-- Logs begin at Mon 2022-02-28 09:46:09 UTC, end at Mon 2022-02-28 10:49:23 UTC. -- Feb 28 10:16:57.226214 dv-cinder-master-3-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Feb 28 10:16:57.237372 dv-cinder-master-3-iscsi devstack@keystone.service[79307]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Feb 28 10:16:57.239422 dv-cinder-master-3-iscsi devstack@keystone.service[79307]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Feb 28 10:16:57 2022] *** Feb 28 10:16:57.239422 dv-cinder-master-3-iscsi devstack@keystone.service[79307]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 28 10:16:57.239422 dv-cinder-master-3-iscsi devstack@keystone.service[79307]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 28 10:16:57.239422 dv-cinder-master-3-iscsi devstack@keystone.service[79307]: nodename: dv-cinder-master-3-iscsi Feb 28 10:16:57.239422 dv-cinder-master-3-iscsi devstack@keystone.service[79307]: machine: x86_64 Feb 28 10:16:57.239422 dv-cinder-master-3-iscsi devstack@keystone.service[79307]: clock source: unix Feb 28 10:16:57.239422 dv-cinder-master-3-iscsi devstack@keystone.service[79307]: pcre jit disabled Feb 28 10:16:57.239422 dv-cinder-master-3-iscsi devstack@keystone.service[79307]: detected number of CPU cores: 4 Feb 28 10:16:57.239422 dv-cinder-master-3-iscsi devstack@keystone.service[79307]: current working directory: / Feb 28 10:16:57.239422 dv-cinder-master-3-iscsi devstack@keystone.service[79307]: detected binary path: /usr/bin/uwsgi-core Feb 28 10:16:57.239951 dv-cinder-master-3-iscsi devstack@keystone.service[79307]: your processes number limit is 47680 Feb 28 10:16:57.239951 dv-cinder-master-3-iscsi devstack@keystone.service[79307]: your memory page size is 4096 bytes Feb 28 10:16:57.239951 dv-cinder-master-3-iscsi devstack@keystone.service[79307]: detected max file descriptor number: 2048 Feb 28 10:16:57.239951 dv-cinder-master-3-iscsi devstack@keystone.service[79307]: lock engine: pthread robust mutexes Feb 28 10:16:57.239951 dv-cinder-master-3-iscsi devstack@keystone.service[79307]: thunder lock: enabled Feb 28 10:16:57.239951 dv-cinder-master-3-iscsi devstack@keystone.service[79307]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Feb 28 10:16:57.239951 dv-cinder-master-3-iscsi devstack@keystone.service[79307]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 28 10:16:57.284405 dv-cinder-master-3-iscsi devstack@keystone.service[79307]: Python main interpreter initialized at 0x55f88598d9c0 Feb 28 10:16:57.284405 dv-cinder-master-3-iscsi devstack@keystone.service[79307]: python threads support enabled Feb 28 10:16:57.284405 dv-cinder-master-3-iscsi devstack@keystone.service[79307]: your server socket listen backlog is limited to 100 connections Feb 28 10:16:57.284405 dv-cinder-master-3-iscsi devstack@keystone.service[79307]: your mercy for graceful operations on workers is 90 seconds Feb 28 10:16:57.284734 dv-cinder-master-3-iscsi devstack@keystone.service[79307]: mapped 403077 bytes (393 KB) for 2 cores Feb 28 10:16:57.284836 dv-cinder-master-3-iscsi devstack@keystone.service[79307]: *** Operational MODE: preforking *** Feb 28 10:16:57.285106 dv-cinder-master-3-iscsi devstack@keystone.service[79307]: *** uWSGI is running in multiple interpreter mode *** Feb 28 10:16:57.285106 dv-cinder-master-3-iscsi devstack@keystone.service[79307]: spawned uWSGI master process (pid: 79307) Feb 28 10:16:57.285305 dv-cinder-master-3-iscsi systemd[1]: Started Devstack devstack@keystone.service. Feb 28 10:16:57.288024 dv-cinder-master-3-iscsi devstack@keystone.service[79307]: spawned uWSGI worker 1 (pid: 79318, cores: 1) Feb 28 10:16:57.288024 dv-cinder-master-3-iscsi devstack@keystone.service[79307]: spawned uWSGI worker 2 (pid: 79319, cores: 1) Feb 28 10:16:57.288024 dv-cinder-master-3-iscsi devstack@keystone.service[79307]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 28 10:17:03.173506 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 28 10:17:03.173506 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: from cryptography.utils import int_from_bytes Feb 28 10:17:03.174077 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 28 10:17:03.174077 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: from cryptography.utils import int_from_bytes Feb 28 10:17:03.174501 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 28 10:17:03.174501 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: from cryptography.utils import int_from_bytes Feb 28 10:17:03.175225 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 28 10:17:03.175225 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: from cryptography.utils import int_from_bytes Feb 28 10:17:03.222120 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 28 10:17:03.222334 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 28 10:17:03.222414 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 28 10:17:03.222496 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 28 10:17:03.222566 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] command line args: [] {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 28 10:17:03.223086 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] command line args: [] {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 28 10:17:03.223167 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 28 10:17:03.223230 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 28 10:17:03.223289 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ================================================================================ {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 28 10:17:03.223348 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ================================================================================ {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 28 10:17:03.223415 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] admin_token = **** {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.223475 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] admin_token = **** {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.223539 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] config_dir = [] {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.223599 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] config_dir = [] {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.223657 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.223719 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.223789 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] config_source = [] {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.223849 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] config_source = [] {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.224113 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] debug = True {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.224198 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] debug = True {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.224266 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.224534 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.225639 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.225639 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.225639 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.225639 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.225894 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.225960 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] list_limit = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.226025 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.226085 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] log_config_append = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.226085 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.226351 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] log_dir = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.226440 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.226503 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] log_file = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.226698 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.226791 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.226923 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.227154 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.227253 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] list_limit = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.227398 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.227484 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] log_config_append = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.227620 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.227768 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.227856 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.227990 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.228131 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] log_dir = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.228215 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.228417 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] log_file = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.228507 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.228656 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.228852 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.228936 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.229110 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.229297 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.229386 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.229608 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.229778 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.229978 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.230140 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.230140 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.230463 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.230631 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.21/identity {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.230809 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.230955 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] publish_errors = False {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.231103 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.231243 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.231243 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.231540 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.231672 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.231800 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.231936 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.232071 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.232198 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.232325 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.232453 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] standard_threads = False {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.232579 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.232778 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.232945 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.233080 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.233208 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.233343 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.233343 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] use_journal = False {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.233343 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] use_json = False {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.233343 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] use_stderr = False {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.234103 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.21/identity {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.234103 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] publish_errors = False {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.234103 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.234473 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] use_syslog = False {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.234631 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.234631 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.234889 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.235026 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.235156 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.235291 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.235437 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.235601 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] standard_threads = False {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.235737 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.235876 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.236011 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.236145 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.236275 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.236403 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.236531 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.236670 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] use_journal = False {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.236670 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] use_json = False {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.236919 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.237048 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] use_stderr = False {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.237176 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.237321 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] use_syslog = False {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.237458 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.237594 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 10:17:03.237722 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.237850 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.237978 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.238185 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.238317 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.238445 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.238574 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.238743 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.238872 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.239012 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.239157 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.239293 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.239429 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.239564 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.239701 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.239839 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.239968 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.240104 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.240236 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.240365 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.240500 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.240640 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.240810 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.240975 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.241124 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.241252 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.241381 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.241518 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.241647 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.241781 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.241915 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.242044 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.242178 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.242315 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.242445 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.242574 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.242854 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.242993 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.243122 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.243261 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.243396 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.243531 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.243661 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.243661 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.243911 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.244052 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.244182 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.244311 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.244445 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.244574 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.244702 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.244914 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.245045 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.245179 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.245313 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.245448 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.245576 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.245713 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.245842 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.245970 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.246107 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.246236 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.246364 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.246499 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.246667 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.246802 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.246931 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.247060 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.247199 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.247328 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.247462 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.247591 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.247725 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.247854 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.247990 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.248125 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.248254 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.248931 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.248931 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.249297 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.249439 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.249574 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.249574 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.249816 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.249816 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.250057 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.250193 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.250322 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.250450 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.250584 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.250759 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.251239 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.251388 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.251525 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.251690 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.251833 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.252224 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.252421 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.252649 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.252851 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.253019 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.253243 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.253410 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.253601 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.253844 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.254010 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.254010 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.254010 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.254010 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.254777 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.255010 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.255210 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.255377 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.255604 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.255769 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.255992 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.256160 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.256385 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.256596 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.256762 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.256956 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.257153 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.257153 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.257153 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.257153 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.257153 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.257847 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.258012 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.258267 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.258444 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.258587 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.258801 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.258934 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.259064 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.259202 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.259333 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.259473 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.259610 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.259740 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.259877 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.260007 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.260166 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.260308 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.260439 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.260568 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.260713 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.260844 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.260973 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.261188 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.261329 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.261461 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.261590 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.261719 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.261855 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.261986 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.262115 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.262250 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.262380 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.262520 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.262840 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.262840 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.263101 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.263230 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.263359 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.263490 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.263626 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.263757 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.263932 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.264182 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.264346 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.264478 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.264617 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.264767 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.264909 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.265040 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.265176 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.265305 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.265434 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.265564 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.265701 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.265832 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.265961 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.266090 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.266220 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.266348 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.266493 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.266662 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] auth.external = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.266807 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.266938 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.267067 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.267202 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.267343 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.267473 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.267603 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.267733 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] auth.password = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.267862 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.267991 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] auth.token = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.268129 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.268260 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.268399 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.268529 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.268658 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.268788 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.268925 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.269082 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.269224 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.269367 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.269499 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.269629 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.269759 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.269890 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.270027 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.270158 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] credential.caching = True {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.270297 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] auth.external = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.270428 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.270558 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.270711 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.270855 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.270989 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.271125 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.271264 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.271395 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] auth.password = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.271532 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.271663 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] auth.token = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.271801 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.271932 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.272072 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.272203 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.272341 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.272472 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.272602 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.272732 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.272732 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.272978 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.273115 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.273115 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.273361 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.273491 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] credential.caching = True {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.273620 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.273750 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.273898 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.274030 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.274161 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.274291 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.274427 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.274557 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.274741 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] federation.caching = True {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.274741 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.274988 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.275136 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.275267 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.275397 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.275535 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.275666 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.275806 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.275806 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.276060 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.276192 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.276329 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.276466 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.276596 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.276726 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.276856 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.276986 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.277191 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.277332 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.277463 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.277463 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.277718 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.277854 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] identity.caching = True {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.277993 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] federation.caching = True {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.278124 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.278255 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.278385 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.278515 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.278663 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.278809 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.278941 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.279161 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.279325 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.279464 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.280428 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.280576 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.280708 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.280838 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.280980 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.281111 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.281282 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.281426 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.281558 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.281699 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.281829 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.281959 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.282090 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.282237 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] identity.caching = True {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.282371 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.282501 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.282658 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.282795 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.282926 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.283067 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.283199 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.283329 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.283461 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.283591 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.283740 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.283872 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.284017 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.284148 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.284278 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.284408 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.284547 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.284679 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.284809 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.284939 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.285069 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.285200 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.285337 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.285468 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.285599 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.285729 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.285870 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.286001 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.286139 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.286271 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.286401 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.286533 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.286687 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.286818 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.286959 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.287091 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.287222 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.287352 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.287482 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.287613 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.287761 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.287893 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.288023 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.288154 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.288284 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.288414 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.288551 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.288682 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.288813 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.288943 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.289072 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.289202 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.289343 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.289485 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.289616 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.289756 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.289890 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.290029 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.290169 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.290300 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.290430 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.290560 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.290765 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.290896 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.290896 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.291152 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.291282 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.291423 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.291639 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.291803 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.291944 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.292076 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.292206 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.292336 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.292466 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.292595 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.292733 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.292865 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.user = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.292995 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.293125 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.293255 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.293395 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.293533 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.293664 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.293795 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.293926 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.294056 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.294186 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.294324 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.294456 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.294586 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.294740 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.294871 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.295002 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.295191 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.295417 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.295558 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.295689 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.295959 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.296195 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.296338 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.user = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.296469 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.296600 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.296730 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.296860 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.296992 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.297135 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.297267 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.297408 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.297540 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.297671 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.297809 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.297940 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.298072 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.298203 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.298333 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.298464 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.298649 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.298787 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.298918 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.299049 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.299181 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.299322 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.299464 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.299596 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.299726 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.299861 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.299992 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.300122 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.300262 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.300394 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.300525 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.300662 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.300800 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.300943 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.301099 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.301238 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.301376 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.301512 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.301649 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.301796 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.301942 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.302086 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.302224 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.302362 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.302499 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.302653 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.302807 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.302945 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.303092 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.303230 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.303367 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] resource.caching = True {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.303503 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.303648 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.303785 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.303922 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.304065 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.304202 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.304338 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.304549 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.304689 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.304826 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.304963 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.305110 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.305248 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.305393 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.305532 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.305669 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.305806 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.305943 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.305943 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] role.caching = True {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.306208 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.306208 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.306468 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] role.driver = sql {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.306468 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.306764 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] resource.caching = True {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.306915 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.307063 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.307201 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.307338 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.307475 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.307612 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.307749 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.307894 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.308032 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.308169 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.308169 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.308426 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.308564 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.308709 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.308856 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.308856 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.309123 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.309260 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] role.caching = True {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.309397 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.309542 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] role.driver = sql {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.309680 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.309817 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.309953 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.310090 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.310227 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.310372 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.310511 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.310681 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.310681 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.311085 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.311296 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.311453 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.311592 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.311739 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.311878 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.312016 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.312161 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.312305 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.312442 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.312579 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.312579 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.312850 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.312996 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.313133 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.313271 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.313408 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.313545 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.313681 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.313827 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.313827 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.314086 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.314223 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.314360 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.314496 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.314671 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.314815 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.314953 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.315090 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.315244 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.315460 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.315640 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.315781 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.315918 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.316055 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.316190 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.316327 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] token.caching = True {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.316327 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.316607 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.316607 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.316867 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.317004 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.317141 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.317286 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.317424 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.317561 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.317698 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.317834 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.317970 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.318116 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.318254 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.318390 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.318536 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.318723 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.318873 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.319012 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.319150 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.319286 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.319423 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.319559 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] token.caching = True {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.319704 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.319841 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.319978 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.320367 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.320504 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.320651 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.320797 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.320797 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.321055 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.321055 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.321314 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.321450 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.321607 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] database.connection = **** {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.321758 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.321908 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.322046 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.322184 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.322321 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.322458 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.322624 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.322778 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.322916 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.323052 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.323189 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.323327 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.323327 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.323593 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.323731 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.323868 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.324005 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.324141 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.324279 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.324424 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.324572 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.324710 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.324848 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.324984 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] database.connection = **** {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.325130 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.325276 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.325422 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.325567 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.325705 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.325842 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.325979 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.326115 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.326260 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.326989 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.327148 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.327148 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 28 10:17:03.327409 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.327409 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.327409 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.327409 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.327409 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.327409 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.327409 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.327409 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.327409 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.328620 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.328620 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.328620 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.328620 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 10:17:03.328620 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 28 10:17:03.343759 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.343982 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.344207 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.344547 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.344787 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.345021 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.352716 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.353621 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.382929 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.383159 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.385891 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.386234 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.438571 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.439700 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.490140 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.490512 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.491236 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.491474 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.558167 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.558358 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.558591 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.558737 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.558820 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.559037 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.559184 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.559271 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.559452 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.559652 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.559965 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.560295 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.586232 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.586481 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.586723 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.586818 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.586981 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.587139 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.587234 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.587367 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.587522 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.587615 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.587848 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.588131 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.588410 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.588690 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.599472 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.600109 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.612981 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.613249 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.613454 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.613592 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.613736 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.613865 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.613995 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.614136 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.614264 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.614393 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.614521 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.614685 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.614932 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.615211 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 10:17:03.632229 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.632407 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.632574 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 28 10:17:03.632721 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 28 10:17:03.633031 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.633161 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.633291 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 28 10:17:03.633419 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 28 10:17:03.633549 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.633753 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.633882 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.634011 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.634213 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.634344 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.634590 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.634933 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.645683 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.645956 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.646222 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.646353 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.646498 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.646829 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.647162 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.647506 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.654488 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:17:03.655514 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:17:03.658203 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:17:03.658476 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.658771 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.658988 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:17:03.659144 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.659305 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.659435 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.659566 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.659805 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.659995 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.660140 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.660317 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.660445 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.660597 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.660838 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.660978 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.661218 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.661547 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.661884 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.662216 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.662548 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.662899 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.688130 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.689489 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.689708 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:17:03.689991 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.691249 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:17:03.691595 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.695373 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:17:03.695644 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.695924 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.697224 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:17:03.697571 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.697915 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.703590 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:17:03.703866 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.705239 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:17:03.705590 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.708244 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:17:03.708524 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.708861 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.709221 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.709537 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.709815 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.710080 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.710343 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.710727 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:17:03.711074 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.711416 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.711755 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.712089 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.712424 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.712758 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.713089 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.729589 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.729860 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.731944 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.732289 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.734886 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:17:03.737115 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:17:03.738407 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.738726 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.740876 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.741237 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.743689 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:17:03.746342 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:17:03.747178 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:17:03.750758 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:17:03.751648 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.751939 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.752217 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.752509 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.752778 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.753047 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.754793 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.755156 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.755510 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.755860 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.756203 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.756548 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.772722 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:17:03.772999 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.773262 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.773528 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.776250 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:17:03.776601 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.776943 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.777274 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.782221 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.783897 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.784169 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.786023 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.787243 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:17:03.787519 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.787798 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.787985 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.788116 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.788339 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.788468 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.791428 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:17:03.791792 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.792230 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.792488 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.792846 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.801771 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:17:03.802043 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.802316 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.802592 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.802894 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.803171 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.803445 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.806425 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:17:03.806795 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.807144 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.807491 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.807838 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.808177 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.808518 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.822135 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:17:03.825277 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:17:03.828918 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:17:03.829490 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.831075 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.832318 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:17:03.833908 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:17:03.834179 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.834452 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.835815 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.837351 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.838956 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:17:03.839232 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.839507 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.845031 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.845031 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:17:03.848180 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.848479 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.848762 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.849036 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.952302 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.953844 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:17:03.957004 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.957301 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.957578 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.957851 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.961919 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:17:03.962222 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.962506 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.966979 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:17:03.967986 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.968271 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.971277 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:17:03.971564 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.971840 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.972109 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.972373 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.972642 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.973104 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.973375 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.973734 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.974035 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.976132 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 10:17:03.976361 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.976636 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.976901 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.977162 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.977426 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.977711 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.977978 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.978242 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.978648 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.978919 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.979184 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.979458 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.979720 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.979940 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.980292 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.981107 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:03.981399 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 10:17:04.017318 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55f88598d9c0 pid: 79319 (default app) Feb 28 10:17:04.019685 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55f88598d9c0 pid: 79318 (default app) Feb 28 10:17:04.020837 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0992a5-3a68-4fbf-8477-305f5485bca0 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:04.021128 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0992a5-3a68-4fbf-8477-305f5485bca0 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:04.021400 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0992a5-3a68-4fbf-8477-305f5485bca0 None None] PATH_INFO: `/v3` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:04.025533 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1/1] 10.222.0.21 () {50 vars in 791 bytes} [Mon Feb 28 10:17:04 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:12.271350 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206cc98-7ef0-44e5-9ce5-2de596c2c143 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:12.271889 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206cc98-7ef0-44e5-9ce5-2de596c2c143 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:12.271889 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206cc98-7ef0-44e5-9ce5-2de596c2c143 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:12.278657 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1/2] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:17:12 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:17:12.284515 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb9541-3b25-4756-80bc-35b6e294ec1f None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:12.284948 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb9541-3b25-4756-80bc-35b6e294ec1f None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:12.285124 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb9541-3b25-4756-80bc-35b6e294ec1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:12.316835 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG oslo_db.sqlalchemy.engines [None req-2dfb9541-3b25-4756-80bc-35b6e294ec1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 28 10:17:12.496056 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG passlib.handlers.bcrypt [None req-2dfb9541-3b25-4756-80bc-35b6e294ec1f None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79319) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 28 10:17:12.496477 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG passlib.handlers.bcrypt [None req-2dfb9541-3b25-4756-80bc-35b6e294ec1f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79319) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 28 10:17:12.552460 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-2dfb9541-3b25-4756-80bc-35b6e294ec1f None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:17:12.554040 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-2dfb9541-3b25-4756-80bc-35b6e294ec1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:17:12.673769 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 2/3] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:17:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 28 10:17:12.802224 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206cc98-7ef0-44e5-9ce5-2de596c2c143 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:12.836615 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG oslo_db.sqlalchemy.engines [None req-a206cc98-7ef0-44e5-9ce5-2de596c2c143 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79318) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 28 10:17:12.962721 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206cc98-7ef0-44e5-9ce5-2de596c2c143 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:12.967202 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eacf939-6f55-44c6-b736-5d401f97cbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:12.967862 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eacf939-6f55-44c6-b736-5d401f97cbc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:12.968148 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eacf939-6f55-44c6-b736-5d401f97cbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:12.968424 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eacf939-6f55-44c6-b736-5d401f97cbc7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:12.976493 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eacf939-6f55-44c6-b736-5d401f97cbc7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:13.027438 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0eacf939-6f55-44c6-b736-5d401f97cbc7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 28 10:17:13.027783 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eacf939-6f55-44c6-b736-5d401f97cbc7 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:13.037767 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 2/4] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 10:17:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 10:17:13.043831 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb9541-3b25-4756-80bc-35b6e294ec1f None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:13.058554 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb9541-3b25-4756-80bc-35b6e294ec1f None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:13.063002 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68272694-186f-46d5-96f0-534823ed8769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:13.064089 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68272694-186f-46d5-96f0-534823ed8769 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:13.064372 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68272694-186f-46d5-96f0-534823ed8769 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:13.064642 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68272694-186f-46d5-96f0-534823ed8769 admin admin] PATH_INFO: `/v3/projects/e5bfe7c1c3cf44edb4e5e5f5ea06d32a` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:13.066114 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68272694-186f-46d5-96f0-534823ed8769 admin admin] RBAC: Authorizing `identity:get_project(project_id=e5bfe7c1c3cf44edb4e5e5f5ea06d32a)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:13.118727 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.common.rbac_enforcer.enforcer [None req-68272694-186f-46d5-96f0-534823ed8769 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 28 10:17:13.119009 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68272694-186f-46d5-96f0-534823ed8769 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:13.123607 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 3/5] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Feb 28 10:17:13 2022] GET /identity/v3/projects/e5bfe7c1c3cf44edb4e5e5f5ea06d32a => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:17:15.422996 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852fc7f-a8d0-4345-84b7-e46ff886d70c None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:15.423519 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852fc7f-a8d0-4345-84b7-e46ff886d70c None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:15.423519 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852fc7f-a8d0-4345-84b7-e46ff886d70c None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:15.427992 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 3/6] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:17:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:17:15.433502 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe714fe-9a4c-4e16-b241-1376f1835525 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:15.433875 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe714fe-9a4c-4e16-b241-1376f1835525 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:15.434054 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe714fe-9a4c-4e16-b241-1376f1835525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:15.453306 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-7fe714fe-9a4c-4e16-b241-1376f1835525 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:17:15.454822 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-7fe714fe-9a4c-4e16-b241-1376f1835525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:17:15.462813 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 4/7] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:17:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 28 10:17:15.485571 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852fc7f-a8d0-4345-84b7-e46ff886d70c None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:15.497475 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852fc7f-a8d0-4345-84b7-e46ff886d70c None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:15.501698 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38499674-f947-4182-bef4-2e5509942a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:15.502316 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38499674-f947-4182-bef4-2e5509942a06 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:15.502619 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38499674-f947-4182-bef4-2e5509942a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:15.502899 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38499674-f947-4182-bef4-2e5509942a06 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:15.510331 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38499674-f947-4182-bef4-2e5509942a06 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:15.512106 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38499674-f947-4182-bef4-2e5509942a06 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:15.521838 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 4/8] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Feb 28 10:17:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 10:17:15.527251 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe714fe-9a4c-4e16-b241-1376f1835525 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:15.536809 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe714fe-9a4c-4e16-b241-1376f1835525 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:15.541223 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9666721-a6e5-45e4-8b70-41eeb51ccd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:15.542071 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9666721-a6e5-45e4-8b70-41eeb51ccd2e admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:15.542354 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9666721-a6e5-45e4-8b70-41eeb51ccd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:15.542662 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9666721-a6e5-45e4-8b70-41eeb51ccd2e admin admin] PATH_INFO: `/v3/users/6ceda84916c547c4bc3f54154671eb74` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:15.544048 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9666721-a6e5-45e4-8b70-41eeb51ccd2e admin admin] RBAC: Authorizing `identity:get_user(user_id=6ceda84916c547c4bc3f54154671eb74)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:15.545982 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9666721-a6e5-45e4-8b70-41eeb51ccd2e admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:15.547585 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 5/9] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Feb 28 10:17:15 2022] GET /identity/v3/users/6ceda84916c547c4bc3f54154671eb74 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:17.948317 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee2f96-c662-49c8-b3a9-ac6cf308dd87 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:17.948847 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee2f96-c662-49c8-b3a9-ac6cf308dd87 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:17.948847 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee2f96-c662-49c8-b3a9-ac6cf308dd87 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:17.950705 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 5/10] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:17:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:17:17.952181 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0f533-f257-4a54-9048-b3a208e67da6 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:17.952627 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0f533-f257-4a54-9048-b3a208e67da6 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:17.952723 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0f533-f257-4a54-9048-b3a208e67da6 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:17.954894 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 6/11] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:17:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:17:17.955838 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944f97f-144a-4764-a62e-38dcc6132628 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:17.956120 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944f97f-144a-4764-a62e-38dcc6132628 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:17.956394 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944f97f-144a-4764-a62e-38dcc6132628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:17.959769 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8b93d-8e48-47c5-84e8-8a60dfbfaeab None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:17.960051 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8b93d-8e48-47c5-84e8-8a60dfbfaeab None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:17.960328 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8b93d-8e48-47c5-84e8-8a60dfbfaeab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:17.977055 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-bba8b93d-8e48-47c5-84e8-8a60dfbfaeab None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:17:17.978242 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-bba8b93d-8e48-47c5-84e8-8a60dfbfaeab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:17:17.997624 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG passlib.handlers.bcrypt [None req-d944f97f-144a-4764-a62e-38dcc6132628 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79318) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 28 10:17:17.998666 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG passlib.handlers.bcrypt [None req-d944f97f-144a-4764-a62e-38dcc6132628 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79318) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 28 10:17:18.046984 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-d944f97f-144a-4764-a62e-38dcc6132628 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:17:18.048568 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-d944f97f-144a-4764-a62e-38dcc6132628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:17:18.061521 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 7/12] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:17:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 10:17:18.084182 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8b93d-8e48-47c5-84e8-8a60dfbfaeab None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:18.145325 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 6/13] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:17:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 10:17:18.168890 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944f97f-144a-4764-a62e-38dcc6132628 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:18.178993 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8b93d-8e48-47c5-84e8-8a60dfbfaeab None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:18.211494 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff96415-04a7-44c2-8f67-d7dc223ebcae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:18.212135 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff96415-04a7-44c2-8f67-d7dc223ebcae None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:18.212416 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff96415-04a7-44c2-8f67-d7dc223ebcae None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:18.212686 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff96415-04a7-44c2-8f67-d7dc223ebcae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:18.264911 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944f97f-144a-4764-a62e-38dcc6132628 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:18.276101 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff96415-04a7-44c2-8f67-d7dc223ebcae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:18.277570 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff96415-04a7-44c2-8f67-d7dc223ebcae None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:18.297245 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040d0cc-364b-4e34-ae83-fe90c856bba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:18.298258 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040d0cc-364b-4e34-ae83-fe90c856bba0 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:18.298539 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040d0cc-364b-4e34-ae83-fe90c856bba0 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:18.298842 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040d0cc-364b-4e34-ae83-fe90c856bba0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:18.309860 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4040d0cc-364b-4e34-ae83-fe90c856bba0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:17:18.316693 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-4040d0cc-364b-4e34-ae83-fe90c856bba0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:17:18.317868 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 7/14] 10.222.0.21 () {56 vars in 1096 bytes} [Mon Feb 28 10:17:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:17:18.324083 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040d0cc-364b-4e34-ae83-fe90c856bba0 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:18.374970 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 8/15] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:17:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Feb 28 10:17:18.380446 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff96415-04a7-44c2-8f67-d7dc223ebcae None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:18.419053 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040d0cc-364b-4e34-ae83-fe90c856bba0 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:18.449954 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457cb81f-1cc4-42f5-b25c-ad1849fc79ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:18.450617 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457cb81f-1cc4-42f5-b25c-ad1849fc79ad None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:18.451451 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457cb81f-1cc4-42f5-b25c-ad1849fc79ad None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:18.451771 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457cb81f-1cc4-42f5-b25c-ad1849fc79ad None admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:18.452565 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457cb81f-1cc4-42f5-b25c-ad1849fc79ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:17:18.452868 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457cb81f-1cc4-42f5-b25c-ad1849fc79ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:18.454284 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457cb81f-1cc4-42f5-b25c-ad1849fc79ad None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:18.465407 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 8/16] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:17:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:17:18.471645 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457cb81f-1cc4-42f5-b25c-ad1849fc79ad None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:18.473701 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff96415-04a7-44c2-8f67-d7dc223ebcae None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:18.505875 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244b01e-8acd-47f9-9e5f-4c6bcfc3f7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:18.506678 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244b01e-8acd-47f9-9e5f-4c6bcfc3f7b6 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:18.506955 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244b01e-8acd-47f9-9e5f-4c6bcfc3f7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:18.507220 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244b01e-8acd-47f9-9e5f-4c6bcfc3f7b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:18.517624 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8244b01e-8acd-47f9-9e5f-4c6bcfc3f7b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:18.519099 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8244b01e-8acd-47f9-9e5f-4c6bcfc3f7b6 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:18.535980 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-8244b01e-8acd-47f9-9e5f-4c6bcfc3f7b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:17:18.537137 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 9/17] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:17:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:17:18.542710 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244b01e-8acd-47f9-9e5f-4c6bcfc3f7b6 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:18.564025 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457cb81f-1cc4-42f5-b25c-ad1849fc79ad None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:18.596509 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d4d9d9-785e-4e33-b261-efb0b395a4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:18.597362 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4d9d9-785e-4e33-b261-efb0b395a4a3 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:18.597640 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4d9d9-785e-4e33-b261-efb0b395a4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:18.597917 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4d9d9-785e-4e33-b261-efb0b395a4a3 None admin] PATH_INFO: `/v3/users/6ceda84916c547c4bc3f54154671eb74` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:18.599457 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d4d9d9-785e-4e33-b261-efb0b395a4a3 None admin] RBAC: Authorizing `identity:get_user(user_id=6ceda84916c547c4bc3f54154671eb74)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:18.600882 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d4d9d9-785e-4e33-b261-efb0b395a4a3 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:18.602472 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 9/18] 10.222.0.21 () {56 vars in 1177 bytes} [Mon Feb 28 10:17:18 2022] GET /identity/v3/users/6ceda84916c547c4bc3f54154671eb74 => generated 247 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:17:18.607792 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d4d9d9-785e-4e33-b261-efb0b395a4a3 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:18.636764 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244b01e-8acd-47f9-9e5f-4c6bcfc3f7b6 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:18.670810 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372465b-a64b-466e-a589-d8f908a71b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:18.671391 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372465b-a64b-466e-a589-d8f908a71b53 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:18.671671 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372465b-a64b-466e-a589-d8f908a71b53 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:18.671942 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372465b-a64b-466e-a589-d8f908a71b53 None admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:18.672650 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372465b-a64b-466e-a589-d8f908a71b53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:17:18.672947 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372465b-a64b-466e-a589-d8f908a71b53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:18.674312 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372465b-a64b-466e-a589-d8f908a71b53 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:18.691635 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 10/19] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:17:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:17:18.699714 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d4d9d9-785e-4e33-b261-efb0b395a4a3 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:18.735286 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5d1db-de24-4f6f-82af-309f768e9531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:18.736086 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5d1db-de24-4f6f-82af-309f768e9531 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:18.736366 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5d1db-de24-4f6f-82af-309f768e9531 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:18.736633 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5d1db-de24-4f6f-82af-309f768e9531 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:18.738123 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee5d1db-de24-4f6f-82af-309f768e9531 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:18.739622 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee5d1db-de24-4f6f-82af-309f768e9531 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:18.741247 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 10/20] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:17:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:17:18.747271 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372465b-a64b-466e-a589-d8f908a71b53 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:18.851831 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372465b-a64b-466e-a589-d8f908a71b53 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:18.886386 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a434fd-d9f8-4678-8479-3616cf090c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:18.887068 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a434fd-d9f8-4678-8479-3616cf090c6f None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:18.887344 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a434fd-d9f8-4678-8479-3616cf090c6f None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:18.887614 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a434fd-d9f8-4678-8479-3616cf090c6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:18.888468 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a434fd-d9f8-4678-8479-3616cf090c6f None admin] RBAC: Adding query filter params (role.id=48e4608a7b3f4b87a20b10c4d1b45aa9, scope.domain.id=default, user.id=6ceda84916c547c4bc3f54154671eb74) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:17:18.889290 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a434fd-d9f8-4678-8479-3616cf090c6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:18.890759 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a434fd-d9f8-4678-8479-3616cf090c6f None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:18.897638 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 11/21] 10.222.0.21 () {56 vars in 1322 bytes} [Mon Feb 28 10:17:18 2022] GET /identity/v3/role_assignments?user.id=6ceda84916c547c4bc3f54154671eb74&scope.domain.id=default&role.id=48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 233 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:21.603254 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048c6ba-4c42-4bb3-8370-8b6390f23827 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:21.604246 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048c6ba-4c42-4bb3-8370-8b6390f23827 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:21.604807 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048c6ba-4c42-4bb3-8370-8b6390f23827 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:21.607679 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 11/22] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:17:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:17:21.620639 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6520111-019f-45fe-9841-1ce0f718d10a None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:21.621606 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6520111-019f-45fe-9841-1ce0f718d10a None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:21.622077 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6520111-019f-45fe-9841-1ce0f718d10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:21.651762 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-e6520111-019f-45fe-9841-1ce0f718d10a None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:17:21.653346 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-e6520111-019f-45fe-9841-1ce0f718d10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:17:21.741146 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 12/23] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:17:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:17:21.785889 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048c6ba-4c42-4bb3-8370-8b6390f23827 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:21.924474 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1380b-2b85-47f7-ba03-f29b8f819ab1 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:21.924674 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1380b-2b85-47f7-ba03-f29b8f819ab1 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:21.925151 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1380b-2b85-47f7-ba03-f29b8f819ab1 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:21.927442 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 13/24] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:17:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:17:21.933682 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b29ae2-5169-40e7-bdef-39121b46a1a0 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:21.934236 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b29ae2-5169-40e7-bdef-39121b46a1a0 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:21.934768 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b29ae2-5169-40e7-bdef-39121b46a1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:21.954331 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048c6ba-4c42-4bb3-8370-8b6390f23827 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:21.984057 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-a6b29ae2-5169-40e7-bdef-39121b46a1a0 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:17:21.985606 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-a6b29ae2-5169-40e7-bdef-39121b46a1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:17:21.990495 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c7bd5-4fa3-4f23-bd72-1f5ad218033c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:21.991509 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c7bd5-4fa3-4f23-bd72-1f5ad218033c None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:21.991937 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c7bd5-4fa3-4f23-bd72-1f5ad218033c None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:21.992385 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c7bd5-4fa3-4f23-bd72-1f5ad218033c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:22.012163 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c7bd5-4fa3-4f23-bd72-1f5ad218033c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:22.013979 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c7bd5-4fa3-4f23-bd72-1f5ad218033c None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:22.038861 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-f55c7bd5-4fa3-4f23-bd72-1f5ad218033c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:17:22.040750 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 12/25] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:17:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:17:22.048735 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c7bd5-4fa3-4f23-bd72-1f5ad218033c None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:22.121313 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 14/26] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:17:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:17:22.122786 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42144c-f3f0-4495-976c-78c8d509c7f0 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:22.123082 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42144c-f3f0-4495-976c-78c8d509c7f0 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:22.123361 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42144c-f3f0-4495-976c-78c8d509c7f0 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:22.125209 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 15/27] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:17:22.131203 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699d127-9f30-4b31-b5f2-c8a8694786f3 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:22.131483 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699d127-9f30-4b31-b5f2-c8a8694786f3 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:22.131923 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699d127-9f30-4b31-b5f2-c8a8694786f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:22.167096 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-e699d127-9f30-4b31-b5f2-c8a8694786f3 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:17:22.169534 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-e699d127-9f30-4b31-b5f2-c8a8694786f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:17:22.172537 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c7bd5-4fa3-4f23-bd72-1f5ad218033c None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:22.208812 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323f39b-e43b-4297-80c2-827853f69a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:22.210408 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323f39b-e43b-4297-80c2-827853f69a29 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:22.210926 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323f39b-e43b-4297-80c2-827853f69a29 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:22.211608 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323f39b-e43b-4297-80c2-827853f69a29 None admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:22.212537 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2323f39b-e43b-4297-80c2-827853f69a29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:17:22.213386 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2323f39b-e43b-4297-80c2-827853f69a29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:22.215306 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2323f39b-e43b-4297-80c2-827853f69a29 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:22.236288 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 13/28] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:17:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:22.237505 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323f39b-e43b-4297-80c2-827853f69a29 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:22.296160 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 16/29] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:17:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:17:22.297480 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e699d127-9f30-4b31-b5f2-c8a8694786f3 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:22.367321 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323f39b-e43b-4297-80c2-827853f69a29 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:22.402922 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3456d22e-50f4-4b5b-a416-94ae2d991a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:22.403597 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456d22e-50f4-4b5b-a416-94ae2d991a6f None admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:22.403966 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456d22e-50f4-4b5b-a416-94ae2d991a6f None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:22.404988 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456d22e-50f4-4b5b-a416-94ae2d991a6f None admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:22.405808 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3456d22e-50f4-4b5b-a416-94ae2d991a6f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:22.407444 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3456d22e-50f4-4b5b-a416-94ae2d991a6f None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:22.427423 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e699d127-9f30-4b31-b5f2-c8a8694786f3 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:22.462681 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ba5eb3-6462-4d71-8b44-a501b03bc70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:22.463643 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba5eb3-6462-4d71-8b44-a501b03bc70e None admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:22.464064 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba5eb3-6462-4d71-8b44-a501b03bc70e None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:22.464486 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba5eb3-6462-4d71-8b44-a501b03bc70e None admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:22.465341 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ba5eb3-6462-4d71-8b44-a501b03bc70e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:22.467584 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ba5eb3-6462-4d71-8b44-a501b03bc70e None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:22.549895 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 14/30] 10.222.0.21 () {60 vars in 1131 bytes} [Mon Feb 28 10:17:22 2022] POST /identity/v3/roles => generated 219 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:17:22.551841 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49db350-da58-462a-8b21-fcb5960890b3 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:22.552305 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49db350-da58-462a-8b21-fcb5960890b3 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:22.552761 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49db350-da58-462a-8b21-fcb5960890b3 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:22.555042 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 15/31] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:17:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:17:22.558324 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49db350-da58-462a-8b21-fcb5960890b3 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:22.622245 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 17/32] 10.222.0.21 () {60 vars in 1141 bytes} [Mon Feb 28 10:17:22 2022] POST /identity/v3/projects => generated 301 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:17:22.625567 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda2be3-e1c6-49c6-ab25-e80af8d0e4e6 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:22.626036 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda2be3-e1c6-49c6-ab25-e80af8d0e4e6 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:22.626477 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda2be3-e1c6-49c6-ab25-e80af8d0e4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:22.647689 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-2dda2be3-e1c6-49c6-ab25-e80af8d0e4e6 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:17:22.649775 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-2dda2be3-e1c6-49c6-ab25-e80af8d0e4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:17:22.738855 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 18/33] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:17:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:17:22.758900 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda2be3-e1c6-49c6-ab25-e80af8d0e4e6 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:22.768924 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49db350-da58-462a-8b21-fcb5960890b3 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:22.807821 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec3940-d2ba-4514-9d91-19d465ed1ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:22.808500 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec3940-d2ba-4514-9d91-19d465ed1ca6 None admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:22.808786 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec3940-d2ba-4514-9d91-19d465ed1ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:22.809076 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec3940-d2ba-4514-9d91-19d465ed1ca6 None admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:22.809821 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec3940-d2ba-4514-9d91-19d465ed1ca6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:22.811496 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec3940-d2ba-4514-9d91-19d465ed1ca6 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:22.840143 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 16/34] 10.222.0.21 () {60 vars in 1131 bytes} [Mon Feb 28 10:17:22 2022] POST /identity/v3/roles => generated 225 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:17:22.900573 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda2be3-e1c6-49c6-ab25-e80af8d0e4e6 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:22.960714 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880160ff-9b27-4f42-b379-61131f939ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:22.961553 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880160ff-9b27-4f42-b379-61131f939ae8 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:22.961840 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880160ff-9b27-4f42-b379-61131f939ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:22.962126 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880160ff-9b27-4f42-b379-61131f939ae8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:22.978584 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880160ff-9b27-4f42-b379-61131f939ae8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:17:22.986387 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-880160ff-9b27-4f42-b379-61131f939ae8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:17:22.987689 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 19/35] 10.222.0.21 () {56 vars in 1096 bytes} [Mon Feb 28 10:17:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:17:22.993964 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec3940-d2ba-4514-9d91-19d465ed1ca6 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:23.118845 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec3940-d2ba-4514-9d91-19d465ed1ca6 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:23.153928 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc7c3c-f986-473d-a461-e8530b969cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:23.155462 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc7c3c-f986-473d-a461-e8530b969cd3 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:23.155752 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc7c3c-f986-473d-a461-e8530b969cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:23.156034 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc7c3c-f986-473d-a461-e8530b969cd3 None admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:23.156844 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bc7c3c-f986-473d-a461-e8530b969cd3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:17:23.157153 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bc7c3c-f986-473d-a461-e8530b969cd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:23.158542 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bc7c3c-f986-473d-a461-e8530b969cd3 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:23.167707 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 17/36] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:17:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:23.168900 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14c448-f281-4445-a40e-1da3cdb2c6a3 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:23.169190 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14c448-f281-4445-a40e-1da3cdb2c6a3 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:23.169549 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14c448-f281-4445-a40e-1da3cdb2c6a3 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:23.172662 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 20/37] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:17:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:17:23.173849 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc7c3c-f986-473d-a461-e8530b969cd3 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:23.177123 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17faf9c1-bf0c-4678-b5b6-3679a909e342 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:23.177419 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17faf9c1-bf0c-4678-b5b6-3679a909e342 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:23.177698 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17faf9c1-bf0c-4678-b5b6-3679a909e342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:23.206790 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-17faf9c1-bf0c-4678-b5b6-3679a909e342 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:17:23.209238 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-17faf9c1-bf0c-4678-b5b6-3679a909e342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:17:23.277556 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc7c3c-f986-473d-a461-e8530b969cd3 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:23.283181 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 21/38] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:17:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:17:23.284527 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef40ca1-f5a3-49f9-a68d-d16436d967c9 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:23.284826 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef40ca1-f5a3-49f9-a68d-d16436d967c9 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:23.285104 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef40ca1-f5a3-49f9-a68d-d16436d967c9 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:23.286834 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 22/39] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:17:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:17:23.292165 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37274965-d91d-45e8-a8c4-bcc09f1ef04d None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:23.292459 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37274965-d91d-45e8-a8c4-bcc09f1ef04d None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:23.292739 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37274965-d91d-45e8-a8c4-bcc09f1ef04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:23.309015 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-37274965-d91d-45e8-a8c4-bcc09f1ef04d None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:17:23.310769 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-37274965-d91d-45e8-a8c4-bcc09f1ef04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:17:23.311661 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1688b5d-3667-4fa2-8275-b2ccef0ef430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:23.312537 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1688b5d-3667-4fa2-8275-b2ccef0ef430 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:23.312821 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1688b5d-3667-4fa2-8275-b2ccef0ef430 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:23.313096 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1688b5d-3667-4fa2-8275-b2ccef0ef430 None admin] PATH_INFO: `/v3/users/6ceda84916c547c4bc3f54154671eb74` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:23.314314 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1688b5d-3667-4fa2-8275-b2ccef0ef430 None admin] RBAC: Authorizing `identity:get_user(user_id=6ceda84916c547c4bc3f54154671eb74)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:23.315808 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1688b5d-3667-4fa2-8275-b2ccef0ef430 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:23.317418 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 18/40] 10.222.0.21 () {56 vars in 1177 bytes} [Mon Feb 28 10:17:23 2022] GET /identity/v3/users/6ceda84916c547c4bc3f54154671eb74 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:23.318234 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1688b5d-3667-4fa2-8275-b2ccef0ef430 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:23.375904 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 23/41] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:17:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:17:23.376815 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37274965-d91d-45e8-a8c4-bcc09f1ef04d None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:23.415835 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1688b5d-3667-4fa2-8275-b2ccef0ef430 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:23.450389 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322832cb-18be-472f-800a-36958ff366aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:23.451438 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322832cb-18be-472f-800a-36958ff366aa None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:23.451717 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322832cb-18be-472f-800a-36958ff366aa None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:23.451992 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322832cb-18be-472f-800a-36958ff366aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:23.453257 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322832cb-18be-472f-800a-36958ff366aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:23.454723 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322832cb-18be-472f-800a-36958ff366aa None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:23.456317 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 19/42] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:17:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:23.460874 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322832cb-18be-472f-800a-36958ff366aa None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:23.472039 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37274965-d91d-45e8-a8c4-bcc09f1ef04d None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:23.504619 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930f4ca-14b5-4717-8646-170d24457f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:23.505394 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930f4ca-14b5-4717-8646-170d24457f75 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:23.505679 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930f4ca-14b5-4717-8646-170d24457f75 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:23.505958 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930f4ca-14b5-4717-8646-170d24457f75 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:23.507160 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930f4ca-14b5-4717-8646-170d24457f75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:23.508734 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930f4ca-14b5-4717-8646-170d24457f75 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:23.510337 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 24/43] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:17:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:23.511097 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930f4ca-14b5-4717-8646-170d24457f75 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:23.552602 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322832cb-18be-472f-800a-36958ff366aa None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:23.585973 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc7f8a-be18-4924-9adc-557f3a7d3206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:23.586748 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc7f8a-be18-4924-9adc-557f3a7d3206 None admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:23.587038 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc7f8a-be18-4924-9adc-557f3a7d3206 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:23.587313 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc7f8a-be18-4924-9adc-557f3a7d3206 None admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:23.588045 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc7f8a-be18-4924-9adc-557f3a7d3206 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:23.589419 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc7f8a-be18-4924-9adc-557f3a7d3206 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:23.601971 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 20/44] 10.222.0.21 () {60 vars in 1131 bytes} [Mon Feb 28 10:17:23 2022] POST /identity/v3/roles => generated 223 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:17:23.602759 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc7f8a-be18-4924-9adc-557f3a7d3206 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:23.605087 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930f4ca-14b5-4717-8646-170d24457f75 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:23.643187 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a8ac76-552f-4cfb-9236-1a523bb45218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:23.643863 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8ac76-552f-4cfb-9236-1a523bb45218 None admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:23.644130 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8ac76-552f-4cfb-9236-1a523bb45218 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:23.644403 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8ac76-552f-4cfb-9236-1a523bb45218 None admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:23.645123 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a8ac76-552f-4cfb-9236-1a523bb45218 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:23.646649 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a8ac76-552f-4cfb-9236-1a523bb45218 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:23.675054 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 25/45] 10.222.0.21 () {60 vars in 1141 bytes} [Mon Feb 28 10:17:23 2022] POST /identity/v3/projects => generated 312 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:17:23.716841 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc7f8a-be18-4924-9adc-557f3a7d3206 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:23.755799 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e555f-11bb-4a56-8ac7-5deba2370fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:23.756732 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e555f-11bb-4a56-8ac7-5deba2370fe9 None admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:23.757027 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e555f-11bb-4a56-8ac7-5deba2370fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:23.757319 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e555f-11bb-4a56-8ac7-5deba2370fe9 None admin] PATH_INFO: `/v3/domains/default/users/6ceda84916c547c4bc3f54154671eb74/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:23.759749 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129e555f-11bb-4a56-8ac7-5deba2370fe9 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=6ceda84916c547c4bc3f54154671eb74, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:23.761287 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129e555f-11bb-4a56-8ac7-5deba2370fe9 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:23.777929 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 21/46] 10.222.0.21 () {58 vars in 1361 bytes} [Mon Feb 28 10:17:23 2022] PUT /identity/v3/domains/default/users/6ceda84916c547c4bc3f54154671eb74/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:17:26.045535 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90d72a-148c-4dad-842b-e1dfbd97b0cd None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:26.046081 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90d72a-148c-4dad-842b-e1dfbd97b0cd None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:26.046167 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90d72a-148c-4dad-842b-e1dfbd97b0cd None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:26.048126 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 26/47] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:17:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:17:26.053245 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa74140-da16-43b1-b1be-ce0e2cd56309 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:26.053669 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa74140-da16-43b1-b1be-ce0e2cd56309 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:26.053800 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa74140-da16-43b1-b1be-ce0e2cd56309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:26.071365 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-8aa74140-da16-43b1-b1be-ce0e2cd56309 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:17:26.072854 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-8aa74140-da16-43b1-b1be-ce0e2cd56309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:17:26.087070 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0371e56-bdbc-4f23-bdb3-4610791a3284 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:26.087362 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0371e56-bdbc-4f23-bdb3-4610791a3284 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:26.087640 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0371e56-bdbc-4f23-bdb3-4610791a3284 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:26.089405 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 27/48] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:17:26.094779 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd139c-3add-4e9a-9e6b-a6c344344bd0 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:26.095077 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd139c-3add-4e9a-9e6b-a6c344344bd0 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:26.095351 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd139c-3add-4e9a-9e6b-a6c344344bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:26.112277 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-4dcd139c-3add-4e9a-9e6b-a6c344344bd0 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:17:26.113408 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-4dcd139c-3add-4e9a-9e6b-a6c344344bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:17:26.137275 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 22/49] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:17:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 10:17:26.160835 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa74140-da16-43b1-b1be-ce0e2cd56309 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:26.177998 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 28/50] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:17:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 10:17:26.202580 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd139c-3add-4e9a-9e6b-a6c344344bd0 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:26.254724 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa74140-da16-43b1-b1be-ce0e2cd56309 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:26.286303 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec889c4b-7285-460e-b026-e2316a827cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:26.287107 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec889c4b-7285-460e-b026-e2316a827cbe None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:26.287394 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec889c4b-7285-460e-b026-e2316a827cbe None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:26.287665 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec889c4b-7285-460e-b026-e2316a827cbe None admin] PATH_INFO: `/v3/domains/default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:26.288825 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec889c4b-7285-460e-b026-e2316a827cbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:26.290252 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec889c4b-7285-460e-b026-e2316a827cbe None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:26.292056 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 23/51] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:17:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:17:26.298131 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec889c4b-7285-460e-b026-e2316a827cbe None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:26.302928 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd139c-3add-4e9a-9e6b-a6c344344bd0 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:26.334318 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98be60-ae8f-4ddb-b630-7d606d6a7ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:26.335179 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98be60-ae8f-4ddb-b630-7d606d6a7ed0 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:26.335460 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98be60-ae8f-4ddb-b630-7d606d6a7ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:26.335729 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98be60-ae8f-4ddb-b630-7d606d6a7ed0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:26.345890 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd98be60-ae8f-4ddb-b630-7d606d6a7ed0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:17:26.352563 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-dd98be60-ae8f-4ddb-b630-7d606d6a7ed0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:17:26.353722 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 29/52] 10.222.0.21 () {56 vars in 1096 bytes} [Mon Feb 28 10:17:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:17:26.360048 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98be60-ae8f-4ddb-b630-7d606d6a7ed0 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:26.392036 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec889c4b-7285-460e-b026-e2316a827cbe None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:26.425827 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f00a4-cabc-43af-886d-4cb235d73f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:26.426771 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f00a4-cabc-43af-886d-4cb235d73f5f None admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:26.427058 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f00a4-cabc-43af-886d-4cb235d73f5f None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:26.427336 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f00a4-cabc-43af-886d-4cb235d73f5f None admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:26.428037 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0f00a4-cabc-43af-886d-4cb235d73f5f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:26.429473 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0f00a4-cabc-43af-886d-4cb235d73f5f None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:26.454643 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98be60-ae8f-4ddb-b630-7d606d6a7ed0 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:26.456644 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 24/53] 10.222.0.21 () {60 vars in 1140 bytes} [Mon Feb 28 10:17:26 2022] POST /identity/v3/projects => generated 298 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:17:26.490262 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f688d6-73be-472f-83a4-cf6355280bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:26.490969 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f688d6-73be-472f-83a4-cf6355280bcd None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:26.491251 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f688d6-73be-472f-83a4-cf6355280bcd None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:26.491524 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f688d6-73be-472f-83a4-cf6355280bcd None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:26.492279 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f688d6-73be-472f-83a4-cf6355280bcd None admin] RBAC: Adding query filter params (name=admin) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:17:26.492582 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f688d6-73be-472f-83a4-cf6355280bcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:26.494010 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f688d6-73be-472f-83a4-cf6355280bcd None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:26.507358 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 30/54] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:17:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:17:26.513253 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f00a4-cabc-43af-886d-4cb235d73f5f None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:26.618479 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f00a4-cabc-43af-886d-4cb235d73f5f None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:26.651571 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e4463-1cd8-43bc-90bf-dfda391773bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:26.652423 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e4463-1cd8-43bc-90bf-dfda391773bd None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:26.652720 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e4463-1cd8-43bc-90bf-dfda391773bd None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:26.652999 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e4463-1cd8-43bc-90bf-dfda391773bd None admin] PATH_INFO: `/v3/users/6ceda84916c547c4bc3f54154671eb74` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:26.654821 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625e4463-1cd8-43bc-90bf-dfda391773bd None admin] RBAC: Authorizing `identity:get_user(user_id=6ceda84916c547c4bc3f54154671eb74)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:26.656436 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625e4463-1cd8-43bc-90bf-dfda391773bd None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:26.658096 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 25/55] 10.222.0.21 () {56 vars in 1177 bytes} [Mon Feb 28 10:17:26 2022] GET /identity/v3/users/6ceda84916c547c4bc3f54154671eb74 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:17:26.663769 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f688d6-73be-472f-83a4-cf6355280bcd None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:26.758003 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f688d6-73be-472f-83a4-cf6355280bcd None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:26.791094 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa47ef2-a934-4c66-b441-fc066ebda11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:26.791880 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa47ef2-a934-4c66-b441-fc066ebda11b None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:26.792168 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa47ef2-a934-4c66-b441-fc066ebda11b None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:26.792447 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa47ef2-a934-4c66-b441-fc066ebda11b None admin] PATH_INFO: `/v3/domains/default` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:26.793621 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa47ef2-a934-4c66-b441-fc066ebda11b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:26.795153 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa47ef2-a934-4c66-b441-fc066ebda11b None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:26.796766 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 31/56] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:17:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:17:26.802461 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e4463-1cd8-43bc-90bf-dfda391773bd None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:26.898738 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e4463-1cd8-43bc-90bf-dfda391773bd None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:26.930340 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c9a77-ccac-47a6-a204-fcaa64af72fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:26.930953 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c9a77-ccac-47a6-a204-fcaa64af72fe None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:26.931242 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c9a77-ccac-47a6-a204-fcaa64af72fe None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:26.931549 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c9a77-ccac-47a6-a204-fcaa64af72fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:26.932367 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c9a77-ccac-47a6-a204-fcaa64af72fe None admin] RBAC: Adding query filter params (role.id=48e4608a7b3f4b87a20b10c4d1b45aa9, scope.domain.id=default, user.id=6ceda84916c547c4bc3f54154671eb74) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:17:26.932681 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c9a77-ccac-47a6-a204-fcaa64af72fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:26.934130 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c9a77-ccac-47a6-a204-fcaa64af72fe None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:26.942424 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 26/57] 10.222.0.21 () {56 vars in 1322 bytes} [Mon Feb 28 10:17:26 2022] GET /identity/v3/role_assignments?user.id=6ceda84916c547c4bc3f54154671eb74&scope.domain.id=default&role.id=48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 530 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:28.775405 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9569cfd-78aa-4f41-804e-9fe673330de5 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:28.775925 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9569cfd-78aa-4f41-804e-9fe673330de5 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:28.775925 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9569cfd-78aa-4f41-804e-9fe673330de5 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:28.777699 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 32/58] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:17:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:17:28.783707 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73965537-e4d5-4854-a975-0de72c5201a6 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:28.784097 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73965537-e4d5-4854-a975-0de72c5201a6 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:28.784269 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73965537-e4d5-4854-a975-0de72c5201a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:28.801924 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-73965537-e4d5-4854-a975-0de72c5201a6 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:17:28.803153 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-73965537-e4d5-4854-a975-0de72c5201a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:17:28.866145 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 27/59] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:17:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:17:28.891392 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9569cfd-78aa-4f41-804e-9fe673330de5 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:28.988467 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9569cfd-78aa-4f41-804e-9fe673330de5 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:29.020193 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f55b0-a614-4117-bae4-af520b9a8122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:29.020956 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f55b0-a614-4117-bae4-af520b9a8122 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:29.021234 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f55b0-a614-4117-bae4-af520b9a8122 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:29.021503 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f55b0-a614-4117-bae4-af520b9a8122 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:29.022674 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991f55b0-a614-4117-bae4-af520b9a8122 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:29.024103 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991f55b0-a614-4117-bae4-af520b9a8122 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:29.025710 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 33/60] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:17:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:29.031279 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73965537-e4d5-4854-a975-0de72c5201a6 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:29.123531 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73965537-e4d5-4854-a975-0de72c5201a6 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:29.155372 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6a37f-8dd0-48cc-af65-246215136111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:29.156024 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6a37f-8dd0-48cc-af65-246215136111 None admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:29.156313 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6a37f-8dd0-48cc-af65-246215136111 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:29.156594 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6a37f-8dd0-48cc-af65-246215136111 None admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:29.157296 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6a37f-8dd0-48cc-af65-246215136111 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:29.158775 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6a37f-8dd0-48cc-af65-246215136111 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:29.183564 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 28/61] 10.222.0.21 () {60 vars in 1132 bytes} [Mon Feb 28 10:17:29 2022] POST /identity/v3/users => generated 275 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:17:32.694337 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a9af0-9675-4606-bbc1-9c3893d7aa2f None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:32.694873 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a9af0-9675-4606-bbc1-9c3893d7aa2f None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:32.694873 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a9af0-9675-4606-bbc1-9c3893d7aa2f None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:32.697069 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 34/62] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:17:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:17:32.712372 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55343f-1de4-45e2-be1a-93b2d1653739 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:32.712861 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55343f-1de4-45e2-be1a-93b2d1653739 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:32.712934 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55343f-1de4-45e2-be1a-93b2d1653739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:32.731142 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-4d55343f-1de4-45e2-be1a-93b2d1653739 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:17:32.733019 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-4d55343f-1de4-45e2-be1a-93b2d1653739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:17:32.737806 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e3084-6b6d-4b32-8409-c9a34e2e21bb None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:32.738089 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e3084-6b6d-4b32-8409-c9a34e2e21bb None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:32.738371 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e3084-6b6d-4b32-8409-c9a34e2e21bb None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:32.740298 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 35/63] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:17:32.752931 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade19bb4-a74e-4147-bace-b54d723554eb None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:32.752931 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade19bb4-a74e-4147-bace-b54d723554eb None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:32.752931 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade19bb4-a74e-4147-bace-b54d723554eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:32.769447 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-ade19bb4-a74e-4147-bace-b54d723554eb None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:17:32.771010 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-ade19bb4-a74e-4147-bace-b54d723554eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:17:32.853328 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 36/64] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:17:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:17:32.864849 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 29/65] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:17:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 10:17:32.878144 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade19bb4-a74e-4147-bace-b54d723554eb None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:32.910492 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55343f-1de4-45e2-be1a-93b2d1653739 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:33.016358 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade19bb4-a74e-4147-bace-b54d723554eb None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:33.040871 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55343f-1de4-45e2-be1a-93b2d1653739 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:33.056636 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39500ee-e052-4bda-884e-75fb6a410bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:33.057863 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39500ee-e052-4bda-884e-75fb6a410bcd None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:33.058653 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39500ee-e052-4bda-884e-75fb6a410bcd None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:33.059156 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39500ee-e052-4bda-884e-75fb6a410bcd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:33.073556 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39500ee-e052-4bda-884e-75fb6a410bcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:17:33.075857 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d7cdd2-788c-4411-b06d-ee063fdccb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:33.076914 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7cdd2-788c-4411-b06d-ee063fdccb09 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:33.077367 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7cdd2-788c-4411-b06d-ee063fdccb09 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:33.077788 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7cdd2-788c-4411-b06d-ee063fdccb09 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:33.082063 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-d39500ee-e052-4bda-884e-75fb6a410bcd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:17:33.084070 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 37/66] 10.222.0.21 () {56 vars in 1096 bytes} [Mon Feb 28 10:17:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:17:33.085662 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3fed6c-a89f-4254-8041-b6c563c000d4 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:33.086093 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3fed6c-a89f-4254-8041-b6c563c000d4 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:33.086690 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3fed6c-a89f-4254-8041-b6c563c000d4 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:33.088795 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 38/67] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:17:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:17:33.089729 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3fed6c-a89f-4254-8041-b6c563c000d4 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:33.094507 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d7cdd2-788c-4411-b06d-ee063fdccb09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:17:33.101851 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-d8d7cdd2-788c-4411-b06d-ee063fdccb09 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 10:17:33.103598 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 30/68] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:17:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:17:33.105105 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704303c9-b294-4bc6-8764-2a33f4edc580 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:33.105617 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704303c9-b294-4bc6-8764-2a33f4edc580 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:33.106104 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704303c9-b294-4bc6-8764-2a33f4edc580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:33.124192 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-704303c9-b294-4bc6-8764-2a33f4edc580 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:17:33.125720 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-704303c9-b294-4bc6-8764-2a33f4edc580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:17:33.198891 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 31/69] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:17:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:17:33.200110 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704303c9-b294-4bc6-8764-2a33f4edc580 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:33.208372 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3fed6c-a89f-4254-8041-b6c563c000d4 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:33.245235 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea69a9-58c0-4861-ba50-343545f08b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:33.245901 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea69a9-58c0-4861-ba50-343545f08b4b None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:33.246186 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea69a9-58c0-4861-ba50-343545f08b4b None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:33.246468 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea69a9-58c0-4861-ba50-343545f08b4b None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:33.247242 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea69a9-58c0-4861-ba50-343545f08b4b None admin] RBAC: Adding query filter params (name=admin) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:17:33.248184 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea69a9-58c0-4861-ba50-343545f08b4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:33.249577 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea69a9-58c0-4861-ba50-343545f08b4b None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:33.257976 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 39/70] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:17:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:33.258805 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea69a9-58c0-4861-ba50-343545f08b4b None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:33.317329 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704303c9-b294-4bc6-8764-2a33f4edc580 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:33.351864 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b74c6b-8cf7-4753-acba-c5fe58f76950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:33.352532 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b74c6b-8cf7-4753-acba-c5fe58f76950 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:33.352814 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b74c6b-8cf7-4753-acba-c5fe58f76950 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:33.353091 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b74c6b-8cf7-4753-acba-c5fe58f76950 None admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:33.353834 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b74c6b-8cf7-4753-acba-c5fe58f76950 None admin] RBAC: Adding query filter params (name=member) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:17:33.354140 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b74c6b-8cf7-4753-acba-c5fe58f76950 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:33.355541 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b74c6b-8cf7-4753-acba-c5fe58f76950 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:33.357842 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea69a9-58c0-4861-ba50-343545f08b4b None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:33.368964 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 32/71] 10.222.0.21 () {56 vars in 1101 bytes} [Mon Feb 28 10:17:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:33.371409 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d3588-9594-4935-a72e-ed13e848ed04 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:33.371700 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d3588-9594-4935-a72e-ed13e848ed04 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:33.371997 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d3588-9594-4935-a72e-ed13e848ed04 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:33.374654 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 33/72] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:17:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:17:33.375359 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d3588-9594-4935-a72e-ed13e848ed04 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:33.391272 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04e4b4-5f26-4e2c-8494-aaefd402e423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:33.392077 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04e4b4-5f26-4e2c-8494-aaefd402e423 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:33.392358 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04e4b4-5f26-4e2c-8494-aaefd402e423 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:33.392633 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04e4b4-5f26-4e2c-8494-aaefd402e423 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:33.402273 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04e4b4-5f26-4e2c-8494-aaefd402e423 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:17:33.409554 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-fb04e4b4-5f26-4e2c-8494-aaefd402e423 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 10:17:33.410746 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 40/73] 10.222.0.21 () {56 vars in 1114 bytes} [Mon Feb 28 10:17:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:17:33.412202 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18505df-5904-49b8-9ddb-227e9d263c72 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:33.412493 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18505df-5904-49b8-9ddb-227e9d263c72 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:33.412770 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18505df-5904-49b8-9ddb-227e9d263c72 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:33.414575 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 41/74] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:17:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:17:33.416105 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18505df-5904-49b8-9ddb-227e9d263c72 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:33.471623 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d3588-9594-4935-a72e-ed13e848ed04 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:33.503376 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d1e7c-36d8-477d-9ba2-7e2c5ba8d053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:33.504230 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d1e7c-36d8-477d-9ba2-7e2c5ba8d053 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:33.504514 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d1e7c-36d8-477d-9ba2-7e2c5ba8d053 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:33.504787 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d1e7c-36d8-477d-9ba2-7e2c5ba8d053 None admin] PATH_INFO: `/v3/users/6ceda84916c547c4bc3f54154671eb74` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:33.505972 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d1e7c-36d8-477d-9ba2-7e2c5ba8d053 None admin] RBAC: Authorizing `identity:get_user(user_id=6ceda84916c547c4bc3f54154671eb74)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:33.507424 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d1e7c-36d8-477d-9ba2-7e2c5ba8d053 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:33.509039 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 34/75] 10.222.0.21 () {56 vars in 1177 bytes} [Mon Feb 28 10:17:33 2022] GET /identity/v3/users/6ceda84916c547c4bc3f54154671eb74 => generated 247 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:33.510170 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25161daa-291e-4c0f-85a4-2617be5d446b None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:33.510457 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25161daa-291e-4c0f-85a4-2617be5d446b None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:33.510761 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25161daa-291e-4c0f-85a4-2617be5d446b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:33.515186 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18505df-5904-49b8-9ddb-227e9d263c72 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:33.527698 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-25161daa-291e-4c0f-85a4-2617be5d446b None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:17:33.528866 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-25161daa-291e-4c0f-85a4-2617be5d446b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:17:33.547307 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b8c25d-654c-41be-88e8-24bcbc63a7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:33.548158 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8c25d-654c-41be-88e8-24bcbc63a7e3 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:33.548443 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8c25d-654c-41be-88e8-24bcbc63a7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:33.548718 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8c25d-654c-41be-88e8-24bcbc63a7e3 None admin] PATH_INFO: `/v3/users/65bb7dc9a10b405e9a58441897d664c2` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:33.561390 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b8c25d-654c-41be-88e8-24bcbc63a7e3 None admin] RBAC: Authorizing `identity:get_user(user_id=65bb7dc9a10b405e9a58441897d664c2)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:33.562867 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b8c25d-654c-41be-88e8-24bcbc63a7e3 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:33.564503 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 42/76] 10.222.0.21 () {56 vars in 1177 bytes} [Mon Feb 28 10:17:33 2022] GET /identity/v3/users/65bb7dc9a10b405e9a58441897d664c2 => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:33.566436 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b8c25d-654c-41be-88e8-24bcbc63a7e3 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:33.592054 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 35/77] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:17:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:17:33.593442 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890118f-0054-4312-a0ee-dfd153576040 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:33.593733 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890118f-0054-4312-a0ee-dfd153576040 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:33.594015 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890118f-0054-4312-a0ee-dfd153576040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:33.609456 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-7890118f-0054-4312-a0ee-dfd153576040 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:17:33.610656 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-7890118f-0054-4312-a0ee-dfd153576040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:17:33.661235 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b8c25d-654c-41be-88e8-24bcbc63a7e3 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:33.673233 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 36/78] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:17:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:17:33.686755 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890118f-0054-4312-a0ee-dfd153576040 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:33.693909 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f7c45-ce16-4216-9aee-1b2fedd7841f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:33.694572 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f7c45-ce16-4216-9aee-1b2fedd7841f None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:33.695145 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f7c45-ce16-4216-9aee-1b2fedd7841f None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:33.695145 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f7c45-ce16-4216-9aee-1b2fedd7841f None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:33.696132 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f7c45-ce16-4216-9aee-1b2fedd7841f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:17:33.696434 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f7c45-ce16-4216-9aee-1b2fedd7841f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:33.697810 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f7c45-ce16-4216-9aee-1b2fedd7841f None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:33.706315 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 43/79] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:17:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:33.707140 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f7c45-ce16-4216-9aee-1b2fedd7841f None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:33.772429 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890118f-0054-4312-a0ee-dfd153576040 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:33.800065 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f7c45-ce16-4216-9aee-1b2fedd7841f None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:33.803416 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c94b15-37a6-4330-8603-778c039bed52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:33.804052 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c94b15-37a6-4330-8603-778c039bed52 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:33.804333 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c94b15-37a6-4330-8603-778c039bed52 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:33.804604 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c94b15-37a6-4330-8603-778c039bed52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:33.833151 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732e0db-7791-4b89-915c-113fd8cc796a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:33.833789 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732e0db-7791-4b89-915c-113fd8cc796a None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:33.834078 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732e0db-7791-4b89-915c-113fd8cc796a None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:33.834358 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732e0db-7791-4b89-915c-113fd8cc796a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:33.869241 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c94b15-37a6-4330-8603-778c039bed52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:33.870739 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c94b15-37a6-4330-8603-778c039bed52 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:33.900032 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d732e0db-7791-4b89-915c-113fd8cc796a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:33.901485 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d732e0db-7791-4b89-915c-113fd8cc796a None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:33.963845 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 37/80] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:17:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:17:33.964984 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c94b15-37a6-4330-8603-778c039bed52 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:33.998468 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 44/81] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:17:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:17:33.999330 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732e0db-7791-4b89-915c-113fd8cc796a None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:34.061237 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c94b15-37a6-4330-8603-778c039bed52 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:34.094338 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea2a30-556d-494b-84e4-8f8208ff88b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:34.095145 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea2a30-556d-494b-84e4-8f8208ff88b0 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:34.095427 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea2a30-556d-494b-84e4-8f8208ff88b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:34.095613 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732e0db-7791-4b89-915c-113fd8cc796a None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:34.095709 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea2a30-556d-494b-84e4-8f8208ff88b0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:34.105188 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea2a30-556d-494b-84e4-8f8208ff88b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:17:34.112855 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-71ea2a30-556d-494b-84e4-8f8208ff88b0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 10:17:34.114019 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 38/82] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:17:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:17:34.114814 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea2a30-556d-494b-84e4-8f8208ff88b0 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:34.128862 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0887576-f2b5-4571-ba48-0ac17154223f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:34.129685 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0887576-f2b5-4571-ba48-0ac17154223f None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:34.129971 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0887576-f2b5-4571-ba48-0ac17154223f None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:34.130261 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0887576-f2b5-4571-ba48-0ac17154223f None admin] PATH_INFO: `/v3/domains/default` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:34.131532 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0887576-f2b5-4571-ba48-0ac17154223f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:34.132965 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0887576-f2b5-4571-ba48-0ac17154223f None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:34.134752 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 45/83] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:17:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:34.136028 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0887576-f2b5-4571-ba48-0ac17154223f None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:34.209696 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea2a30-556d-494b-84e4-8f8208ff88b0 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:34.228376 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0887576-f2b5-4571-ba48-0ac17154223f None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:34.241540 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2174202-525f-4be8-823c-2c7e0c25bc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:34.242392 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2174202-525f-4be8-823c-2c7e0c25bc0c None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:34.242696 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2174202-525f-4be8-823c-2c7e0c25bc0c None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:34.242971 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2174202-525f-4be8-823c-2c7e0c25bc0c None admin] PATH_INFO: `/v3/users/65bb7dc9a10b405e9a58441897d664c2` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:34.244160 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2174202-525f-4be8-823c-2c7e0c25bc0c None admin] RBAC: Authorizing `identity:get_user(user_id=65bb7dc9a10b405e9a58441897d664c2)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:34.245609 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2174202-525f-4be8-823c-2c7e0c25bc0c None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:34.247229 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 39/84] 10.222.0.21 () {56 vars in 1177 bytes} [Mon Feb 28 10:17:34 2022] GET /identity/v3/users/65bb7dc9a10b405e9a58441897d664c2 => generated 275 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:34.249143 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2174202-525f-4be8-823c-2c7e0c25bc0c None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:34.262251 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35599f0-cd6d-4940-8e6b-0721aea5cafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:34.263186 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35599f0-cd6d-4940-8e6b-0721aea5cafd None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:34.263627 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35599f0-cd6d-4940-8e6b-0721aea5cafd None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:34.263910 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35599f0-cd6d-4940-8e6b-0721aea5cafd None admin] PATH_INFO: `/v3/projects/067e263bb06c40a4a0e9fe2adf525073` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:34.265094 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35599f0-cd6d-4940-8e6b-0721aea5cafd None admin] RBAC: Authorizing `identity:get_project(project_id=067e263bb06c40a4a0e9fe2adf525073)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:34.266516 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35599f0-cd6d-4940-8e6b-0721aea5cafd None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:34.268225 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 46/85] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:17:34 2022] GET /identity/v3/projects/067e263bb06c40a4a0e9fe2adf525073 => generated 298 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:34.269130 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35599f0-cd6d-4940-8e6b-0721aea5cafd None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:34.343223 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2174202-525f-4be8-823c-2c7e0c25bc0c None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:34.369576 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35599f0-cd6d-4940-8e6b-0721aea5cafd None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:34.374370 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e849ed-f005-48f4-9e02-f66912111c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:34.375249 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e849ed-f005-48f4-9e02-f66912111c0a None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:34.375544 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e849ed-f005-48f4-9e02-f66912111c0a None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:34.375824 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e849ed-f005-48f4-9e02-f66912111c0a None admin] PATH_INFO: `/v3/projects/067e263bb06c40a4a0e9fe2adf525073` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:34.377033 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e849ed-f005-48f4-9e02-f66912111c0a None admin] RBAC: Authorizing `identity:get_project(project_id=067e263bb06c40a4a0e9fe2adf525073)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:34.378457 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e849ed-f005-48f4-9e02-f66912111c0a None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:34.380338 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 40/86] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:17:34 2022] GET /identity/v3/projects/067e263bb06c40a4a0e9fe2adf525073 => generated 298 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:34.380905 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e849ed-f005-48f4-9e02-f66912111c0a None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:34.406192 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14fc02-92dc-4045-9146-3b57e1623185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:34.406902 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14fc02-92dc-4045-9146-3b57e1623185 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:34.407190 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14fc02-92dc-4045-9146-3b57e1623185 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:34.407467 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14fc02-92dc-4045-9146-3b57e1623185 None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:34.408205 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd14fc02-92dc-4045-9146-3b57e1623185 None admin] RBAC: Adding query filter params (name=member) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:17:34.408508 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd14fc02-92dc-4045-9146-3b57e1623185 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:34.409870 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd14fc02-92dc-4045-9146-3b57e1623185 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:34.417470 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 47/87] 10.222.0.21 () {56 vars in 1101 bytes} [Mon Feb 28 10:17:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:34.418247 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14fc02-92dc-4045-9146-3b57e1623185 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:34.481238 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e849ed-f005-48f4-9e02-f66912111c0a None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:34.518016 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab7a11-9be5-43a0-ad7f-5c2677898a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:34.518723 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab7a11-9be5-43a0-ad7f-5c2677898a68 None admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:34.519010 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab7a11-9be5-43a0-ad7f-5c2677898a68 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:34.519291 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab7a11-9be5-43a0-ad7f-5c2677898a68 None admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:34.520008 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ab7a11-9be5-43a0-ad7f-5c2677898a68 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:34.521445 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ab7a11-9be5-43a0-ad7f-5c2677898a68 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:34.523782 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14fc02-92dc-4045-9146-3b57e1623185 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:34.540837 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 41/88] 10.222.0.21 () {60 vars in 1132 bytes} [Mon Feb 28 10:17:34 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:17:34.541836 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab7a11-9be5-43a0-ad7f-5c2677898a68 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:34.564108 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc5ac9-23f9-4cfa-918e-bc830912f9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:34.565152 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc5ac9-23f9-4cfa-918e-bc830912f9da None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:34.565440 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc5ac9-23f9-4cfa-918e-bc830912f9da None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:34.565721 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc5ac9-23f9-4cfa-918e-bc830912f9da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:34.641258 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dc5ac9-23f9-4cfa-918e-bc830912f9da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:34.642742 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dc5ac9-23f9-4cfa-918e-bc830912f9da None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:34.658889 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab7a11-9be5-43a0-ad7f-5c2677898a68 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:34.698213 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c92b7f-bb4c-443e-9be0-d8bb243034bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:34.698928 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c92b7f-bb4c-443e-9be0-d8bb243034bc None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:34.699219 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c92b7f-bb4c-443e-9be0-d8bb243034bc None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:34.699499 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c92b7f-bb4c-443e-9be0-d8bb243034bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:34.700341 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c92b7f-bb4c-443e-9be0-d8bb243034bc None admin] RBAC: Adding query filter params (role.id=48e4608a7b3f4b87a20b10c4d1b45aa9, scope.project.id=067e263bb06c40a4a0e9fe2adf525073, user.id=6ceda84916c547c4bc3f54154671eb74) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:17:34.701300 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c92b7f-bb4c-443e-9be0-d8bb243034bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:34.702830 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c92b7f-bb4c-443e-9be0-d8bb243034bc None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:34.710749 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 42/89] 10.222.0.21 () {56 vars in 1374 bytes} [Mon Feb 28 10:17:34 2022] GET /identity/v3/role_assignments?user.id=6ceda84916c547c4bc3f54154671eb74&scope.project.id=067e263bb06c40a4a0e9fe2adf525073&role.id=48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:34.710749 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c92b7f-bb4c-443e-9be0-d8bb243034bc None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:34.750049 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 48/90] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:17:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:17:34.751053 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc5ac9-23f9-4cfa-918e-bc830912f9da None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:34.845826 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c92b7f-bb4c-443e-9be0-d8bb243034bc None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:34.860819 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc5ac9-23f9-4cfa-918e-bc830912f9da None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:34.884919 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a930e8-ffc6-4c39-9450-d9b03d301301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:34.885867 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a930e8-ffc6-4c39-9450-d9b03d301301 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:34.886312 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a930e8-ffc6-4c39-9450-d9b03d301301 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:34.886830 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a930e8-ffc6-4c39-9450-d9b03d301301 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:34.887838 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a930e8-ffc6-4c39-9450-d9b03d301301 None admin] RBAC: Adding query filter params (role.id=1c79fcc5aeef4042aa382ec20f77f7b9, scope.project.id=067e263bb06c40a4a0e9fe2adf525073, user.id=65bb7dc9a10b405e9a58441897d664c2) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:17:34.888929 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a930e8-ffc6-4c39-9450-d9b03d301301 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:34.890617 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a930e8-ffc6-4c39-9450-d9b03d301301 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:34.897327 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 43/91] 10.222.0.21 () {56 vars in 1374 bytes} [Mon Feb 28 10:17:34 2022] GET /identity/v3/role_assignments?user.id=65bb7dc9a10b405e9a58441897d664c2&scope.project.id=067e263bb06c40a4a0e9fe2adf525073&role.id=1c79fcc5aeef4042aa382ec20f77f7b9 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:34.898615 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a930e8-ffc6-4c39-9450-d9b03d301301 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:34.898731 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae413e7-0167-44c2-9b02-6201bfe4901a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:34.899547 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae413e7-0167-44c2-9b02-6201bfe4901a None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:34.899831 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae413e7-0167-44c2-9b02-6201bfe4901a None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:34.900109 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae413e7-0167-44c2-9b02-6201bfe4901a None admin] PATH_INFO: `/v3/users/65bb7dc9a10b405e9a58441897d664c2` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:34.901382 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae413e7-0167-44c2-9b02-6201bfe4901a None admin] RBAC: Authorizing `identity:get_user(user_id=65bb7dc9a10b405e9a58441897d664c2)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:34.902901 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae413e7-0167-44c2-9b02-6201bfe4901a None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:34.904714 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 49/92] 10.222.0.21 () {56 vars in 1177 bytes} [Mon Feb 28 10:17:34 2022] GET /identity/v3/users/65bb7dc9a10b405e9a58441897d664c2 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:34.910469 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae413e7-0167-44c2-9b02-6201bfe4901a None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:35.013174 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a930e8-ffc6-4c39-9450-d9b03d301301 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:35.018980 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae413e7-0167-44c2-9b02-6201bfe4901a None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:35.050102 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acec51b-7964-47ff-9666-f0a4d03631fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:35.051285 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acec51b-7964-47ff-9666-f0a4d03631fc None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:35.051751 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acec51b-7964-47ff-9666-f0a4d03631fc None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:35.052031 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acec51b-7964-47ff-9666-f0a4d03631fc None admin] PATH_INFO: `/v3/projects/067e263bb06c40a4a0e9fe2adf525073` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:35.053602 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acec51b-7964-47ff-9666-f0a4d03631fc None admin] RBAC: Authorizing `identity:get_project(project_id=067e263bb06c40a4a0e9fe2adf525073)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:35.055230 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acec51b-7964-47ff-9666-f0a4d03631fc None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:35.055786 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b0c69-016a-441c-b518-1c8211b89e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:35.056599 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b0c69-016a-441c-b518-1c8211b89e80 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:35.057029 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b0c69-016a-441c-b518-1c8211b89e80 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:35.057278 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 44/93] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:17:34 2022] GET /identity/v3/projects/067e263bb06c40a4a0e9fe2adf525073 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:35.057632 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b0c69-016a-441c-b518-1c8211b89e80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:35.067627 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acec51b-7964-47ff-9666-f0a4d03631fc None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:35.134040 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b0c69-016a-441c-b518-1c8211b89e80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:35.135581 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b0c69-016a-441c-b518-1c8211b89e80 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:35.224296 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acec51b-7964-47ff-9666-f0a4d03631fc None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:35.239342 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 50/94] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:17:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Feb 28 10:17:35.244787 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b0c69-016a-441c-b518-1c8211b89e80 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:35.277750 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108750d-651d-4693-895c-a33ce993246b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:35.279331 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108750d-651d-4693-895c-a33ce993246b None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:35.279942 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108750d-651d-4693-895c-a33ce993246b None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:35.280448 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108750d-651d-4693-895c-a33ce993246b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:35.281477 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1108750d-651d-4693-895c-a33ce993246b None admin] RBAC: Adding query filter params (role.id=101ea48f12324cee9b597825e21f34b4, scope.project.id=067e263bb06c40a4a0e9fe2adf525073, user.id=65bb7dc9a10b405e9a58441897d664c2) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:17:35.281994 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1108750d-651d-4693-895c-a33ce993246b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:35.283672 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1108750d-651d-4693-895c-a33ce993246b None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:35.298148 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 45/95] 10.222.0.21 () {56 vars in 1374 bytes} [Mon Feb 28 10:17:35 2022] GET /identity/v3/role_assignments?user.id=65bb7dc9a10b405e9a58441897d664c2&scope.project.id=067e263bb06c40a4a0e9fe2adf525073&role.id=101ea48f12324cee9b597825e21f34b4 => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:35.380107 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b0c69-016a-441c-b518-1c8211b89e80 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:35.429438 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c0140-c266-4077-bbcb-e86b22b72d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:35.430301 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c0140-c266-4077-bbcb-e86b22b72d4c None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:35.430586 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c0140-c266-4077-bbcb-e86b22b72d4c None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:35.430889 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c0140-c266-4077-bbcb-e86b22b72d4c None admin] PATH_INFO: `/v3/projects/1bd8eb870236450d89f5867026bd925e` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:35.432093 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2c0140-c266-4077-bbcb-e86b22b72d4c None admin] RBAC: Authorizing `identity:get_project(project_id=1bd8eb870236450d89f5867026bd925e)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:35.433552 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2c0140-c266-4077-bbcb-e86b22b72d4c None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:35.436370 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 51/96] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:17:35 2022] GET /identity/v3/projects/1bd8eb870236450d89f5867026bd925e => generated 312 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:35.443729 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108750d-651d-4693-895c-a33ce993246b None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:35.580353 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108750d-651d-4693-895c-a33ce993246b None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:35.615333 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e6722-fa37-4c69-b38d-09a7b5f0e9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:35.616360 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e6722-fa37-4c69-b38d-09a7b5f0e9a8 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:35.616857 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e6722-fa37-4c69-b38d-09a7b5f0e9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:35.617353 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e6722-fa37-4c69-b38d-09a7b5f0e9a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:35.618382 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e6722-fa37-4c69-b38d-09a7b5f0e9a8 None admin] RBAC: Adding query filter params (role.id=1c79fcc5aeef4042aa382ec20f77f7b9, scope.project.id=1bd8eb870236450d89f5867026bd925e, user.id=65bb7dc9a10b405e9a58441897d664c2) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:17:35.618957 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e6722-fa37-4c69-b38d-09a7b5f0e9a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:35.620602 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e6722-fa37-4c69-b38d-09a7b5f0e9a8 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:35.626429 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 46/97] 10.222.0.21 () {56 vars in 1374 bytes} [Mon Feb 28 10:17:35 2022] GET /identity/v3/role_assignments?user.id=65bb7dc9a10b405e9a58441897d664c2&scope.project.id=1bd8eb870236450d89f5867026bd925e&role.id=1c79fcc5aeef4042aa382ec20f77f7b9 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:38.036105 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1742e8c-b4df-4825-beec-1e14ab8bdf54 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:38.036641 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1742e8c-b4df-4825-beec-1e14ab8bdf54 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:38.036641 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1742e8c-b4df-4825-beec-1e14ab8bdf54 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:38.038475 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 52/98] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:17:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:17:38.048164 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e091dd5-fad1-4425-9b47-88fed58ca24e None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:38.048701 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e091dd5-fad1-4425-9b47-88fed58ca24e None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:38.048701 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e091dd5-fad1-4425-9b47-88fed58ca24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:38.071693 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-4e091dd5-fad1-4425-9b47-88fed58ca24e None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:17:38.072908 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-4e091dd5-fad1-4425-9b47-88fed58ca24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:17:38.161005 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 47/99] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:17:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:17:38.169877 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675751c-835a-49b2-a002-48376c7bcda5 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:38.170408 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675751c-835a-49b2-a002-48376c7bcda5 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:38.170408 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675751c-835a-49b2-a002-48376c7bcda5 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:38.172149 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 53/100] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:17:38.188568 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f11de1-7d69-4667-8530-dc71f5a8dd7c None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:38.188935 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f11de1-7d69-4667-8530-dc71f5a8dd7c None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:38.189140 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f11de1-7d69-4667-8530-dc71f5a8dd7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:38.215168 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9675751c-835a-49b2-a002-48376c7bcda5 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:38.217342 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-75f11de1-7d69-4667-8530-dc71f5a8dd7c None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:17:38.218526 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-75f11de1-7d69-4667-8530-dc71f5a8dd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:17:38.371133 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9675751c-835a-49b2-a002-48376c7bcda5 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:38.396952 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 48/101] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:17:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:17:38.422150 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139713ae-d7ca-4c6e-98a3-46a935654bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:38.422892 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139713ae-d7ca-4c6e-98a3-46a935654bb3 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:38.423181 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139713ae-d7ca-4c6e-98a3-46a935654bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:38.423464 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139713ae-d7ca-4c6e-98a3-46a935654bb3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:38.424650 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139713ae-d7ca-4c6e-98a3-46a935654bb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:38.426119 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139713ae-d7ca-4c6e-98a3-46a935654bb3 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:38.428069 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 54/102] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:17:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:17:38.433439 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f11de1-7d69-4667-8530-dc71f5a8dd7c None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:38.435354 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139713ae-d7ca-4c6e-98a3-46a935654bb3 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:38.575946 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139713ae-d7ca-4c6e-98a3-46a935654bb3 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:38.597264 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f11de1-7d69-4667-8530-dc71f5a8dd7c None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:38.614807 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de901dd-a290-4684-ad31-8fe9e62093f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:38.615867 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de901dd-a290-4684-ad31-8fe9e62093f8 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:38.616309 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de901dd-a290-4684-ad31-8fe9e62093f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:38.616725 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de901dd-a290-4684-ad31-8fe9e62093f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:38.627868 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de901dd-a290-4684-ad31-8fe9e62093f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:17:38.635293 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-2de901dd-a290-4684-ad31-8fe9e62093f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 10:17:38.637143 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 55/103] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:17:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:17:38.639053 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffd5ed-72a1-4bb7-9309-8b5c6d3390c1 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:38.639564 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffd5ed-72a1-4bb7-9309-8b5c6d3390c1 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:38.639672 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d417f591-0a86-40e8-b757-51be97e06899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:38.640178 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffd5ed-72a1-4bb7-9309-8b5c6d3390c1 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:38.640285 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417f591-0a86-40e8-b757-51be97e06899 None admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:38.640506 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417f591-0a86-40e8-b757-51be97e06899 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:38.640789 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417f591-0a86-40e8-b757-51be97e06899 None admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:38.641569 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d417f591-0a86-40e8-b757-51be97e06899 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:38.642927 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 56/104] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:17:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:17:38.643346 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d417f591-0a86-40e8-b757-51be97e06899 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:38.644459 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef757aa8-a47d-4dc1-88c1-e5a74c5203aa None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:38.645017 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef757aa8-a47d-4dc1-88c1-e5a74c5203aa None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:38.645564 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef757aa8-a47d-4dc1-88c1-e5a74c5203aa None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:38.647379 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 57/105] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:17:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:17:38.652103 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef757aa8-a47d-4dc1-88c1-e5a74c5203aa None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:38.675497 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 49/106] 10.222.0.21 () {60 vars in 1141 bytes} [Mon Feb 28 10:17:38 2022] POST /identity/v3/projects => generated 302 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:17:38.677902 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e6790-fb27-404d-b666-ebb90087195b None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:38.678495 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e6790-fb27-404d-b666-ebb90087195b None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:38.678984 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e6790-fb27-404d-b666-ebb90087195b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:38.704582 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-169e6790-fb27-404d-b666-ebb90087195b None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:17:38.706480 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-169e6790-fb27-404d-b666-ebb90087195b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:17:38.777774 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 50/107] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:17:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:17:38.779450 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f665ab7-92c7-40dc-9008-de2d5faa5b20 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:38.779779 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef757aa8-a47d-4dc1-88c1-e5a74c5203aa None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:38.779925 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f665ab7-92c7-40dc-9008-de2d5faa5b20 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:38.780304 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f665ab7-92c7-40dc-9008-de2d5faa5b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:38.799474 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-6f665ab7-92c7-40dc-9008-de2d5faa5b20 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:17:38.800806 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-6f665ab7-92c7-40dc-9008-de2d5faa5b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:17:38.834219 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7feb6-cab1-4be9-bd42-26e9a0ab7ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:38.834924 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7feb6-cab1-4be9-bd42-26e9a0ab7ce5 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:38.835195 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7feb6-cab1-4be9-bd42-26e9a0ab7ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:38.835467 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7feb6-cab1-4be9-bd42-26e9a0ab7ce5 None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:38.836469 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7feb6-cab1-4be9-bd42-26e9a0ab7ce5 None admin] RBAC: Adding query filter params (name=member) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:17:38.838133 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7feb6-cab1-4be9-bd42-26e9a0ab7ce5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:38.840463 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7feb6-cab1-4be9-bd42-26e9a0ab7ce5 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:38.863602 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 58/108] 10.222.0.21 () {56 vars in 1101 bytes} [Mon Feb 28 10:17:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:38.864573 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7feb6-cab1-4be9-bd42-26e9a0ab7ce5 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:38.936485 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 51/109] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:17:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:17:38.937279 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f665ab7-92c7-40dc-9008-de2d5faa5b20 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:39.008456 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7feb6-cab1-4be9-bd42-26e9a0ab7ce5 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:39.048946 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db252468-ddc6-4364-a5ea-5017e492e14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:39.049793 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db252468-ddc6-4364-a5ea-5017e492e14e None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:39.050806 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db252468-ddc6-4364-a5ea-5017e492e14e None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:39.050806 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db252468-ddc6-4364-a5ea-5017e492e14e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:39.060962 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db252468-ddc6-4364-a5ea-5017e492e14e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:17:39.066510 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f665ab7-92c7-40dc-9008-de2d5faa5b20 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:39.067906 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-db252468-ddc6-4364-a5ea-5017e492e14e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 28 10:17:39.069117 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 59/110] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:17:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:17:39.070619 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af54cc9-3c37-48c5-8d06-242c20d743d9 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:39.075051 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af54cc9-3c37-48c5-8d06-242c20d743d9 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:39.075338 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af54cc9-3c37-48c5-8d06-242c20d743d9 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:39.077620 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 60/111] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:17:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:17:39.078298 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af54cc9-3c37-48c5-8d06-242c20d743d9 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:39.101526 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd9251-e119-4e00-89d1-ca8516174d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:39.102397 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd9251-e119-4e00-89d1-ca8516174d96 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:39.102706 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd9251-e119-4e00-89d1-ca8516174d96 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:39.102982 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd9251-e119-4e00-89d1-ca8516174d96 None admin] PATH_INFO: `/v3/users/65bb7dc9a10b405e9a58441897d664c2` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:39.104176 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fd9251-e119-4e00-89d1-ca8516174d96 None admin] RBAC: Authorizing `identity:get_user(user_id=65bb7dc9a10b405e9a58441897d664c2)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:39.105633 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fd9251-e119-4e00-89d1-ca8516174d96 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:39.107510 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 52/112] 10.222.0.21 () {56 vars in 1177 bytes} [Mon Feb 28 10:17:38 2022] GET /identity/v3/users/65bb7dc9a10b405e9a58441897d664c2 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:39.108277 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd9251-e119-4e00-89d1-ca8516174d96 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:39.180975 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af54cc9-3c37-48c5-8d06-242c20d743d9 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:39.206496 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd9251-e119-4e00-89d1-ca8516174d96 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:39.214383 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c48edf-7a0e-4efe-af8e-8195aec7c313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:39.215203 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c48edf-7a0e-4efe-af8e-8195aec7c313 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:39.215491 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c48edf-7a0e-4efe-af8e-8195aec7c313 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:39.215765 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c48edf-7a0e-4efe-af8e-8195aec7c313 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:39.229425 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c48edf-7a0e-4efe-af8e-8195aec7c313 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:17:39.236470 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-08c48edf-7a0e-4efe-af8e-8195aec7c313 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:17:39.242484 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 61/113] 10.222.0.21 () {56 vars in 1096 bytes} [Mon Feb 28 10:17:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:17:39.242484 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0b130-3e16-4925-92a2-c22ef7b1f45a None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:39.242484 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0b130-3e16-4925-92a2-c22ef7b1f45a None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:39.242484 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0b130-3e16-4925-92a2-c22ef7b1f45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:39.245077 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a1968-cefd-4796-9f04-0beca59c83ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:39.245752 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a1968-cefd-4796-9f04-0beca59c83ef None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:39.246034 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a1968-cefd-4796-9f04-0beca59c83ef None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:39.246350 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a1968-cefd-4796-9f04-0beca59c83ef None admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:39.247821 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a1968-cefd-4796-9f04-0beca59c83ef None admin] RBAC: Adding query filter params (name=reader) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:17:39.248094 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a1968-cefd-4796-9f04-0beca59c83ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:39.249453 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a1968-cefd-4796-9f04-0beca59c83ef None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:39.257932 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 53/114] 10.222.0.21 () {56 vars in 1101 bytes} [Mon Feb 28 10:17:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:39.259414 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46fc33c-bad6-4092-8886-6bcf933c36ae None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:39.259707 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46fc33c-bad6-4092-8886-6bcf933c36ae None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:39.259986 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46fc33c-bad6-4092-8886-6bcf933c36ae None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:39.261408 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-b5f0b130-3e16-4925-92a2-c22ef7b1f45a None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:17:39.261618 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 54/115] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:17:39.262461 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46fc33c-bad6-4092-8886-6bcf933c36ae None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:39.263910 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-b5f0b130-3e16-4925-92a2-c22ef7b1f45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:17:39.330022 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 62/116] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:17:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:17:39.335469 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0b130-3e16-4925-92a2-c22ef7b1f45a None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:39.363336 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46fc33c-bad6-4092-8886-6bcf933c36ae None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:39.396034 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950df85-8691-492a-a333-c269095d803d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:39.396886 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950df85-8691-492a-a333-c269095d803d None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:39.397171 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950df85-8691-492a-a333-c269095d803d None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:39.397449 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950df85-8691-492a-a333-c269095d803d None admin] PATH_INFO: `/v3/projects/067e263bb06c40a4a0e9fe2adf525073` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:39.398711 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e950df85-8691-492a-a333-c269095d803d None admin] RBAC: Authorizing `identity:get_project(project_id=067e263bb06c40a4a0e9fe2adf525073)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:39.400165 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e950df85-8691-492a-a333-c269095d803d None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:39.407070 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 55/117] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:17:39 2022] GET /identity/v3/projects/067e263bb06c40a4a0e9fe2adf525073 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:39.407070 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950df85-8691-492a-a333-c269095d803d None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:39.435913 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0b130-3e16-4925-92a2-c22ef7b1f45a None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:39.468280 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2071aa0-31fa-402f-8d07-65e7efc6ddb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:39.468872 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2071aa0-31fa-402f-8d07-65e7efc6ddb8 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:39.469150 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2071aa0-31fa-402f-8d07-65e7efc6ddb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:39.469424 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2071aa0-31fa-402f-8d07-65e7efc6ddb8 None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:39.470158 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2071aa0-31fa-402f-8d07-65e7efc6ddb8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:17:39.470460 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2071aa0-31fa-402f-8d07-65e7efc6ddb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:39.471844 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2071aa0-31fa-402f-8d07-65e7efc6ddb8 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:39.479552 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 63/118] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:17:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:39.485880 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a1d31-a416-41e1-877a-750d79a3682d None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:39.485880 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a1d31-a416-41e1-877a-750d79a3682d None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:39.485880 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a1d31-a416-41e1-877a-750d79a3682d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:39.499136 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950df85-8691-492a-a333-c269095d803d None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:39.500959 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-3f1a1d31-a416-41e1-877a-750d79a3682d None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:17:39.502131 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-3f1a1d31-a416-41e1-877a-750d79a3682d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:17:39.533289 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d104e101-fcf1-4018-9d47-9b58433588d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:39.534153 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104e101-fcf1-4018-9d47-9b58433588d2 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:39.534435 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104e101-fcf1-4018-9d47-9b58433588d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:39.534736 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104e101-fcf1-4018-9d47-9b58433588d2 None admin] PATH_INFO: `/v3/users/cd74c74718004b1b838e598cd3e46de5` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:39.551227 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d104e101-fcf1-4018-9d47-9b58433588d2 None admin] RBAC: Authorizing `identity:get_user(user_id=cd74c74718004b1b838e598cd3e46de5)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:39.552698 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d104e101-fcf1-4018-9d47-9b58433588d2 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:39.554422 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 56/119] 10.222.0.21 () {56 vars in 1177 bytes} [Mon Feb 28 10:17:39 2022] GET /identity/v3/users/cd74c74718004b1b838e598cd3e46de5 => generated 289 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:39.555210 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d104e101-fcf1-4018-9d47-9b58433588d2 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:39.580219 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 64/120] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:17:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:17:39.580219 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a1d31-a416-41e1-877a-750d79a3682d None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:39.653059 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d104e101-fcf1-4018-9d47-9b58433588d2 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:39.677434 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a1d31-a416-41e1-877a-750d79a3682d None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:39.686696 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b6b250-1376-43c8-87af-72a6532db7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:39.687496 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6b250-1376-43c8-87af-72a6532db7b8 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:39.687776 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6b250-1376-43c8-87af-72a6532db7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:39.688050 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6b250-1376-43c8-87af-72a6532db7b8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:39.698058 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b6b250-1376-43c8-87af-72a6532db7b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:17:39.705347 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-a2b6b250-1376-43c8-87af-72a6532db7b8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 10:17:39.706642 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 57/121] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:17:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:17:39.707296 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b6b250-1376-43c8-87af-72a6532db7b8 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:39.717543 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49312f4b-dc10-43cc-abb0-cd869858874b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:39.718482 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49312f4b-dc10-43cc-abb0-cd869858874b None admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:39.718741 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49312f4b-dc10-43cc-abb0-cd869858874b None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:39.719035 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49312f4b-dc10-43cc-abb0-cd869858874b None admin] PATH_INFO: `/v3/projects/067e263bb06c40a4a0e9fe2adf525073/users/65bb7dc9a10b405e9a58441897d664c2/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:39.720974 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49312f4b-dc10-43cc-abb0-cd869858874b None admin] RBAC: Authorizing `identity:create_grant(project_id=067e263bb06c40a4a0e9fe2adf525073, user_id=65bb7dc9a10b405e9a58441897d664c2, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:39.722731 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49312f4b-dc10-43cc-abb0-cd869858874b None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:39.746873 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 65/122] 10.222.0.21 () {58 vars in 1439 bytes} [Mon Feb 28 10:17:39 2022] PUT /identity/v3/projects/067e263bb06c40a4a0e9fe2adf525073/users/65bb7dc9a10b405e9a58441897d664c2/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:17:39.746873 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49312f4b-dc10-43cc-abb0-cd869858874b None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:39.813507 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b6b250-1376-43c8-87af-72a6532db7b8 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:39.853870 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c014c8-222d-4ce3-88bc-ffb5a7ff50e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:39.854788 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c014c8-222d-4ce3-88bc-ffb5a7ff50e5 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:39.855079 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c014c8-222d-4ce3-88bc-ffb5a7ff50e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:39.855357 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c014c8-222d-4ce3-88bc-ffb5a7ff50e5 None admin] PATH_INFO: `/v3/users/6ceda84916c547c4bc3f54154671eb74` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:39.856624 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c014c8-222d-4ce3-88bc-ffb5a7ff50e5 None admin] RBAC: Authorizing `identity:get_user(user_id=6ceda84916c547c4bc3f54154671eb74)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:39.858274 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c014c8-222d-4ce3-88bc-ffb5a7ff50e5 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:39.860188 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 58/123] 10.222.0.21 () {56 vars in 1177 bytes} [Mon Feb 28 10:17:39 2022] GET /identity/v3/users/6ceda84916c547c4bc3f54154671eb74 => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:39.860986 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c014c8-222d-4ce3-88bc-ffb5a7ff50e5 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:39.863174 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49312f4b-dc10-43cc-abb0-cd869858874b None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:39.899844 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bda2e0-c258-4ca5-9a6f-5c64d9bfde16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:39.900508 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bda2e0-c258-4ca5-9a6f-5c64d9bfde16 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:39.900790 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bda2e0-c258-4ca5-9a6f-5c64d9bfde16 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:39.901066 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bda2e0-c258-4ca5-9a6f-5c64d9bfde16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:39.974484 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bda2e0-c258-4ca5-9a6f-5c64d9bfde16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:39.975393 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c014c8-222d-4ce3-88bc-ffb5a7ff50e5 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:39.976676 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bda2e0-c258-4ca5-9a6f-5c64d9bfde16 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:40.013306 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070fbfd-5453-4cc7-ba12-7cfe2957ddbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:40.014156 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070fbfd-5453-4cc7-ba12-7cfe2957ddbf None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:40.014446 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070fbfd-5453-4cc7-ba12-7cfe2957ddbf None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:40.014765 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070fbfd-5453-4cc7-ba12-7cfe2957ddbf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:40.026345 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6070fbfd-5453-4cc7-ba12-7cfe2957ddbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:17:40.036807 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-6070fbfd-5453-4cc7-ba12-7cfe2957ddbf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 10:17:40.038760 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 59/124] 10.222.0.21 () {56 vars in 1114 bytes} [Mon Feb 28 10:17:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:17:40.039811 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070fbfd-5453-4cc7-ba12-7cfe2957ddbf None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:40.087327 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 66/125] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:17:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:17:40.088401 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bda2e0-c258-4ca5-9a6f-5c64d9bfde16 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:40.140731 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070fbfd-5453-4cc7-ba12-7cfe2957ddbf None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:40.182081 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea997392-911d-4f97-8035-db4575a0c665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:40.183141 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea997392-911d-4f97-8035-db4575a0c665 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:40.183663 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea997392-911d-4f97-8035-db4575a0c665 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:40.184152 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea997392-911d-4f97-8035-db4575a0c665 None admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:40.185285 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea997392-911d-4f97-8035-db4575a0c665 None admin] RBAC: Adding query filter params (name=member) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:17:40.185792 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea997392-911d-4f97-8035-db4575a0c665 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:40.187143 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bda2e0-c258-4ca5-9a6f-5c64d9bfde16 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:40.187615 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea997392-911d-4f97-8035-db4575a0c665 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:40.201410 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 60/126] 10.222.0.21 () {56 vars in 1101 bytes} [Mon Feb 28 10:17:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:40.202582 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea997392-911d-4f97-8035-db4575a0c665 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:40.222782 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36ad38-1be0-4c48-9ed3-fe0fa90b23a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:40.223683 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36ad38-1be0-4c48-9ed3-fe0fa90b23a8 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:40.223968 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36ad38-1be0-4c48-9ed3-fe0fa90b23a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:40.224282 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36ad38-1be0-4c48-9ed3-fe0fa90b23a8 None admin] PATH_INFO: `/v3/projects/067e263bb06c40a4a0e9fe2adf525073` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:40.225768 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f36ad38-1be0-4c48-9ed3-fe0fa90b23a8 None admin] RBAC: Authorizing `identity:get_project(project_id=067e263bb06c40a4a0e9fe2adf525073)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:40.227322 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f36ad38-1be0-4c48-9ed3-fe0fa90b23a8 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:40.229004 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 67/127] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:17:40 2022] GET /identity/v3/projects/067e263bb06c40a4a0e9fe2adf525073 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:40.229983 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36ad38-1be0-4c48-9ed3-fe0fa90b23a8 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:40.309717 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea997392-911d-4f97-8035-db4575a0c665 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:40.331944 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36ad38-1be0-4c48-9ed3-fe0fa90b23a8 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:40.345744 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ef5d5-c873-4fca-aea8-171e488924da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:40.346740 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ef5d5-c873-4fca-aea8-171e488924da None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:40.347254 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ef5d5-c873-4fca-aea8-171e488924da None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:40.347735 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ef5d5-c873-4fca-aea8-171e488924da None admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:40.348679 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695ef5d5-c873-4fca-aea8-171e488924da None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:17:40.349188 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695ef5d5-c873-4fca-aea8-171e488924da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:40.350818 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695ef5d5-c873-4fca-aea8-171e488924da None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:40.359338 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 61/128] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:17:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:40.360486 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ef5d5-c873-4fca-aea8-171e488924da None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:40.371405 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558063d1-c12a-40fa-971d-ac0df2d4175d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:40.372120 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558063d1-c12a-40fa-971d-ac0df2d4175d None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:40.372434 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558063d1-c12a-40fa-971d-ac0df2d4175d None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:40.372711 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558063d1-c12a-40fa-971d-ac0df2d4175d None admin] PATH_INFO: `/v3/projects/067e263bb06c40a4a0e9fe2adf525073` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:40.374062 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558063d1-c12a-40fa-971d-ac0df2d4175d None admin] RBAC: Authorizing `identity:get_project(project_id=067e263bb06c40a4a0e9fe2adf525073)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:40.375741 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558063d1-c12a-40fa-971d-ac0df2d4175d None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:40.377743 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 68/129] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:17:40 2022] GET /identity/v3/projects/067e263bb06c40a4a0e9fe2adf525073 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:40.378490 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558063d1-c12a-40fa-971d-ac0df2d4175d None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:40.472884 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ef5d5-c873-4fca-aea8-171e488924da None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:40.481095 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558063d1-c12a-40fa-971d-ac0df2d4175d None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:40.516104 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa2cad-069e-4065-aeea-e720715d9bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:40.518125 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa2cad-069e-4065-aeea-e720715d9bb0 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:40.518457 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa2cad-069e-4065-aeea-e720715d9bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:40.518717 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa2cad-069e-4065-aeea-e720715d9bb0 None admin] PATH_INFO: `/v3/users/65bb7dc9a10b405e9a58441897d664c2` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:40.520528 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa2cad-069e-4065-aeea-e720715d9bb0 None admin] RBAC: Authorizing `identity:get_user(user_id=65bb7dc9a10b405e9a58441897d664c2)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:40.521994 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa2cad-069e-4065-aeea-e720715d9bb0 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:40.523892 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 62/130] 10.222.0.21 () {56 vars in 1177 bytes} [Mon Feb 28 10:17:40 2022] GET /identity/v3/users/65bb7dc9a10b405e9a58441897d664c2 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:40.524559 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa2cad-069e-4065-aeea-e720715d9bb0 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:40.532630 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b92dcc5-2222-4198-85be-3015ba2ec81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:40.533789 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b92dcc5-2222-4198-85be-3015ba2ec81d None admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:40.534707 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b92dcc5-2222-4198-85be-3015ba2ec81d None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:40.535185 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b92dcc5-2222-4198-85be-3015ba2ec81d None admin] PATH_INFO: `/v3/projects/067e263bb06c40a4a0e9fe2adf525073/users/6ceda84916c547c4bc3f54154671eb74/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:40.537993 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b92dcc5-2222-4198-85be-3015ba2ec81d None admin] RBAC: Authorizing `identity:create_grant(project_id=067e263bb06c40a4a0e9fe2adf525073, user_id=6ceda84916c547c4bc3f54154671eb74, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:40.540124 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b92dcc5-2222-4198-85be-3015ba2ec81d None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:40.559285 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 69/131] 10.222.0.21 () {58 vars in 1439 bytes} [Mon Feb 28 10:17:40 2022] PUT /identity/v3/projects/067e263bb06c40a4a0e9fe2adf525073/users/6ceda84916c547c4bc3f54154671eb74/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:17:40.561309 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b92dcc5-2222-4198-85be-3015ba2ec81d None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:40.664452 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa2cad-069e-4065-aeea-e720715d9bb0 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:40.687128 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b92dcc5-2222-4198-85be-3015ba2ec81d None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:40.728058 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49665999-24f6-4144-bb8d-2d4a510d4f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:40.728731 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e1767-509a-4d40-b3ee-7359261b725b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:40.728945 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49665999-24f6-4144-bb8d-2d4a510d4f24 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:40.729233 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49665999-24f6-4144-bb8d-2d4a510d4f24 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:40.729513 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49665999-24f6-4144-bb8d-2d4a510d4f24 None admin] PATH_INFO: `/v3/users/65bb7dc9a10b405e9a58441897d664c2` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:40.730343 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e1767-509a-4d40-b3ee-7359261b725b None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:40.730848 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e1767-509a-4d40-b3ee-7359261b725b None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:40.731368 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e1767-509a-4d40-b3ee-7359261b725b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:40.732990 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92e1767-509a-4d40-b3ee-7359261b725b None admin] RBAC: Adding query filter params (role.id=86661077994d4bb6b80bab41d2f2c953, scope.project.id=067e263bb06c40a4a0e9fe2adf525073, user.id=cd74c74718004b1b838e598cd3e46de5) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:17:40.733539 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92e1767-509a-4d40-b3ee-7359261b725b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:40.735247 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92e1767-509a-4d40-b3ee-7359261b725b None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:40.735483 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49665999-24f6-4144-bb8d-2d4a510d4f24 None admin] RBAC: Authorizing `identity:get_user(user_id=65bb7dc9a10b405e9a58441897d664c2)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:40.736960 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49665999-24f6-4144-bb8d-2d4a510d4f24 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:40.738993 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 63/132] 10.222.0.21 () {56 vars in 1177 bytes} [Mon Feb 28 10:17:40 2022] GET /identity/v3/users/65bb7dc9a10b405e9a58441897d664c2 => generated 275 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:40.739833 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49665999-24f6-4144-bb8d-2d4a510d4f24 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:40.742763 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 70/133] 10.222.0.21 () {56 vars in 1374 bytes} [Mon Feb 28 10:17:40 2022] GET /identity/v3/role_assignments?user.id=cd74c74718004b1b838e598cd3e46de5&scope.project.id=067e263bb06c40a4a0e9fe2adf525073&role.id=86661077994d4bb6b80bab41d2f2c953 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:40.748558 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e1767-509a-4d40-b3ee-7359261b725b None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:40.857849 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49665999-24f6-4144-bb8d-2d4a510d4f24 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:40.897898 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8112ceb-37e0-4a56-bf43-9a66cc1a5ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:40.898815 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8112ceb-37e0-4a56-bf43-9a66cc1a5ac6 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:40.899103 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8112ceb-37e0-4a56-bf43-9a66cc1a5ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:40.899383 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8112ceb-37e0-4a56-bf43-9a66cc1a5ac6 None admin] PATH_INFO: `/v3/projects/1bd8eb870236450d89f5867026bd925e` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:40.900921 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8112ceb-37e0-4a56-bf43-9a66cc1a5ac6 None admin] RBAC: Authorizing `identity:get_project(project_id=1bd8eb870236450d89f5867026bd925e)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:40.902450 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8112ceb-37e0-4a56-bf43-9a66cc1a5ac6 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:40.905026 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 64/134] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:17:40 2022] GET /identity/v3/projects/1bd8eb870236450d89f5867026bd925e => generated 312 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:40.912322 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8112ceb-37e0-4a56-bf43-9a66cc1a5ac6 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:40.983449 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e1767-509a-4d40-b3ee-7359261b725b None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:41.051187 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89d2ee-bedd-412e-8226-2a700baf8960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:41.052069 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89d2ee-bedd-412e-8226-2a700baf8960 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:41.052354 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89d2ee-bedd-412e-8226-2a700baf8960 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:41.052632 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89d2ee-bedd-412e-8226-2a700baf8960 None admin] PATH_INFO: `/v3/projects/067e263bb06c40a4a0e9fe2adf525073` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:41.054650 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb89d2ee-bedd-412e-8226-2a700baf8960 None admin] RBAC: Authorizing `identity:get_project(project_id=067e263bb06c40a4a0e9fe2adf525073)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:41.056103 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb89d2ee-bedd-412e-8226-2a700baf8960 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:41.061495 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 71/135] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:17:40 2022] GET /identity/v3/projects/067e263bb06c40a4a0e9fe2adf525073 => generated 298 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:17:41.065051 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89d2ee-bedd-412e-8226-2a700baf8960 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:41.087384 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8112ceb-37e0-4a56-bf43-9a66cc1a5ac6 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:41.127874 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a57db-8809-4b1b-95ec-5a0439e7746f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:41.128776 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a57db-8809-4b1b-95ec-5a0439e7746f None admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:41.129060 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a57db-8809-4b1b-95ec-5a0439e7746f None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:41.129338 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a57db-8809-4b1b-95ec-5a0439e7746f None admin] PATH_INFO: `/v3/projects/1bd8eb870236450d89f5867026bd925e/users/65bb7dc9a10b405e9a58441897d664c2/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:41.131385 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a57db-8809-4b1b-95ec-5a0439e7746f None admin] RBAC: Authorizing `identity:create_grant(project_id=1bd8eb870236450d89f5867026bd925e, user_id=65bb7dc9a10b405e9a58441897d664c2, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:41.132833 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a57db-8809-4b1b-95ec-5a0439e7746f None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:41.162723 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 65/136] 10.222.0.21 () {58 vars in 1439 bytes} [Mon Feb 28 10:17:40 2022] PUT /identity/v3/projects/1bd8eb870236450d89f5867026bd925e/users/65bb7dc9a10b405e9a58441897d664c2/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:17:41.193598 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89d2ee-bedd-412e-8226-2a700baf8960 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:41.246486 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a1b1d3-b2b2-4a0a-afe5-3823f809dd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:41.247393 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1b1d3-b2b2-4a0a-afe5-3823f809dd1b None admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:41.247683 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1b1d3-b2b2-4a0a-afe5-3823f809dd1b None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:41.247960 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1b1d3-b2b2-4a0a-afe5-3823f809dd1b None admin] PATH_INFO: `/v3/projects/067e263bb06c40a4a0e9fe2adf525073/users/65bb7dc9a10b405e9a58441897d664c2/roles/101ea48f12324cee9b597825e21f34b4` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:41.250462 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a1b1d3-b2b2-4a0a-afe5-3823f809dd1b None admin] RBAC: Authorizing `identity:create_grant(project_id=067e263bb06c40a4a0e9fe2adf525073, user_id=65bb7dc9a10b405e9a58441897d664c2, role_id=101ea48f12324cee9b597825e21f34b4)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:41.252087 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a1b1d3-b2b2-4a0a-afe5-3823f809dd1b None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:41.271787 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 72/137] 10.222.0.21 () {58 vars in 1439 bytes} [Mon Feb 28 10:17:41 2022] PUT /identity/v3/projects/067e263bb06c40a4a0e9fe2adf525073/users/65bb7dc9a10b405e9a58441897d664c2/roles/101ea48f12324cee9b597825e21f34b4 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:17:41.329443 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69144f4-a42d-459b-922c-558e72cf0867 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:41.329790 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69144f4-a42d-459b-922c-558e72cf0867 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:41.329997 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69144f4-a42d-459b-922c-558e72cf0867 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:41.331939 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 66/138] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:17:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:17:41.337971 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6bdaf8-59bd-4c74-befb-00b5cfa32324 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:41.338284 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6bdaf8-59bd-4c74-befb-00b5cfa32324 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:41.338524 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6bdaf8-59bd-4c74-befb-00b5cfa32324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:41.363965 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-1a6bdaf8-59bd-4c74-befb-00b5cfa32324 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:17:41.365280 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-1a6bdaf8-59bd-4c74-befb-00b5cfa32324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:17:41.449547 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 73/139] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:17:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:17:41.476246 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69144f4-a42d-459b-922c-558e72cf0867 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:41.602577 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69144f4-a42d-459b-922c-558e72cf0867 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:41.643340 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4cb5a3-a0da-4cc8-b4e8-51bfdc929e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:41.644150 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cb5a3-a0da-4cc8-b4e8-51bfdc929e37 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:41.644443 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cb5a3-a0da-4cc8-b4e8-51bfdc929e37 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:41.644720 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cb5a3-a0da-4cc8-b4e8-51bfdc929e37 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:41.645956 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4cb5a3-a0da-4cc8-b4e8-51bfdc929e37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:41.647436 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4cb5a3-a0da-4cc8-b4e8-51bfdc929e37 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:41.649373 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 67/140] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:17:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:41.654871 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6bdaf8-59bd-4c74-befb-00b5cfa32324 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:41.779966 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6bdaf8-59bd-4c74-befb-00b5cfa32324 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:41.824383 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c38a52-7016-425d-bb6c-7cf958f38190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:41.825945 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c38a52-7016-425d-bb6c-7cf958f38190 None admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:41.826555 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c38a52-7016-425d-bb6c-7cf958f38190 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:41.827046 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c38a52-7016-425d-bb6c-7cf958f38190 None admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:41.827964 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c38a52-7016-425d-bb6c-7cf958f38190 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:41.829833 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c38a52-7016-425d-bb6c-7cf958f38190 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:41.878175 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 74/141] 10.222.0.21 () {60 vars in 1132 bytes} [Mon Feb 28 10:17:41 2022] POST /identity/v3/users => generated 283 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:17:42.985894 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d2876-15d4-469d-b0f5-f9362e4b21e3 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:42.986428 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d2876-15d4-469d-b0f5-f9362e4b21e3 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:42.986428 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d2876-15d4-469d-b0f5-f9362e4b21e3 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:42.988555 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 68/142] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:17:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:17:42.994196 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020c693-7eb8-49e3-aeb7-9ae1f664e453 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:42.995050 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020c693-7eb8-49e3-aeb7-9ae1f664e453 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:42.995551 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020c693-7eb8-49e3-aeb7-9ae1f664e453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:43.017526 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-b020c693-7eb8-49e3-aeb7-9ae1f664e453 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:17:43.019061 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-b020c693-7eb8-49e3-aeb7-9ae1f664e453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:17:43.095088 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 75/143] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:17:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:17:43.127623 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d2876-15d4-469d-b0f5-f9362e4b21e3 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:43.268263 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d2876-15d4-469d-b0f5-f9362e4b21e3 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:43.312225 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f42a2f2-7c5c-4633-99bd-7ad541f0b218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:43.313032 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f42a2f2-7c5c-4633-99bd-7ad541f0b218 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:43.313320 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f42a2f2-7c5c-4633-99bd-7ad541f0b218 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:43.313599 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f42a2f2-7c5c-4633-99bd-7ad541f0b218 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:43.328701 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f42a2f2-7c5c-4633-99bd-7ad541f0b218 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:17:43.335676 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-9f42a2f2-7c5c-4633-99bd-7ad541f0b218 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 10:17:43.337062 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 69/144] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:17:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:17:43.342935 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020c693-7eb8-49e3-aeb7-9ae1f664e453 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:43.466161 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020c693-7eb8-49e3-aeb7-9ae1f664e453 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:43.502694 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f84976-16e5-460f-bc92-ac28901af44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:43.503720 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f84976-16e5-460f-bc92-ac28901af44c None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:43.504207 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f84976-16e5-460f-bc92-ac28901af44c None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:43.504701 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f84976-16e5-460f-bc92-ac28901af44c None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:43.505635 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f84976-16e5-460f-bc92-ac28901af44c None admin] RBAC: Adding query filter params (name=member) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:17:43.506132 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f84976-16e5-460f-bc92-ac28901af44c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:43.507734 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f84976-16e5-460f-bc92-ac28901af44c None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:43.517169 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 76/145] 10.222.0.21 () {56 vars in 1101 bytes} [Mon Feb 28 10:17:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:43.527710 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f42a2f2-7c5c-4633-99bd-7ad541f0b218 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:43.665000 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f42a2f2-7c5c-4633-99bd-7ad541f0b218 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:43.707383 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce750e2-9627-42c7-b0b3-fc807c68e0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:43.708257 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce750e2-9627-42c7-b0b3-fc807c68e0cd None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:43.708550 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce750e2-9627-42c7-b0b3-fc807c68e0cd None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:43.708825 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce750e2-9627-42c7-b0b3-fc807c68e0cd None admin] PATH_INFO: `/v3/users/65bb7dc9a10b405e9a58441897d664c2` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:43.710448 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce750e2-9627-42c7-b0b3-fc807c68e0cd None admin] RBAC: Authorizing `identity:get_user(user_id=65bb7dc9a10b405e9a58441897d664c2)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:43.711939 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce750e2-9627-42c7-b0b3-fc807c68e0cd None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:43.713568 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 70/146] 10.222.0.21 () {56 vars in 1177 bytes} [Mon Feb 28 10:17:43 2022] GET /identity/v3/users/65bb7dc9a10b405e9a58441897d664c2 => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:43.719424 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f84976-16e5-460f-bc92-ac28901af44c None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:43.850205 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f84976-16e5-460f-bc92-ac28901af44c None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:43.884915 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1734fde5-c47d-4586-b5f5-b501a2d9a261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:43.885569 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734fde5-c47d-4586-b5f5-b501a2d9a261 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:43.885852 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734fde5-c47d-4586-b5f5-b501a2d9a261 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:43.886128 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734fde5-c47d-4586-b5f5-b501a2d9a261 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:43.964542 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1734fde5-c47d-4586-b5f5-b501a2d9a261 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:43.966210 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1734fde5-c47d-4586-b5f5-b501a2d9a261 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:44.067214 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 77/147] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:17:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:17:44.073039 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce750e2-9627-42c7-b0b3-fc807c68e0cd None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:44.202961 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce750e2-9627-42c7-b0b3-fc807c68e0cd None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:44.242061 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3620d8b9-bef8-4efd-8a55-08281b84d132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:44.242958 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620d8b9-bef8-4efd-8a55-08281b84d132 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:44.243242 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620d8b9-bef8-4efd-8a55-08281b84d132 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:44.243518 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620d8b9-bef8-4efd-8a55-08281b84d132 None admin] PATH_INFO: `/v3/projects/067e263bb06c40a4a0e9fe2adf525073` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:44.244722 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3620d8b9-bef8-4efd-8a55-08281b84d132 None admin] RBAC: Authorizing `identity:get_project(project_id=067e263bb06c40a4a0e9fe2adf525073)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:44.246165 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3620d8b9-bef8-4efd-8a55-08281b84d132 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:44.248575 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 71/148] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:17:44 2022] GET /identity/v3/projects/067e263bb06c40a4a0e9fe2adf525073 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:44.254446 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1734fde5-c47d-4586-b5f5-b501a2d9a261 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:44.389776 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1734fde5-c47d-4586-b5f5-b501a2d9a261 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:44.425760 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20275b1-6615-45e1-80d7-182b9b4d37b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:44.426794 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20275b1-6615-45e1-80d7-182b9b4d37b5 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:44.427276 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20275b1-6615-45e1-80d7-182b9b4d37b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:44.427758 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20275b1-6615-45e1-80d7-182b9b4d37b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:44.428773 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20275b1-6615-45e1-80d7-182b9b4d37b5 None admin] RBAC: Adding query filter params (role.id=1c79fcc5aeef4042aa382ec20f77f7b9, scope.project.id=067e263bb06c40a4a0e9fe2adf525073, user.id=65bb7dc9a10b405e9a58441897d664c2) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:17:44.429322 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20275b1-6615-45e1-80d7-182b9b4d37b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:44.430977 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20275b1-6615-45e1-80d7-182b9b4d37b5 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:44.438809 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 78/149] 10.222.0.21 () {56 vars in 1374 bytes} [Mon Feb 28 10:17:44 2022] GET /identity/v3/role_assignments?user.id=65bb7dc9a10b405e9a58441897d664c2&scope.project.id=067e263bb06c40a4a0e9fe2adf525073&role.id=1c79fcc5aeef4042aa382ec20f77f7b9 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:44.665282 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333acc8c-c6d5-4397-b75c-7889838640ef None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:44.665612 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333acc8c-c6d5-4397-b75c-7889838640ef None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:44.665799 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333acc8c-c6d5-4397-b75c-7889838640ef None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:44.667570 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 72/150] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:17:44.684744 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36146fc0-10b7-4784-915f-83587d6fe0a1 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:44.685513 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36146fc0-10b7-4784-915f-83587d6fe0a1 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:44.685987 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36146fc0-10b7-4784-915f-83587d6fe0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:44.708146 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-36146fc0-10b7-4784-915f-83587d6fe0a1 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:17:44.709673 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-36146fc0-10b7-4784-915f-83587d6fe0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:17:44.797501 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 79/151] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:17:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:17:44.823028 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861259ee-9a11-4a1f-8d38-5c8b2de2ba10 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:44.823321 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861259ee-9a11-4a1f-8d38-5c8b2de2ba10 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:44.823596 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861259ee-9a11-4a1f-8d38-5c8b2de2ba10 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:44.825621 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 73/152] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:17:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:17:44.836829 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861259ee-9a11-4a1f-8d38-5c8b2de2ba10 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:44.837609 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510792c-46f2-411f-a7bc-a556c78a05ea None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:44.838095 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510792c-46f2-411f-a7bc-a556c78a05ea None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:44.838622 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510792c-46f2-411f-a7bc-a556c78a05ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:44.859663 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-b510792c-46f2-411f-a7bc-a556c78a05ea None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:17:44.860851 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-b510792c-46f2-411f-a7bc-a556c78a05ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:17:44.952088 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 80/153] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:17:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:17:44.958980 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861259ee-9a11-4a1f-8d38-5c8b2de2ba10 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:44.998505 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f148bd9-7648-467e-9479-f48dc3a106bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:44.999690 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f148bd9-7648-467e-9479-f48dc3a106bf None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:45.000194 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f148bd9-7648-467e-9479-f48dc3a106bf None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:45.000680 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f148bd9-7648-467e-9479-f48dc3a106bf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:45.008021 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510792c-46f2-411f-a7bc-a556c78a05ea None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:45.020786 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f148bd9-7648-467e-9479-f48dc3a106bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:17:45.025928 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-6f148bd9-7648-467e-9479-f48dc3a106bf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 28 10:17:45.035728 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 74/154] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:17:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:17:45.041075 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f148bd9-7648-467e-9479-f48dc3a106bf None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:45.120231 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510792c-46f2-411f-a7bc-a556c78a05ea None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:45.161006 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f148bd9-7648-467e-9479-f48dc3a106bf None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:45.171336 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b029c-ef30-47bd-ad10-4490e53dac5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:45.172143 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b029c-ef30-47bd-ad10-4490e53dac5b None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:45.172425 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b029c-ef30-47bd-ad10-4490e53dac5b None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:45.172700 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b029c-ef30-47bd-ad10-4490e53dac5b None admin] PATH_INFO: `/v3/roles/member` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:45.188431 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b029c-ef30-47bd-ad10-4490e53dac5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:17:45.197428 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd9c5c-aa48-4da9-a491-99edf4441fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:45.198281 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd9c5c-aa48-4da9-a491-99edf4441fd8 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:45.198750 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd9c5c-aa48-4da9-a491-99edf4441fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:45.199187 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd9c5c-aa48-4da9-a491-99edf4441fd8 None admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:45.199345 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-f50b029c-ef30-47bd-ad10-4490e53dac5b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 10:17:45.200220 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd9c5c-aa48-4da9-a491-99edf4441fd8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:17:45.201145 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 81/155] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:17:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:17:45.201626 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd9c5c-aa48-4da9-a491-99edf4441fd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:45.203324 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd9c5c-aa48-4da9-a491-99edf4441fd8 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:45.207500 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b029c-ef30-47bd-ad10-4490e53dac5b None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:45.212699 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 75/156] 10.222.0.21 () {56 vars in 1101 bytes} [Mon Feb 28 10:17:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:17:45.218576 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd9c5c-aa48-4da9-a491-99edf4441fd8 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:45.316727 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b029c-ef30-47bd-ad10-4490e53dac5b None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:45.320390 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd9c5c-aa48-4da9-a491-99edf4441fd8 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:45.350875 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819636f9-3c27-4d7f-b23c-b261fb1238ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:45.351618 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819636f9-3c27-4d7f-b23c-b261fb1238ba None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:45.351861 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819636f9-3c27-4d7f-b23c-b261fb1238ba None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:45.352136 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819636f9-3c27-4d7f-b23c-b261fb1238ba None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:45.352878 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819636f9-3c27-4d7f-b23c-b261fb1238ba None admin] RBAC: Adding query filter params (name=member) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:17:45.353184 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819636f9-3c27-4d7f-b23c-b261fb1238ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:45.354556 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819636f9-3c27-4d7f-b23c-b261fb1238ba None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:45.355401 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851f749-ea9d-46f0-9a8a-f958d19958b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:45.356425 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851f749-ea9d-46f0-9a8a-f958d19958b6 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:45.357446 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851f749-ea9d-46f0-9a8a-f958d19958b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:45.357863 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851f749-ea9d-46f0-9a8a-f958d19958b6 None admin] PATH_INFO: `/v3/users/cd74c74718004b1b838e598cd3e46de5` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:45.359959 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9851f749-ea9d-46f0-9a8a-f958d19958b6 None admin] RBAC: Authorizing `identity:get_user(user_id=cd74c74718004b1b838e598cd3e46de5)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:45.361568 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9851f749-ea9d-46f0-9a8a-f958d19958b6 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:45.363392 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 76/157] 10.222.0.21 () {56 vars in 1177 bytes} [Mon Feb 28 10:17:45 2022] GET /identity/v3/users/cd74c74718004b1b838e598cd3e46de5 => generated 289 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:17:45.367534 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 82/158] 10.222.0.21 () {56 vars in 1101 bytes} [Mon Feb 28 10:17:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:45.367534 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d9757-0c65-4c94-a077-193c5fbe5b79 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:45.367534 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d9757-0c65-4c94-a077-193c5fbe5b79 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:45.367534 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d9757-0c65-4c94-a077-193c5fbe5b79 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:45.367534 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 83/159] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:17:45.369671 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d9757-0c65-4c94-a077-193c5fbe5b79 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:45.371545 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851f749-ea9d-46f0-9a8a-f958d19958b6 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:45.480448 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851f749-ea9d-46f0-9a8a-f958d19958b6 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:45.523038 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5468e0-f0b0-430e-b265-61910715b568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:45.523945 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5468e0-f0b0-430e-b265-61910715b568 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:45.524233 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5468e0-f0b0-430e-b265-61910715b568 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:45.524506 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5468e0-f0b0-430e-b265-61910715b568 None admin] PATH_INFO: `/v3/projects/067e263bb06c40a4a0e9fe2adf525073` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:45.529107 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5468e0-f0b0-430e-b265-61910715b568 None admin] RBAC: Authorizing `identity:get_project(project_id=067e263bb06c40a4a0e9fe2adf525073)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:45.530339 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5468e0-f0b0-430e-b265-61910715b568 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:45.532387 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 77/160] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:17:45 2022] GET /identity/v3/projects/067e263bb06c40a4a0e9fe2adf525073 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:45.533326 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcbd20-31b0-4acf-b101-6dee5dad12da None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:45.533609 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcbd20-31b0-4acf-b101-6dee5dad12da None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:45.533981 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcbd20-31b0-4acf-b101-6dee5dad12da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:45.538292 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d9757-0c65-4c94-a077-193c5fbe5b79 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:45.565162 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-2adcbd20-31b0-4acf-b101-6dee5dad12da None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:17:45.566419 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-2adcbd20-31b0-4acf-b101-6dee5dad12da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:17:45.573217 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168fc742-1f43-4796-a875-85b2bfc8555c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:45.574078 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fc742-1f43-4796-a875-85b2bfc8555c None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:45.574353 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fc742-1f43-4796-a875-85b2bfc8555c None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:45.574634 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fc742-1f43-4796-a875-85b2bfc8555c None admin] PATH_INFO: `/v3/users/65bb7dc9a10b405e9a58441897d664c2` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:45.576357 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168fc742-1f43-4796-a875-85b2bfc8555c None admin] RBAC: Authorizing `identity:get_user(user_id=65bb7dc9a10b405e9a58441897d664c2)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:45.577796 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168fc742-1f43-4796-a875-85b2bfc8555c None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:45.579440 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 84/161] 10.222.0.21 () {56 vars in 1177 bytes} [Mon Feb 28 10:17:45 2022] GET /identity/v3/users/65bb7dc9a10b405e9a58441897d664c2 => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:45.580621 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08e8f5-61cc-492b-9ce0-0c022f148104 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:45.580901 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08e8f5-61cc-492b-9ce0-0c022f148104 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:45.581170 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08e8f5-61cc-492b-9ce0-0c022f148104 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:45.583002 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 85/162] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:17:45.583493 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08e8f5-61cc-492b-9ce0-0c022f148104 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:45.686960 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08e8f5-61cc-492b-9ce0-0c022f148104 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:45.704958 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 78/163] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:17:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:17:45.706783 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05204833-d335-4b3f-8788-c5378273ddad None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:45.707273 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05204833-d335-4b3f-8788-c5378273ddad None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:45.707742 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05204833-d335-4b3f-8788-c5378273ddad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:45.721592 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361eb4e2-d53d-4f18-8431-071e55d244a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:45.722473 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361eb4e2-d53d-4f18-8431-071e55d244a4 None admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:45.722772 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361eb4e2-d53d-4f18-8431-071e55d244a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:45.723040 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361eb4e2-d53d-4f18-8431-071e55d244a4 None admin] PATH_INFO: `/v3/projects/067e263bb06c40a4a0e9fe2adf525073/users/cd74c74718004b1b838e598cd3e46de5/roles/86661077994d4bb6b80bab41d2f2c953` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:45.724984 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361eb4e2-d53d-4f18-8431-071e55d244a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=067e263bb06c40a4a0e9fe2adf525073, user_id=cd74c74718004b1b838e598cd3e46de5, role_id=86661077994d4bb6b80bab41d2f2c953)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:45.726424 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361eb4e2-d53d-4f18-8431-071e55d244a4 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:45.743362 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-05204833-d335-4b3f-8788-c5378273ddad None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:17:45.752218 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 86/164] 10.222.0.21 () {58 vars in 1439 bytes} [Mon Feb 28 10:17:45 2022] PUT /identity/v3/projects/067e263bb06c40a4a0e9fe2adf525073/users/cd74c74718004b1b838e598cd3e46de5/roles/86661077994d4bb6b80bab41d2f2c953 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:17:45.752799 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361eb4e2-d53d-4f18-8431-071e55d244a4 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:45.753683 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-05204833-d335-4b3f-8788-c5378273ddad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:17:45.867539 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361eb4e2-d53d-4f18-8431-071e55d244a4 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:45.902993 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c4da3-c430-4a74-9f83-a60c0a609053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:45.904464 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c4da3-c430-4a74-9f83-a60c0a609053 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:45.904744 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c4da3-c430-4a74-9f83-a60c0a609053 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:45.905014 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c4da3-c430-4a74-9f83-a60c0a609053 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:45.905972 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 79/165] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:17:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:17:45.906674 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05204833-d335-4b3f-8788-c5378273ddad None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:45.976736 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56c4da3-c430-4a74-9f83-a60c0a609053 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:45.978434 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56c4da3-c430-4a74-9f83-a60c0a609053 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:46.011493 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05204833-d335-4b3f-8788-c5378273ddad None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:46.047926 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61452998-3a67-43cf-9af0-8546102b4aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:46.048771 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61452998-3a67-43cf-9af0-8546102b4aba None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:46.049060 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61452998-3a67-43cf-9af0-8546102b4aba None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:46.049337 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61452998-3a67-43cf-9af0-8546102b4aba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:46.061192 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61452998-3a67-43cf-9af0-8546102b4aba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:17:46.068353 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-61452998-3a67-43cf-9af0-8546102b4aba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:17:46.070049 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 80/166] 10.222.0.21 () {56 vars in 1096 bytes} [Mon Feb 28 10:17:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:17:46.074628 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61452998-3a67-43cf-9af0-8546102b4aba None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:46.090753 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 87/167] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:17:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:17:46.091884 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c4da3-c430-4a74-9f83-a60c0a609053 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:46.181937 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61452998-3a67-43cf-9af0-8546102b4aba None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:46.196353 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c4da3-c430-4a74-9f83-a60c0a609053 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:46.217557 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02818e1-bce8-49ce-9893-ef289383f90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:46.218628 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02818e1-bce8-49ce-9893-ef289383f90b None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:46.218745 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02818e1-bce8-49ce-9893-ef289383f90b None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:46.218931 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02818e1-bce8-49ce-9893-ef289383f90b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:46.229683 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02818e1-bce8-49ce-9893-ef289383f90b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:17:46.234087 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ffad8d-7ab8-4c1f-93c0-4c789d2a0f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:46.234984 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ffad8d-7ab8-4c1f-93c0-4c789d2a0f97 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:46.235443 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ffad8d-7ab8-4c1f-93c0-4c789d2a0f97 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:46.235900 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ffad8d-7ab8-4c1f-93c0-4c789d2a0f97 None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:46.236803 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ffad8d-7ab8-4c1f-93c0-4c789d2a0f97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:17:46.237286 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ffad8d-7ab8-4c1f-93c0-4c789d2a0f97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:46.237879 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-f02818e1-bce8-49ce-9893-ef289383f90b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 10:17:46.239013 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ffad8d-7ab8-4c1f-93c0-4c789d2a0f97 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:46.239193 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 81/168] 10.222.0.21 () {56 vars in 1114 bytes} [Mon Feb 28 10:17:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:17:46.239972 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02818e1-bce8-49ce-9893-ef289383f90b None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:46.248806 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 88/169] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:17:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:46.249844 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ffad8d-7ab8-4c1f-93c0-4c789d2a0f97 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:46.349088 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02818e1-bce8-49ce-9893-ef289383f90b None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:46.359983 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ffad8d-7ab8-4c1f-93c0-4c789d2a0f97 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:46.382944 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31737b-4d88-4e57-a089-f1bd0e312cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:46.383796 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31737b-4d88-4e57-a089-f1bd0e312cd9 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:46.384111 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31737b-4d88-4e57-a089-f1bd0e312cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:46.384345 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31737b-4d88-4e57-a089-f1bd0e312cd9 None admin] PATH_INFO: `/v3/projects/1bd8eb870236450d89f5867026bd925e` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:46.385536 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d31737b-4d88-4e57-a089-f1bd0e312cd9 None admin] RBAC: Authorizing `identity:get_project(project_id=1bd8eb870236450d89f5867026bd925e)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:46.387112 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d31737b-4d88-4e57-a089-f1bd0e312cd9 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:46.389428 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 82/170] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:17:46 2022] GET /identity/v3/projects/1bd8eb870236450d89f5867026bd925e => generated 312 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:46.390189 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31737b-4d88-4e57-a089-f1bd0e312cd9 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:46.394808 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6051a7-ea14-402b-a62a-27ddec6eeb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:46.395656 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6051a7-ea14-402b-a62a-27ddec6eeb22 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:46.396075 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6051a7-ea14-402b-a62a-27ddec6eeb22 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:46.396509 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6051a7-ea14-402b-a62a-27ddec6eeb22 None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:46.397397 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6051a7-ea14-402b-a62a-27ddec6eeb22 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:17:46.397844 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6051a7-ea14-402b-a62a-27ddec6eeb22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:46.399492 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6051a7-ea14-402b-a62a-27ddec6eeb22 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:46.408319 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 89/171] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:17:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:46.409559 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6051a7-ea14-402b-a62a-27ddec6eeb22 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:46.507552 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6051a7-ea14-402b-a62a-27ddec6eeb22 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:46.532554 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31737b-4d88-4e57-a089-f1bd0e312cd9 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:46.542515 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2509c684-a59e-4b2c-a66d-776d68b348b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:46.543560 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509c684-a59e-4b2c-a66d-776d68b348b2 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:46.544206 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509c684-a59e-4b2c-a66d-776d68b348b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:46.545193 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509c684-a59e-4b2c-a66d-776d68b348b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:46.546160 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2509c684-a59e-4b2c-a66d-776d68b348b2 None admin] RBAC: Adding query filter params (role.id=1c79fcc5aeef4042aa382ec20f77f7b9, scope.project.id=1bd8eb870236450d89f5867026bd925e, user.id=65bb7dc9a10b405e9a58441897d664c2) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:17:46.546992 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2509c684-a59e-4b2c-a66d-776d68b348b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:46.548562 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2509c684-a59e-4b2c-a66d-776d68b348b2 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:46.554882 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 90/172] 10.222.0.21 () {56 vars in 1374 bytes} [Mon Feb 28 10:17:46 2022] GET /identity/v3/role_assignments?user.id=65bb7dc9a10b405e9a58441897d664c2&scope.project.id=1bd8eb870236450d89f5867026bd925e&role.id=1c79fcc5aeef4042aa382ec20f77f7b9 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:46.555909 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2509c684-a59e-4b2c-a66d-776d68b348b2 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:46.599058 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ffc3c3-ea9b-4cca-b722-06145edfae9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:46.599995 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffc3c3-ea9b-4cca-b722-06145edfae9d None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:46.600205 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffc3c3-ea9b-4cca-b722-06145edfae9d None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:46.600473 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffc3c3-ea9b-4cca-b722-06145edfae9d None admin] PATH_INFO: `/v3/users/6ceda84916c547c4bc3f54154671eb74` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:46.602089 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ffc3c3-ea9b-4cca-b722-06145edfae9d None admin] RBAC: Authorizing `identity:get_user(user_id=6ceda84916c547c4bc3f54154671eb74)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:46.603276 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ffc3c3-ea9b-4cca-b722-06145edfae9d None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:46.604969 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 83/173] 10.222.0.21 () {56 vars in 1177 bytes} [Mon Feb 28 10:17:46 2022] GET /identity/v3/users/6ceda84916c547c4bc3f54154671eb74 => generated 247 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:46.624508 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ffc3c3-ea9b-4cca-b722-06145edfae9d None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:46.670334 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2509c684-a59e-4b2c-a66d-776d68b348b2 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:46.705757 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f8957-6b9d-4836-935f-dc023ba07214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:46.706928 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f8957-6b9d-4836-935f-dc023ba07214 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:46.707380 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f8957-6b9d-4836-935f-dc023ba07214 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:46.707789 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f8957-6b9d-4836-935f-dc023ba07214 None admin] PATH_INFO: `/v3/users/65bb7dc9a10b405e9a58441897d664c2` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:46.709163 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f8957-6b9d-4836-935f-dc023ba07214 None admin] RBAC: Authorizing `identity:get_user(user_id=65bb7dc9a10b405e9a58441897d664c2)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:46.710784 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f8957-6b9d-4836-935f-dc023ba07214 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:46.712854 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 91/174] 10.222.0.21 () {56 vars in 1177 bytes} [Mon Feb 28 10:17:46 2022] GET /identity/v3/users/65bb7dc9a10b405e9a58441897d664c2 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:46.718130 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f8957-6b9d-4836-935f-dc023ba07214 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:46.753569 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ffc3c3-ea9b-4cca-b722-06145edfae9d None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:46.788823 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5402e-aa87-4a98-83cc-314ac025ce57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:46.789476 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5402e-aa87-4a98-83cc-314ac025ce57 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:46.789759 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5402e-aa87-4a98-83cc-314ac025ce57 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:46.790036 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5402e-aa87-4a98-83cc-314ac025ce57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:46.834798 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f8957-6b9d-4836-935f-dc023ba07214 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:46.869743 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a9548-7bb1-4267-a8e7-8d8c8ef5bb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:46.870385 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a9548-7bb1-4267-a8e7-8d8c8ef5bb1d None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:46.870689 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a9548-7bb1-4267-a8e7-8d8c8ef5bb1d None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:46.870963 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a9548-7bb1-4267-a8e7-8d8c8ef5bb1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:46.891484 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5402e-aa87-4a98-83cc-314ac025ce57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:46.892975 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5402e-aa87-4a98-83cc-314ac025ce57 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:46.941660 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510a9548-7bb1-4267-a8e7-8d8c8ef5bb1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:46.943406 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510a9548-7bb1-4267-a8e7-8d8c8ef5bb1d None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:47.047551 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 92/175] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:17:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:17:47.049091 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f4cbe-d05f-4a55-b809-648182f585ab None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:47.049515 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f4cbe-d05f-4a55-b809-648182f585ab None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:47.049926 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f4cbe-d05f-4a55-b809-648182f585ab None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:47.051859 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 93/176] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:17:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:17:47.055414 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f4cbe-d05f-4a55-b809-648182f585ab None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:47.093783 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 84/177] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:17:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:17:47.095150 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc5832-2076-46d7-bc6c-6a98ab65fc5b None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:47.095437 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc5832-2076-46d7-bc6c-6a98ab65fc5b None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:47.095712 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc5832-2076-46d7-bc6c-6a98ab65fc5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:47.127696 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-7fdc5832-2076-46d7-bc6c-6a98ab65fc5b None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:17:47.128817 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-7fdc5832-2076-46d7-bc6c-6a98ab65fc5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:17:47.160076 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f4cbe-d05f-4a55-b809-648182f585ab None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:47.195301 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b7772-b64d-458a-a966-1d2a5cac0bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:47.196662 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b7772-b64d-458a-a966-1d2a5cac0bb4 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:47.197498 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b7772-b64d-458a-a966-1d2a5cac0bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:47.197890 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b7772-b64d-458a-a966-1d2a5cac0bb4 None admin] PATH_INFO: `/v3/projects/067e263bb06c40a4a0e9fe2adf525073` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:47.199223 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b7772-b64d-458a-a966-1d2a5cac0bb4 None admin] RBAC: Authorizing `identity:get_project(project_id=067e263bb06c40a4a0e9fe2adf525073)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:47.201497 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b7772-b64d-458a-a966-1d2a5cac0bb4 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:47.203618 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 94/178] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:17:47 2022] GET /identity/v3/projects/067e263bb06c40a4a0e9fe2adf525073 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:47.204522 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b7772-b64d-458a-a966-1d2a5cac0bb4 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:47.255611 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 85/179] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:17:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:17:47.256547 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc5832-2076-46d7-bc6c-6a98ab65fc5b None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:47.304113 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b7772-b64d-458a-a966-1d2a5cac0bb4 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:47.338212 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa62d9-f60d-4abe-acef-5930d4a6384c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:47.339428 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa62d9-f60d-4abe-acef-5930d4a6384c None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:47.339909 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa62d9-f60d-4abe-acef-5930d4a6384c None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:47.340378 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa62d9-f60d-4abe-acef-5930d4a6384c None admin] PATH_INFO: `/v3/projects/067e263bb06c40a4a0e9fe2adf525073` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:47.342305 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa62d9-f60d-4abe-acef-5930d4a6384c None admin] RBAC: Authorizing `identity:get_project(project_id=067e263bb06c40a4a0e9fe2adf525073)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:47.343985 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa62d9-f60d-4abe-acef-5930d4a6384c None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:47.345884 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 95/180] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:17:47 2022] GET /identity/v3/projects/067e263bb06c40a4a0e9fe2adf525073 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:47.346913 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa62d9-f60d-4abe-acef-5930d4a6384c None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:47.405750 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc5832-2076-46d7-bc6c-6a98ab65fc5b None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:47.439883 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8231c3-876a-47ad-8f37-cf555e551bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:47.440807 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8231c3-876a-47ad-8f37-cf555e551bd1 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:47.441231 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8231c3-876a-47ad-8f37-cf555e551bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:47.441642 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8231c3-876a-47ad-8f37-cf555e551bd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:47.442616 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8231c3-876a-47ad-8f37-cf555e551bd1 None admin] RBAC: Adding query filter params (role.id=101ea48f12324cee9b597825e21f34b4, scope.project.id=067e263bb06c40a4a0e9fe2adf525073, user.id=65bb7dc9a10b405e9a58441897d664c2) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:17:47.443121 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8231c3-876a-47ad-8f37-cf555e551bd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:47.444699 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8231c3-876a-47ad-8f37-cf555e551bd1 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:47.450126 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa62d9-f60d-4abe-acef-5930d4a6384c None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:47.451336 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 86/181] 10.222.0.21 () {56 vars in 1374 bytes} [Mon Feb 28 10:17:47 2022] GET /identity/v3/role_assignments?user.id=65bb7dc9a10b405e9a58441897d664c2&scope.project.id=067e263bb06c40a4a0e9fe2adf525073&role.id=101ea48f12324cee9b597825e21f34b4 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:47.452383 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8231c3-876a-47ad-8f37-cf555e551bd1 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:47.499430 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3991f56-5cd1-4d08-ad40-aa8e51dfb9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:47.500440 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3991f56-5cd1-4d08-ad40-aa8e51dfb9cf None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:47.500833 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3991f56-5cd1-4d08-ad40-aa8e51dfb9cf None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:47.501202 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3991f56-5cd1-4d08-ad40-aa8e51dfb9cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:47.512636 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3991f56-5cd1-4d08-ad40-aa8e51dfb9cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:17:47.524664 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-e3991f56-5cd1-4d08-ad40-aa8e51dfb9cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:17:47.526347 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 96/182] 10.222.0.21 () {56 vars in 1096 bytes} [Mon Feb 28 10:17:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:17:47.533232 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3991f56-5cd1-4d08-ad40-aa8e51dfb9cf None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:47.558642 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8231c3-876a-47ad-8f37-cf555e551bd1 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:47.599202 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a782b-2e64-4030-a8a0-10155ea430a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:47.600266 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a782b-2e64-4030-a8a0-10155ea430a9 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:47.600747 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a782b-2e64-4030-a8a0-10155ea430a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:47.601215 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a782b-2e64-4030-a8a0-10155ea430a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:47.603682 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665a782b-2e64-4030-a8a0-10155ea430a9 None admin] RBAC: Adding query filter params (role.id=48e4608a7b3f4b87a20b10c4d1b45aa9, scope.project.id=067e263bb06c40a4a0e9fe2adf525073, user.id=6ceda84916c547c4bc3f54154671eb74) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:17:47.604224 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665a782b-2e64-4030-a8a0-10155ea430a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:47.605901 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665a782b-2e64-4030-a8a0-10155ea430a9 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:47.613138 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 87/183] 10.222.0.21 () {56 vars in 1374 bytes} [Mon Feb 28 10:17:47 2022] GET /identity/v3/role_assignments?user.id=6ceda84916c547c4bc3f54154671eb74&scope.project.id=067e263bb06c40a4a0e9fe2adf525073&role.id=48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:47.642507 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3991f56-5cd1-4d08-ad40-aa8e51dfb9cf None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:47.686762 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d581a22-06a4-4841-8db6-1bf30d1e9852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:47.687381 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d581a22-06a4-4841-8db6-1bf30d1e9852 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:47.687663 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d581a22-06a4-4841-8db6-1bf30d1e9852 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:47.687934 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d581a22-06a4-4841-8db6-1bf30d1e9852 None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:47.688697 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d581a22-06a4-4841-8db6-1bf30d1e9852 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:17:47.688999 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d581a22-06a4-4841-8db6-1bf30d1e9852 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:47.690401 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d581a22-06a4-4841-8db6-1bf30d1e9852 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:47.702702 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 97/184] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:17:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:47.706208 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a782b-2e64-4030-a8a0-10155ea430a9 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:47.846394 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a782b-2e64-4030-a8a0-10155ea430a9 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:47.899424 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32273ef3-baa3-4725-b0c2-1d1933f6e78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:47.900323 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32273ef3-baa3-4725-b0c2-1d1933f6e78c None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:47.900604 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32273ef3-baa3-4725-b0c2-1d1933f6e78c None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:47.900876 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32273ef3-baa3-4725-b0c2-1d1933f6e78c None admin] PATH_INFO: `/v3/users/c41ad9db867d4be7a261befd902c0b32` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:47.917873 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f0040-36cc-49a9-a749-5d3ee5a0940e None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:47.918212 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f0040-36cc-49a9-a749-5d3ee5a0940e None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:47.918437 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f0040-36cc-49a9-a749-5d3ee5a0940e None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:47.920633 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 98/185] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:17:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:17:47.926918 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd4100-a6f1-4266-b852-7f67059110ff None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:47.927199 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd4100-a6f1-4266-b852-7f67059110ff None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:47.927471 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd4100-a6f1-4266-b852-7f67059110ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:47.930240 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32273ef3-baa3-4725-b0c2-1d1933f6e78c None admin] RBAC: Authorizing `identity:get_user(user_id=c41ad9db867d4be7a261befd902c0b32)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:47.931746 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32273ef3-baa3-4725-b0c2-1d1933f6e78c None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:47.933487 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 88/186] 10.222.0.21 () {56 vars in 1177 bytes} [Mon Feb 28 10:17:47 2022] GET /identity/v3/users/c41ad9db867d4be7a261befd902c0b32 => generated 283 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:47.939610 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32273ef3-baa3-4725-b0c2-1d1933f6e78c None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:47.951969 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-24fd4100-a6f1-4266-b852-7f67059110ff None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:17:47.953622 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-24fd4100-a6f1-4266-b852-7f67059110ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:17:48.042905 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 99/187] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:17:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 10:17:48.057810 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32273ef3-baa3-4725-b0c2-1d1933f6e78c None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:48.069943 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd4100-a6f1-4266-b852-7f67059110ff None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:48.101834 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef73b445-6986-48b0-9b96-004047c15ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:48.102484 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73b445-6986-48b0-9b96-004047c15ff8 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:48.102955 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73b445-6986-48b0-9b96-004047c15ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:48.103375 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73b445-6986-48b0-9b96-004047c15ff8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:48.177571 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef73b445-6986-48b0-9b96-004047c15ff8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:48.179337 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef73b445-6986-48b0-9b96-004047c15ff8 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:48.209049 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd4100-a6f1-4266-b852-7f67059110ff None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:48.246783 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e33a8-c180-4c8c-bed8-9d408888be14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:48.247790 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e33a8-c180-4c8c-bed8-9d408888be14 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:48.248071 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e33a8-c180-4c8c-bed8-9d408888be14 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:48.248340 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e33a8-c180-4c8c-bed8-9d408888be14 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:48.258734 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e33a8-c180-4c8c-bed8-9d408888be14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:17:48.266248 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-fe7e33a8-c180-4c8c-bed8-9d408888be14 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 10:17:48.268050 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 100/188] 10.222.0.21 () {56 vars in 1114 bytes} [Mon Feb 28 10:17:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:17:48.269468 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f15fa-14f7-4221-b2e8-dbd2e14e0fe5 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:48.269750 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f15fa-14f7-4221-b2e8-dbd2e14e0fe5 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:48.270025 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f15fa-14f7-4221-b2e8-dbd2e14e0fe5 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:48.271721 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 101/189] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:17:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:17:48.276364 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f15fa-14f7-4221-b2e8-dbd2e14e0fe5 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:48.295616 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 89/190] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:17:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Feb 28 10:17:48.296914 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20412a01-4ad1-437c-b0dc-364639f0e93b None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:48.297200 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20412a01-4ad1-437c-b0dc-364639f0e93b None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:48.297472 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20412a01-4ad1-437c-b0dc-364639f0e93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:48.314347 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-20412a01-4ad1-437c-b0dc-364639f0e93b None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:17:48.315581 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-20412a01-4ad1-437c-b0dc-364639f0e93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:17:48.379578 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 90/191] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:17:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:17:48.380228 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20412a01-4ad1-437c-b0dc-364639f0e93b None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:48.388415 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f15fa-14f7-4221-b2e8-dbd2e14e0fe5 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:48.424336 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd5fc5b-b93c-4e07-932b-f95f1281c6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:48.425000 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5fc5b-b93c-4e07-932b-f95f1281c6eb None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:48.425279 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5fc5b-b93c-4e07-932b-f95f1281c6eb None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:48.425949 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5fc5b-b93c-4e07-932b-f95f1281c6eb None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:48.426714 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd5fc5b-b93c-4e07-932b-f95f1281c6eb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:17:48.427019 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd5fc5b-b93c-4e07-932b-f95f1281c6eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:48.429080 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd5fc5b-b93c-4e07-932b-f95f1281c6eb None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:48.440683 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 102/192] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:17:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:17:48.441792 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd5fc5b-b93c-4e07-932b-f95f1281c6eb None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:48.488828 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20412a01-4ad1-437c-b0dc-364639f0e93b None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:48.526557 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b32e085-658e-467e-862e-cf3db12c3ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:48.527425 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32e085-658e-467e-862e-cf3db12c3ed6 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:48.527706 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32e085-658e-467e-862e-cf3db12c3ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:48.527989 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32e085-658e-467e-862e-cf3db12c3ed6 None admin] PATH_INFO: `/v3/projects/6ddffcb5f354434d9e960ae5d51d1a95` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:48.529210 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b32e085-658e-467e-862e-cf3db12c3ed6 None admin] RBAC: Authorizing `identity:get_project(project_id=6ddffcb5f354434d9e960ae5d51d1a95)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:48.530654 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b32e085-658e-467e-862e-cf3db12c3ed6 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:48.537115 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 91/193] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:17:48 2022] GET /identity/v3/projects/6ddffcb5f354434d9e960ae5d51d1a95 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:48.537115 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b32e085-658e-467e-862e-cf3db12c3ed6 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:48.545876 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd5fc5b-b93c-4e07-932b-f95f1281c6eb None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:48.582468 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be58efa-c3c0-4344-ad70-9b03207b7fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:48.583139 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be58efa-c3c0-4344-ad70-9b03207b7fe8 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:48.583429 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be58efa-c3c0-4344-ad70-9b03207b7fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:48.583708 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be58efa-c3c0-4344-ad70-9b03207b7fe8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:48.584851 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be58efa-c3c0-4344-ad70-9b03207b7fe8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:48.586282 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be58efa-c3c0-4344-ad70-9b03207b7fe8 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:48.593136 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 103/194] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:17:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:48.593136 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be58efa-c3c0-4344-ad70-9b03207b7fe8 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:48.639051 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b32e085-658e-467e-862e-cf3db12c3ed6 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:48.671989 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4091a5-66e0-4360-ae39-a044a69219f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:48.673170 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4091a5-66e0-4360-ae39-a044a69219f6 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:48.673358 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4091a5-66e0-4360-ae39-a044a69219f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:48.673568 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4091a5-66e0-4360-ae39-a044a69219f6 None admin] PATH_INFO: `/v3/users/c41ad9db867d4be7a261befd902c0b32` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:48.674785 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4091a5-66e0-4360-ae39-a044a69219f6 None admin] RBAC: Authorizing `identity:get_user(user_id=c41ad9db867d4be7a261befd902c0b32)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:48.676224 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4091a5-66e0-4360-ae39-a044a69219f6 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:48.678000 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 92/195] 10.222.0.21 () {56 vars in 1177 bytes} [Mon Feb 28 10:17:48 2022] GET /identity/v3/users/c41ad9db867d4be7a261befd902c0b32 => generated 283 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:48.678565 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4091a5-66e0-4360-ae39-a044a69219f6 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:48.695772 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be58efa-c3c0-4344-ad70-9b03207b7fe8 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:48.727840 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77088625-119e-4d13-9bef-f7cff024b9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:48.728487 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77088625-119e-4d13-9bef-f7cff024b9b0 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:48.728767 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77088625-119e-4d13-9bef-f7cff024b9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:48.729043 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77088625-119e-4d13-9bef-f7cff024b9b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:48.729857 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77088625-119e-4d13-9bef-f7cff024b9b0 None admin] RBAC: Adding query filter params (role.id=48e4608a7b3f4b87a20b10c4d1b45aa9, scope.project.id=6ddffcb5f354434d9e960ae5d51d1a95, user.id=c41ad9db867d4be7a261befd902c0b32) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:17:48.730164 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77088625-119e-4d13-9bef-f7cff024b9b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:48.731662 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77088625-119e-4d13-9bef-f7cff024b9b0 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:48.746715 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 104/196] 10.222.0.21 () {56 vars in 1374 bytes} [Mon Feb 28 10:17:48 2022] GET /identity/v3/role_assignments?user.id=c41ad9db867d4be7a261befd902c0b32&scope.project.id=6ddffcb5f354434d9e960ae5d51d1a95&role.id=48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:48.746715 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77088625-119e-4d13-9bef-f7cff024b9b0 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:48.802933 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4091a5-66e0-4360-ae39-a044a69219f6 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:48.855285 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03738c-6cd3-4af9-97df-1b443aad911b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:48.856598 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03738c-6cd3-4af9-97df-1b443aad911b None admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:48.857648 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03738c-6cd3-4af9-97df-1b443aad911b None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:48.858231 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03738c-6cd3-4af9-97df-1b443aad911b None admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:48.859662 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a03738c-6cd3-4af9-97df-1b443aad911b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:48.861724 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a03738c-6cd3-4af9-97df-1b443aad911b None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:48.865045 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77088625-119e-4d13-9bef-f7cff024b9b0 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:48.889628 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 93/197] 10.222.0.21 () {60 vars in 1132 bytes} [Mon Feb 28 10:17:48 2022] POST /identity/v3/users => generated 297 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:17:48.912943 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c68275-b5d7-469c-a57b-c415225b96ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:48.913614 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c68275-b5d7-469c-a57b-c415225b96ef None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:48.913895 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c68275-b5d7-469c-a57b-c415225b96ef None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:48.914167 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c68275-b5d7-469c-a57b-c415225b96ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:48.998007 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c68275-b5d7-469c-a57b-c415225b96ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:48.999499 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c68275-b5d7-469c-a57b-c415225b96ef None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:49.112468 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 105/198] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:17:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:17:49.118038 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03738c-6cd3-4af9-97df-1b443aad911b None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:49.237688 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03738c-6cd3-4af9-97df-1b443aad911b None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:49.275890 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f9980a-71eb-497e-8560-9b408836b47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:49.277070 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9980a-71eb-497e-8560-9b408836b47d None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:49.277567 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9980a-71eb-497e-8560-9b408836b47d None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:49.278037 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9980a-71eb-497e-8560-9b408836b47d None admin] PATH_INFO: `/v3/projects/6ddffcb5f354434d9e960ae5d51d1a95` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:49.280763 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f9980a-71eb-497e-8560-9b408836b47d None admin] RBAC: Authorizing `identity:get_project(project_id=6ddffcb5f354434d9e960ae5d51d1a95)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:49.282422 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f9980a-71eb-497e-8560-9b408836b47d None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:49.284409 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 94/199] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:17:49 2022] GET /identity/v3/projects/6ddffcb5f354434d9e960ae5d51d1a95 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:49.290474 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c68275-b5d7-469c-a57b-c415225b96ef None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:49.359012 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717bacb-1d25-4533-ab24-60f6b9044a61 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:49.359502 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717bacb-1d25-4533-ab24-60f6b9044a61 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:49.359576 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717bacb-1d25-4533-ab24-60f6b9044a61 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:49.361310 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 95/200] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:17:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:17:49.366881 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a256e-e0f5-4c84-bf24-0aac0d8300ae None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:49.367365 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a256e-e0f5-4c84-bf24-0aac0d8300ae None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:49.367779 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a256e-e0f5-4c84-bf24-0aac0d8300ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:49.388072 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-7a4a256e-e0f5-4c84-bf24-0aac0d8300ae None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:17:49.389928 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-7a4a256e-e0f5-4c84-bf24-0aac0d8300ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:17:49.401899 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c68275-b5d7-469c-a57b-c415225b96ef None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:49.441906 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3cf176-acee-4f57-940a-54f3fab5001f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:49.442830 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cf176-acee-4f57-940a-54f3fab5001f None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:49.443307 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cf176-acee-4f57-940a-54f3fab5001f None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:49.443723 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cf176-acee-4f57-940a-54f3fab5001f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:49.444718 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3cf176-acee-4f57-940a-54f3fab5001f None admin] RBAC: Adding query filter params (role.id=101ea48f12324cee9b597825e21f34b4, scope.project.id=6ddffcb5f354434d9e960ae5d51d1a95, user.id=c41ad9db867d4be7a261befd902c0b32) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:17:49.445173 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3cf176-acee-4f57-940a-54f3fab5001f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:49.447080 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3cf176-acee-4f57-940a-54f3fab5001f None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:49.454079 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 106/201] 10.222.0.21 () {56 vars in 1374 bytes} [Mon Feb 28 10:17:49 2022] GET /identity/v3/role_assignments?user.id=c41ad9db867d4be7a261befd902c0b32&scope.project.id=6ddffcb5f354434d9e960ae5d51d1a95&role.id=101ea48f12324cee9b597825e21f34b4 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:17:49.474177 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 96/202] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:17:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 10:17:49.499625 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3cf176-acee-4f57-940a-54f3fab5001f None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:49.613806 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3cf176-acee-4f57-940a-54f3fab5001f None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:49.650362 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7df31-4677-415c-a91d-8d73b3b1b395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:49.651174 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7df31-4677-415c-a91d-8d73b3b1b395 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:49.651450 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7df31-4677-415c-a91d-8d73b3b1b395 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:49.651715 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7df31-4677-415c-a91d-8d73b3b1b395 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:49.662359 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd7df31-4677-415c-a91d-8d73b3b1b395 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:17:49.669377 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-5dd7df31-4677-415c-a91d-8d73b3b1b395 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 28 10:17:49.670696 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 107/203] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:17:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:17:49.676528 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a256e-e0f5-4c84-bf24-0aac0d8300ae None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:49.777915 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a256e-e0f5-4c84-bf24-0aac0d8300ae None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:49.812706 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f3c3a-4947-4c3d-b0e5-5bc5caa237d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:49.813374 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f3c3a-4947-4c3d-b0e5-5bc5caa237d8 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:49.813696 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f3c3a-4947-4c3d-b0e5-5bc5caa237d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:49.813970 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f3c3a-4947-4c3d-b0e5-5bc5caa237d8 None admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:49.814745 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f3c3a-4947-4c3d-b0e5-5bc5caa237d8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:17:49.815044 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f3c3a-4947-4c3d-b0e5-5bc5caa237d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:49.816461 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f3c3a-4947-4c3d-b0e5-5bc5caa237d8 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:49.825088 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 97/204] 10.222.0.21 () {56 vars in 1101 bytes} [Mon Feb 28 10:17:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:49.831224 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7df31-4677-415c-a91d-8d73b3b1b395 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:49.930948 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7df31-4677-415c-a91d-8d73b3b1b395 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:49.964385 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eaabf7-7b6a-46e6-9882-cb484d26447c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:49.965246 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eaabf7-7b6a-46e6-9882-cb484d26447c None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:49.965522 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eaabf7-7b6a-46e6-9882-cb484d26447c None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:49.965887 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eaabf7-7b6a-46e6-9882-cb484d26447c None admin] PATH_INFO: `/v3/users/cd74c74718004b1b838e598cd3e46de5` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:49.967174 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eaabf7-7b6a-46e6-9882-cb484d26447c None admin] RBAC: Authorizing `identity:get_user(user_id=cd74c74718004b1b838e598cd3e46de5)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:49.968662 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eaabf7-7b6a-46e6-9882-cb484d26447c None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:49.970495 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 108/205] 10.222.0.21 () {56 vars in 1177 bytes} [Mon Feb 28 10:17:49 2022] GET /identity/v3/users/cd74c74718004b1b838e598cd3e46de5 => generated 289 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:49.975698 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f3c3a-4947-4c3d-b0e5-5bc5caa237d8 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:50.074183 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f3c3a-4947-4c3d-b0e5-5bc5caa237d8 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:50.118794 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c44468-0594-4c4d-83f9-cd95782a6335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:50.119458 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c44468-0594-4c4d-83f9-cd95782a6335 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:50.119738 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c44468-0594-4c4d-83f9-cd95782a6335 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:50.120017 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c44468-0594-4c4d-83f9-cd95782a6335 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:50.209734 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c44468-0594-4c4d-83f9-cd95782a6335 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:50.211160 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c44468-0594-4c4d-83f9-cd95782a6335 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:50.326181 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 98/206] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:17:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Feb 28 10:17:50.331323 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eaabf7-7b6a-46e6-9882-cb484d26447c None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:50.452197 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eaabf7-7b6a-46e6-9882-cb484d26447c None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:50.490070 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b1357-38be-44b2-9e35-573669255237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:50.490872 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b1357-38be-44b2-9e35-573669255237 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:50.491152 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b1357-38be-44b2-9e35-573669255237 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:50.491424 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b1357-38be-44b2-9e35-573669255237 None admin] PATH_INFO: `/v3/projects/067e263bb06c40a4a0e9fe2adf525073` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:50.495369 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b1357-38be-44b2-9e35-573669255237 None admin] RBAC: Authorizing `identity:get_project(project_id=067e263bb06c40a4a0e9fe2adf525073)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:50.496909 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b1357-38be-44b2-9e35-573669255237 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:50.499247 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 109/207] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:17:50 2022] GET /identity/v3/projects/067e263bb06c40a4a0e9fe2adf525073 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:50.507680 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c44468-0594-4c4d-83f9-cd95782a6335 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:50.661096 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c44468-0594-4c4d-83f9-cd95782a6335 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:50.712653 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28089ca3-5bf4-4300-9a59-59697644d978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:50.713695 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28089ca3-5bf4-4300-9a59-59697644d978 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:50.714177 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28089ca3-5bf4-4300-9a59-59697644d978 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:50.714680 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28089ca3-5bf4-4300-9a59-59697644d978 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:50.715705 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28089ca3-5bf4-4300-9a59-59697644d978 None admin] RBAC: Adding query filter params (role.id=86661077994d4bb6b80bab41d2f2c953, scope.project.id=067e263bb06c40a4a0e9fe2adf525073, user.id=cd74c74718004b1b838e598cd3e46de5) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:17:50.717185 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28089ca3-5bf4-4300-9a59-59697644d978 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:50.718856 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28089ca3-5bf4-4300-9a59-59697644d978 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:50.732615 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 99/208] 10.222.0.21 () {56 vars in 1374 bytes} [Mon Feb 28 10:17:50 2022] GET /identity/v3/role_assignments?user.id=cd74c74718004b1b838e598cd3e46de5&scope.project.id=067e263bb06c40a4a0e9fe2adf525073&role.id=86661077994d4bb6b80bab41d2f2c953 => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:51.573130 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a71b4-49c4-4ec4-a8e9-bc3e4ce2e4a3 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:51.574148 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a71b4-49c4-4ec4-a8e9-bc3e4ce2e4a3 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:51.574692 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a71b4-49c4-4ec4-a8e9-bc3e4ce2e4a3 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:51.577595 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 110/209] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:17:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:17:51.582734 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585d524-181c-4fd9-8d85-d3a080535a9b None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:51.583574 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585d524-181c-4fd9-8d85-d3a080535a9b None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:51.584046 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585d524-181c-4fd9-8d85-d3a080535a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:51.601314 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-d585d524-181c-4fd9-8d85-d3a080535a9b None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:17:51.602834 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-d585d524-181c-4fd9-8d85-d3a080535a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:17:51.671831 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 100/210] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:17:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:17:51.695124 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a71b4-49c4-4ec4-a8e9-bc3e4ce2e4a3 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:51.703915 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842dfed1-dc31-4151-96b4-48b185d3ad4f None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:51.704246 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842dfed1-dc31-4151-96b4-48b185d3ad4f None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:51.704470 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842dfed1-dc31-4151-96b4-48b185d3ad4f None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:51.706568 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 101/211] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:17:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:17:51.713332 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df1ed4-1429-4344-90f8-81265a5dee6f None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:51.713632 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df1ed4-1429-4344-90f8-81265a5dee6f None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:51.713883 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df1ed4-1429-4344-90f8-81265a5dee6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:51.731062 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-36df1ed4-1429-4344-90f8-81265a5dee6f None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:17:51.732311 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-36df1ed4-1429-4344-90f8-81265a5dee6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:17:51.804284 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a71b4-49c4-4ec4-a8e9-bc3e4ce2e4a3 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:51.818675 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 102/212] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:17:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:17:51.846723 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df1ed4-1429-4344-90f8-81265a5dee6f None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:51.854563 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601af8a-1224-447d-a540-a97883b937d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:51.855658 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601af8a-1224-447d-a540-a97883b937d2 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:51.856139 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601af8a-1224-447d-a540-a97883b937d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:51.856698 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601af8a-1224-447d-a540-a97883b937d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:51.867656 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601af8a-1224-447d-a540-a97883b937d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:17:51.875463 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-7601af8a-1224-447d-a540-a97883b937d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:17:51.876931 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 111/213] 10.222.0.21 () {56 vars in 1096 bytes} [Mon Feb 28 10:17:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:17:51.882731 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601af8a-1224-447d-a540-a97883b937d2 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:51.972732 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df1ed4-1429-4344-90f8-81265a5dee6f None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:52.007469 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601af8a-1224-447d-a540-a97883b937d2 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:52.017103 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab0c7b-08de-46e2-a4ae-d142a269e1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:52.018672 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab0c7b-08de-46e2-a4ae-d142a269e1ab None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:52.019471 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab0c7b-08de-46e2-a4ae-d142a269e1ab None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:52.020271 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab0c7b-08de-46e2-a4ae-d142a269e1ab None admin] PATH_INFO: `/v3/roles/member` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:52.034134 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ab0c7b-08de-46e2-a4ae-d142a269e1ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:17:52.043427 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-84ab0c7b-08de-46e2-a4ae-d142a269e1ab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 10:17:52.043668 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0158974f-8154-44c6-9076-dc36490637d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:52.044461 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158974f-8154-44c6-9076-dc36490637d6 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:52.044743 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158974f-8154-44c6-9076-dc36490637d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:52.045034 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158974f-8154-44c6-9076-dc36490637d6 None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:52.045759 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0158974f-8154-44c6-9076-dc36490637d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:17:52.046062 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0158974f-8154-44c6-9076-dc36490637d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:52.050805 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0158974f-8154-44c6-9076-dc36490637d6 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:52.050941 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 103/214] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:17:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:17:52.055495 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab0c7b-08de-46e2-a4ae-d142a269e1ab None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:52.062678 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 112/215] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:17:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:17:52.067575 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0158974f-8154-44c6-9076-dc36490637d6 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:52.159370 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab0c7b-08de-46e2-a4ae-d142a269e1ab None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:52.168795 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0158974f-8154-44c6-9076-dc36490637d6 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:52.193038 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269df54-e826-4b67-a43a-f61072b0a588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:52.193702 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269df54-e826-4b67-a43a-f61072b0a588 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:52.194034 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269df54-e826-4b67-a43a-f61072b0a588 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:52.194319 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269df54-e826-4b67-a43a-f61072b0a588 None admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:52.195092 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0269df54-e826-4b67-a43a-f61072b0a588 None admin] RBAC: Adding query filter params (name=member) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:17:52.195400 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0269df54-e826-4b67-a43a-f61072b0a588 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:52.197032 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0269df54-e826-4b67-a43a-f61072b0a588 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:52.204296 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92aee57-f44b-419a-b3b0-e4674d63e1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:52.205147 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92aee57-f44b-419a-b3b0-e4674d63e1d3 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:52.205444 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92aee57-f44b-419a-b3b0-e4674d63e1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:52.205701 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92aee57-f44b-419a-b3b0-e4674d63e1d3 None admin] PATH_INFO: `/v3/users/c41ad9db867d4be7a261befd902c0b32` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:52.206262 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 104/216] 10.222.0.21 () {56 vars in 1101 bytes} [Mon Feb 28 10:17:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:52.206926 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92aee57-f44b-419a-b3b0-e4674d63e1d3 None admin] RBAC: Authorizing `identity:get_user(user_id=c41ad9db867d4be7a261befd902c0b32)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:52.208508 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92aee57-f44b-419a-b3b0-e4674d63e1d3 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:52.211727 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f82b77-bc4f-47fc-a855-593a10289931 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:52.212020 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f82b77-bc4f-47fc-a855-593a10289931 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:52.212296 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f82b77-bc4f-47fc-a855-593a10289931 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:52.219171 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 105/217] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:17:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:17:52.219317 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 113/218] 10.222.0.21 () {56 vars in 1177 bytes} [Mon Feb 28 10:17:52 2022] GET /identity/v3/users/c41ad9db867d4be7a261befd902c0b32 => generated 283 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:52.219428 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f82b77-bc4f-47fc-a855-593a10289931 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:52.219516 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92aee57-f44b-419a-b3b0-e4674d63e1d3 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:52.319597 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f82b77-bc4f-47fc-a855-593a10289931 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:52.319796 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92aee57-f44b-419a-b3b0-e4674d63e1d3 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:52.351744 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f563cd-eb41-4509-a4fc-5271fda355d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:52.352165 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a441fe-a58e-4a9b-b4f9-f340675e33ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:52.352601 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f563cd-eb41-4509-a4fc-5271fda355d7 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:52.352881 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f563cd-eb41-4509-a4fc-5271fda355d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:52.352992 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a441fe-a58e-4a9b-b4f9-f340675e33ce None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:52.353153 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f563cd-eb41-4509-a4fc-5271fda355d7 None admin] PATH_INFO: `/v3/users/f1855ad3727f4692a794498a9ea98edd` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:52.353254 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a441fe-a58e-4a9b-b4f9-f340675e33ce None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:52.353523 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a441fe-a58e-4a9b-b4f9-f340675e33ce None admin] PATH_INFO: `/v3/projects/6ddffcb5f354434d9e960ae5d51d1a95` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:52.354708 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a441fe-a58e-4a9b-b4f9-f340675e33ce None admin] RBAC: Authorizing `identity:get_project(project_id=6ddffcb5f354434d9e960ae5d51d1a95)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:52.356146 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a441fe-a58e-4a9b-b4f9-f340675e33ce None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:52.358491 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 114/219] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:17:52 2022] GET /identity/v3/projects/6ddffcb5f354434d9e960ae5d51d1a95 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:52.361944 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1e3be-3b8f-4a3a-b97f-4cdb8a891456 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:52.361944 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1e3be-3b8f-4a3a-b97f-4cdb8a891456 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:52.361944 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1e3be-3b8f-4a3a-b97f-4cdb8a891456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:52.368127 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f563cd-eb41-4509-a4fc-5271fda355d7 None admin] RBAC: Authorizing `identity:get_user(user_id=f1855ad3727f4692a794498a9ea98edd)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:52.369582 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f563cd-eb41-4509-a4fc-5271fda355d7 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:52.371353 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 106/220] 10.222.0.21 () {56 vars in 1177 bytes} [Mon Feb 28 10:17:52 2022] GET /identity/v3/users/f1855ad3727f4692a794498a9ea98edd => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:52.372839 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f03df8-8992-4e0e-919d-5ceee811d7d7 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:52.373129 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f03df8-8992-4e0e-919d-5ceee811d7d7 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:52.373406 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f03df8-8992-4e0e-919d-5ceee811d7d7 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:52.375076 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 107/221] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:17:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:17:52.375896 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f03df8-8992-4e0e-919d-5ceee811d7d7 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:52.377993 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-6cf1e3be-3b8f-4a3a-b97f-4cdb8a891456 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:17:52.379190 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-6cf1e3be-3b8f-4a3a-b97f-4cdb8a891456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:17:52.442278 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 115/222] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:17:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:17:52.443060 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1e3be-3b8f-4a3a-b97f-4cdb8a891456 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:52.472728 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f03df8-8992-4e0e-919d-5ceee811d7d7 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:52.505101 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c273c94-3ed6-4f01-a8be-42179e263dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:52.505976 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c273c94-3ed6-4f01-a8be-42179e263dc9 None admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:52.506256 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c273c94-3ed6-4f01-a8be-42179e263dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:52.506520 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c273c94-3ed6-4f01-a8be-42179e263dc9 None admin] PATH_INFO: `/v3/projects/6ddffcb5f354434d9e960ae5d51d1a95/users/c41ad9db867d4be7a261befd902c0b32/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:52.509118 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c273c94-3ed6-4f01-a8be-42179e263dc9 None admin] RBAC: Authorizing `identity:create_grant(project_id=6ddffcb5f354434d9e960ae5d51d1a95, user_id=c41ad9db867d4be7a261befd902c0b32, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:52.509875 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c273c94-3ed6-4f01-a8be-42179e263dc9 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:52.522704 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 108/223] 10.222.0.21 () {58 vars in 1439 bytes} [Mon Feb 28 10:17:52 2022] PUT /identity/v3/projects/6ddffcb5f354434d9e960ae5d51d1a95/users/c41ad9db867d4be7a261befd902c0b32/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:17:52.523889 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f5139-e984-44db-92e0-bd87605c6d72 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:52.524180 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f5139-e984-44db-92e0-bd87605c6d72 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:52.524450 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f5139-e984-44db-92e0-bd87605c6d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:52.542182 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-e12f5139-e984-44db-92e0-bd87605c6d72 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:17:52.543521 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-e12f5139-e984-44db-92e0-bd87605c6d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:17:52.549163 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1e3be-3b8f-4a3a-b97f-4cdb8a891456 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:52.586825 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf151b75-0f8a-448b-827b-7cc0d7dcd035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:52.587533 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf151b75-0f8a-448b-827b-7cc0d7dcd035 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:52.587808 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf151b75-0f8a-448b-827b-7cc0d7dcd035 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:52.588014 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf151b75-0f8a-448b-827b-7cc0d7dcd035 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:52.616289 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 109/224] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:17:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:17:52.619136 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f5139-e984-44db-92e0-bd87605c6d72 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:52.672789 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf151b75-0f8a-448b-827b-7cc0d7dcd035 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:52.673880 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf151b75-0f8a-448b-827b-7cc0d7dcd035 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:52.721097 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f5139-e984-44db-92e0-bd87605c6d72 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:52.761044 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58847b8c-d9ec-472f-9caa-cda9a931688f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:52.762312 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58847b8c-d9ec-472f-9caa-cda9a931688f None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:52.762648 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58847b8c-d9ec-472f-9caa-cda9a931688f None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:52.763073 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58847b8c-d9ec-472f-9caa-cda9a931688f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:52.778908 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 116/225] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:17:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:17:52.778908 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf151b75-0f8a-448b-827b-7cc0d7dcd035 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:52.780215 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58847b8c-d9ec-472f-9caa-cda9a931688f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:17:52.789162 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-58847b8c-d9ec-472f-9caa-cda9a931688f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 10:17:52.791255 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 110/226] 10.222.0.21 () {56 vars in 1114 bytes} [Mon Feb 28 10:17:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:17:52.794897 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58847b8c-d9ec-472f-9caa-cda9a931688f None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:52.873343 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf151b75-0f8a-448b-827b-7cc0d7dcd035 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:52.900368 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58847b8c-d9ec-472f-9caa-cda9a931688f None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:52.905463 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319444b-e746-488a-8719-f19d37a93a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:52.906250 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319444b-e746-488a-8719-f19d37a93a3b None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:52.906527 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319444b-e746-488a-8719-f19d37a93a3b None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:52.906829 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319444b-e746-488a-8719-f19d37a93a3b None admin] PATH_INFO: `/v3/domains/default` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:52.907995 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c319444b-e746-488a-8719-f19d37a93a3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:52.909448 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c319444b-e746-488a-8719-f19d37a93a3b None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:52.915885 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 117/227] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:17:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:52.915885 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319444b-e746-488a-8719-f19d37a93a3b None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:52.938309 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59366590-7b4b-4c5b-8f92-a940c593a499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:52.939271 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59366590-7b4b-4c5b-8f92-a940c593a499 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:52.940115 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59366590-7b4b-4c5b-8f92-a940c593a499 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:52.940385 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59366590-7b4b-4c5b-8f92-a940c593a499 None admin] PATH_INFO: `/v3/projects/6ddffcb5f354434d9e960ae5d51d1a95` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:52.941608 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59366590-7b4b-4c5b-8f92-a940c593a499 None admin] RBAC: Authorizing `identity:get_project(project_id=6ddffcb5f354434d9e960ae5d51d1a95)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:52.943079 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59366590-7b4b-4c5b-8f92-a940c593a499 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:52.944785 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 111/228] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:17:52 2022] GET /identity/v3/projects/6ddffcb5f354434d9e960ae5d51d1a95 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:52.944785 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59366590-7b4b-4c5b-8f92-a940c593a499 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:53.021111 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319444b-e746-488a-8719-f19d37a93a3b None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:53.040169 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59366590-7b4b-4c5b-8f92-a940c593a499 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:53.059260 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f886c0a-e1cb-4261-8299-b6e0307dc9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:53.060950 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f886c0a-e1cb-4261-8299-b6e0307dc9cc None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:53.061261 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f886c0a-e1cb-4261-8299-b6e0307dc9cc None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:53.061793 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f886c0a-e1cb-4261-8299-b6e0307dc9cc None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:53.062535 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f886c0a-e1cb-4261-8299-b6e0307dc9cc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:17:53.063071 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f886c0a-e1cb-4261-8299-b6e0307dc9cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:53.065114 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f886c0a-e1cb-4261-8299-b6e0307dc9cc None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:53.079277 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 118/229] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:17:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:53.079277 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f886c0a-e1cb-4261-8299-b6e0307dc9cc None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:53.080799 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e2f41a-8f99-48a6-bb90-bb6610222c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:53.081474 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2f41a-8f99-48a6-bb90-bb6610222c06 None admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:53.081756 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2f41a-8f99-48a6-bb90-bb6610222c06 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:53.082028 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2f41a-8f99-48a6-bb90-bb6610222c06 None admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:53.082773 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e2f41a-8f99-48a6-bb90-bb6610222c06 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:53.084216 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e2f41a-8f99-48a6-bb90-bb6610222c06 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:53.114632 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 112/230] 10.222.0.21 () {60 vars in 1132 bytes} [Mon Feb 28 10:17:52 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:17:53.114632 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e2f41a-8f99-48a6-bb90-bb6610222c06 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:53.223941 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e2f41a-8f99-48a6-bb90-bb6610222c06 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:53.225372 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f886c0a-e1cb-4261-8299-b6e0307dc9cc None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:53.261542 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfdffe-706a-452a-9c31-33f5fae96c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:53.262559 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfdffe-706a-452a-9c31-33f5fae96c40 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:53.263096 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfdffe-706a-452a-9c31-33f5fae96c40 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:53.263376 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfdffe-706a-452a-9c31-33f5fae96c40 None admin] PATH_INFO: `/v3/users/c41ad9db867d4be7a261befd902c0b32` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:53.264818 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dfdffe-706a-452a-9c31-33f5fae96c40 None admin] RBAC: Authorizing `identity:get_user(user_id=c41ad9db867d4be7a261befd902c0b32)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:53.266377 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dfdffe-706a-452a-9c31-33f5fae96c40 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:53.268498 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 113/231] 10.222.0.21 () {56 vars in 1177 bytes} [Mon Feb 28 10:17:53 2022] GET /identity/v3/users/c41ad9db867d4be7a261befd902c0b32 => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:53.271532 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7543d-c361-41d4-bb25-b2d9094c3047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:53.272200 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7543d-c361-41d4-bb25-b2d9094c3047 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:53.272547 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7543d-c361-41d4-bb25-b2d9094c3047 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:53.273022 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7543d-c361-41d4-bb25-b2d9094c3047 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:53.273933 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7543d-c361-41d4-bb25-b2d9094c3047 None admin] RBAC: Adding query filter params (role.id=1c79fcc5aeef4042aa382ec20f77f7b9, scope.project.id=6ddffcb5f354434d9e960ae5d51d1a95, user.id=f1855ad3727f4692a794498a9ea98edd) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:17:53.274034 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfdffe-706a-452a-9c31-33f5fae96c40 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:53.274351 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7543d-c361-41d4-bb25-b2d9094c3047 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:53.276033 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7543d-c361-41d4-bb25-b2d9094c3047 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:53.290306 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 119/232] 10.222.0.21 () {56 vars in 1374 bytes} [Mon Feb 28 10:17:53 2022] GET /identity/v3/role_assignments?user.id=f1855ad3727f4692a794498a9ea98edd&scope.project.id=6ddffcb5f354434d9e960ae5d51d1a95&role.id=1c79fcc5aeef4042aa382ec20f77f7b9 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:53.394007 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfdffe-706a-452a-9c31-33f5fae96c40 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:53.431113 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f7241-a0e1-4b71-84ea-6f84aa3780ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:53.432042 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f7241-a0e1-4b71-84ea-6f84aa3780ae None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:53.432318 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f7241-a0e1-4b71-84ea-6f84aa3780ae None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:53.432640 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f7241-a0e1-4b71-84ea-6f84aa3780ae None admin] PATH_INFO: `/v3/projects/6ddffcb5f354434d9e960ae5d51d1a95` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:53.434097 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6f7241-a0e1-4b71-84ea-6f84aa3780ae None admin] RBAC: Authorizing `identity:get_project(project_id=6ddffcb5f354434d9e960ae5d51d1a95)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:53.436002 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6f7241-a0e1-4b71-84ea-6f84aa3780ae None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:53.437819 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 114/233] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:17:53 2022] GET /identity/v3/projects/6ddffcb5f354434d9e960ae5d51d1a95 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:17:53.443892 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7543d-c361-41d4-bb25-b2d9094c3047 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:53.570147 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7543d-c361-41d4-bb25-b2d9094c3047 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:53.605592 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91359e-b59a-402e-96e7-88636dc1183b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:53.607432 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91359e-b59a-402e-96e7-88636dc1183b None admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:53.607946 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91359e-b59a-402e-96e7-88636dc1183b None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:53.608205 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91359e-b59a-402e-96e7-88636dc1183b None admin] PATH_INFO: `/v3/projects/6ddffcb5f354434d9e960ae5d51d1a95/users/c41ad9db867d4be7a261befd902c0b32/roles/101ea48f12324cee9b597825e21f34b4` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:53.610446 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b91359e-b59a-402e-96e7-88636dc1183b None admin] RBAC: Authorizing `identity:create_grant(project_id=6ddffcb5f354434d9e960ae5d51d1a95, user_id=c41ad9db867d4be7a261befd902c0b32, role_id=101ea48f12324cee9b597825e21f34b4)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:53.611903 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b91359e-b59a-402e-96e7-88636dc1183b None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:53.629290 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 120/234] 10.222.0.21 () {58 vars in 1439 bytes} [Mon Feb 28 10:17:53 2022] PUT /identity/v3/projects/6ddffcb5f354434d9e960ae5d51d1a95/users/c41ad9db867d4be7a261befd902c0b32/roles/101ea48f12324cee9b597825e21f34b4 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:17:55.189540 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f367c-65cb-4ca9-905c-68eafa9bc91c None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:55.190061 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f367c-65cb-4ca9-905c-68eafa9bc91c None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:55.190061 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f367c-65cb-4ca9-905c-68eafa9bc91c None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:55.192114 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 115/235] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:17:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:17:55.208309 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad77e96-6928-4bbc-b690-ae0a46d64122 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:55.208798 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad77e96-6928-4bbc-b690-ae0a46d64122 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:55.208898 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad77e96-6928-4bbc-b690-ae0a46d64122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:55.235583 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-cad77e96-6928-4bbc-b690-ae0a46d64122 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:17:55.236787 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-cad77e96-6928-4bbc-b690-ae0a46d64122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:17:55.319296 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 121/236] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:17:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:17:55.355323 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f367c-65cb-4ca9-905c-68eafa9bc91c None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:55.480373 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f367c-65cb-4ca9-905c-68eafa9bc91c None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:55.523483 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1011780a-d357-4e20-a03d-b35ee81de864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:55.524285 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011780a-d357-4e20-a03d-b35ee81de864 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:55.524686 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011780a-d357-4e20-a03d-b35ee81de864 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:55.524967 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011780a-d357-4e20-a03d-b35ee81de864 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:55.541046 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1011780a-d357-4e20-a03d-b35ee81de864 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:17:55.547996 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-1011780a-d357-4e20-a03d-b35ee81de864 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:17:55.549451 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 116/237] 10.222.0.21 () {56 vars in 1096 bytes} [Mon Feb 28 10:17:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:17:55.555119 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad77e96-6928-4bbc-b690-ae0a46d64122 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:55.713968 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad77e96-6928-4bbc-b690-ae0a46d64122 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:55.758050 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838d192-8160-41ff-9a13-bee7dd5af113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:55.759102 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838d192-8160-41ff-9a13-bee7dd5af113 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:55.759584 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838d192-8160-41ff-9a13-bee7dd5af113 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:55.760046 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838d192-8160-41ff-9a13-bee7dd5af113 None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:55.760979 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b838d192-8160-41ff-9a13-bee7dd5af113 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:17:55.761493 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b838d192-8160-41ff-9a13-bee7dd5af113 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:55.763375 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b838d192-8160-41ff-9a13-bee7dd5af113 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:55.780745 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 122/238] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:17:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:55.786143 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1011780a-d357-4e20-a03d-b35ee81de864 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:55.956572 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1011780a-d357-4e20-a03d-b35ee81de864 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:56.009530 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646859d-150d-4297-8f08-208c128f763a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:56.010349 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646859d-150d-4297-8f08-208c128f763a None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:56.010655 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646859d-150d-4297-8f08-208c128f763a None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:56.010934 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646859d-150d-4297-8f08-208c128f763a None admin] PATH_INFO: `/v3/users/c41ad9db867d4be7a261befd902c0b32` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:56.012229 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7646859d-150d-4297-8f08-208c128f763a None admin] RBAC: Authorizing `identity:get_user(user_id=c41ad9db867d4be7a261befd902c0b32)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:56.014518 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7646859d-150d-4297-8f08-208c128f763a None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:56.016641 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 117/239] 10.222.0.21 () {56 vars in 1177 bytes} [Mon Feb 28 10:17:55 2022] GET /identity/v3/users/c41ad9db867d4be7a261befd902c0b32 => generated 283 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:56.022358 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838d192-8160-41ff-9a13-bee7dd5af113 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:56.126393 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a6540-4e74-45cd-9f29-103949b7b30d None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:56.126759 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a6540-4e74-45cd-9f29-103949b7b30d None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:56.126983 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a6540-4e74-45cd-9f29-103949b7b30d None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:56.128930 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 118/240] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:17:56.156528 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1cdbf4-48ea-42de-b3cb-efad298f5726 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:56.156823 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1cdbf4-48ea-42de-b3cb-efad298f5726 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:56.157100 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1cdbf4-48ea-42de-b3cb-efad298f5726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:56.160784 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838d192-8160-41ff-9a13-bee7dd5af113 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:56.192503 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-5c1cdbf4-48ea-42de-b3cb-efad298f5726 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:17:56.193683 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-5c1cdbf4-48ea-42de-b3cb-efad298f5726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:17:56.199307 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687396c-14a8-4362-b650-ae8ecf82a009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:56.199955 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687396c-14a8-4362-b650-ae8ecf82a009 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:56.200295 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687396c-14a8-4362-b650-ae8ecf82a009 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:56.200573 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687396c-14a8-4362-b650-ae8ecf82a009 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:56.263543 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 119/241] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:17:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:17:56.264790 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e41a5-ab58-43f5-83de-c3e102f2acf4 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:56.265073 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e41a5-ab58-43f5-83de-c3e102f2acf4 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:56.265343 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e41a5-ab58-43f5-83de-c3e102f2acf4 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:56.267043 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 120/242] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:17:56.268754 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687396c-14a8-4362-b650-ae8ecf82a009 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:56.270230 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687396c-14a8-4362-b650-ae8ecf82a009 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:56.272212 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2dcec0-ec0c-4002-b6ab-817ce61313d4 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:56.272589 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2dcec0-ec0c-4002-b6ab-817ce61313d4 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:56.272955 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2dcec0-ec0c-4002-b6ab-817ce61313d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:56.289679 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-ce2dcec0-ec0c-4002-b6ab-817ce61313d4 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:17:56.291024 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-ce2dcec0-ec0c-4002-b6ab-817ce61313d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:17:56.357875 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 121/243] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:17:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:17:56.365980 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2dcec0-ec0c-4002-b6ab-817ce61313d4 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:56.370021 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 123/244] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:17:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:17:56.376310 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687396c-14a8-4362-b650-ae8ecf82a009 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:56.474334 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687396c-14a8-4362-b650-ae8ecf82a009 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:56.482920 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2dcec0-ec0c-4002-b6ab-817ce61313d4 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:56.507080 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e78274-8639-451c-b944-d227ca837bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:56.507924 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e78274-8639-451c-b944-d227ca837bba None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:56.508204 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e78274-8639-451c-b944-d227ca837bba None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:56.508490 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e78274-8639-451c-b944-d227ca837bba None admin] PATH_INFO: `/v3/projects/6ddffcb5f354434d9e960ae5d51d1a95` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:56.509650 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e78274-8639-451c-b944-d227ca837bba None admin] RBAC: Authorizing `identity:get_project(project_id=6ddffcb5f354434d9e960ae5d51d1a95)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:56.511146 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e78274-8639-451c-b944-d227ca837bba None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:56.518229 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 124/245] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:17:56 2022] GET /identity/v3/projects/6ddffcb5f354434d9e960ae5d51d1a95 => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:17:56.518229 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e78274-8639-451c-b944-d227ca837bba None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:56.521718 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af8a7c-0fb7-41f6-8bad-cb6304317a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:56.522617 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af8a7c-0fb7-41f6-8bad-cb6304317a63 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:56.522897 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af8a7c-0fb7-41f6-8bad-cb6304317a63 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:56.523413 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af8a7c-0fb7-41f6-8bad-cb6304317a63 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:56.534143 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af8a7c-0fb7-41f6-8bad-cb6304317a63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:17:56.540940 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-03af8a7c-0fb7-41f6-8bad-cb6304317a63 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 28 10:17:56.542112 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 122/246] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:17:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:17:56.543313 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637592c0-a26c-4c1a-9ffc-68fbd03022c0 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:56.543590 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637592c0-a26c-4c1a-9ffc-68fbd03022c0 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:56.544444 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637592c0-a26c-4c1a-9ffc-68fbd03022c0 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:56.546170 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 123/247] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:17:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:17:56.546936 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637592c0-a26c-4c1a-9ffc-68fbd03022c0 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:56.619258 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e78274-8639-451c-b944-d227ca837bba None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:56.642836 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637592c0-a26c-4c1a-9ffc-68fbd03022c0 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:56.652420 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2840480-1b29-48a7-86ff-8a454b0a9b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:56.653492 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2840480-1b29-48a7-86ff-8a454b0a9b48 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:56.653789 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2840480-1b29-48a7-86ff-8a454b0a9b48 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:56.654070 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2840480-1b29-48a7-86ff-8a454b0a9b48 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:56.663868 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2840480-1b29-48a7-86ff-8a454b0a9b48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:17:56.671280 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-f2840480-1b29-48a7-86ff-8a454b0a9b48 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 10:17:56.672460 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 125/248] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:17:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:17:56.673654 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fc607-c278-4d20-ac53-d0579f7a556a None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:56.673929 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fc607-c278-4d20-ac53-d0579f7a556a None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:56.674206 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fc607-c278-4d20-ac53-d0579f7a556a None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:56.675022 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ab1ad-9600-475f-97f0-301e1e99736d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:56.675661 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ab1ad-9600-475f-97f0-301e1e99736d None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:56.675897 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 126/249] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:17:56.675989 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ab1ad-9600-475f-97f0-301e1e99736d None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:56.676190 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ab1ad-9600-475f-97f0-301e1e99736d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:56.676590 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8fc607-c278-4d20-ac53-d0579f7a556a None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:56.678434 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ab1ad-9600-475f-97f0-301e1e99736d None admin] RBAC: Adding query filter params (role.id=48e4608a7b3f4b87a20b10c4d1b45aa9, scope.project.id=6ddffcb5f354434d9e960ae5d51d1a95, user.id=c41ad9db867d4be7a261befd902c0b32) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:17:56.678434 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ab1ad-9600-475f-97f0-301e1e99736d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:56.678751 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ab1ad-9600-475f-97f0-301e1e99736d None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:56.685309 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 124/250] 10.222.0.21 () {56 vars in 1374 bytes} [Mon Feb 28 10:17:56 2022] GET /identity/v3/role_assignments?user.id=c41ad9db867d4be7a261befd902c0b32&scope.project.id=6ddffcb5f354434d9e960ae5d51d1a95&role.id=48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:56.686804 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9cd32-9d11-4fd6-abd3-4fb756cdbf18 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:56.687088 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9cd32-9d11-4fd6-abd3-4fb756cdbf18 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:56.687358 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9cd32-9d11-4fd6-abd3-4fb756cdbf18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:56.718860 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-4ae9cd32-9d11-4fd6-abd3-4fb756cdbf18 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:17:56.720088 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-4ae9cd32-9d11-4fd6-abd3-4fb756cdbf18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:17:56.789652 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8fc607-c278-4d20-ac53-d0579f7a556a None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:56.790993 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 125/251] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:17:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:17:56.791684 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9cd32-9d11-4fd6-abd3-4fb756cdbf18 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:56.838854 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c5d07-916f-40c9-803c-8d0b94da857d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:56.839987 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c5d07-916f-40c9-803c-8d0b94da857d None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:56.840359 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c5d07-916f-40c9-803c-8d0b94da857d None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:56.840718 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c5d07-916f-40c9-803c-8d0b94da857d None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:56.842152 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057c5d07-916f-40c9-803c-8d0b94da857d None admin] RBAC: Adding query filter params (name=reader) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:17:56.842455 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057c5d07-916f-40c9-803c-8d0b94da857d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:56.843966 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057c5d07-916f-40c9-803c-8d0b94da857d None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:56.860191 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 127/252] 10.222.0.21 () {56 vars in 1101 bytes} [Mon Feb 28 10:17:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:56.860191 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d50398-b049-48bf-87bf-d4e243d4fa63 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:56.860191 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d50398-b049-48bf-87bf-d4e243d4fa63 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:56.860191 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d50398-b049-48bf-87bf-d4e243d4fa63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:56.875302 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-a8d50398-b049-48bf-87bf-d4e243d4fa63 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:17:56.876511 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-a8d50398-b049-48bf-87bf-d4e243d4fa63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:17:56.908458 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9cd32-9d11-4fd6-abd3-4fb756cdbf18 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:56.946996 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a0496-c23e-4e66-9e3f-7d39770d0334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:56.947666 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a0496-c23e-4e66-9e3f-7d39770d0334 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:56.947950 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a0496-c23e-4e66-9e3f-7d39770d0334 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:56.948225 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a0496-c23e-4e66-9e3f-7d39770d0334 None admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:56.948966 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926a0496-c23e-4e66-9e3f-7d39770d0334 None admin] RBAC: Adding query filter params (name=member) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:17:56.949275 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926a0496-c23e-4e66-9e3f-7d39770d0334 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:56.950950 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926a0496-c23e-4e66-9e3f-7d39770d0334 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:56.952812 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 128/253] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:17:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:17:56.953731 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d50398-b049-48bf-87bf-d4e243d4fa63 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:56.963771 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 126/254] 10.222.0.21 () {56 vars in 1101 bytes} [Mon Feb 28 10:17:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:56.963771 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a0496-c23e-4e66-9e3f-7d39770d0334 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:57.051279 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d50398-b049-48bf-87bf-d4e243d4fa63 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:57.056843 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a0496-c23e-4e66-9e3f-7d39770d0334 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:57.082769 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93f398-8d1b-4f86-b81c-60fdbcd1fa79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:57.083545 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93f398-8d1b-4f86-b81c-60fdbcd1fa79 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:57.083821 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93f398-8d1b-4f86-b81c-60fdbcd1fa79 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:57.084097 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93f398-8d1b-4f86-b81c-60fdbcd1fa79 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:57.085235 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad93f398-8d1b-4f86-b81c-60fdbcd1fa79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:57.086705 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad93f398-8d1b-4f86-b81c-60fdbcd1fa79 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:57.087934 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cea247-aa53-4ad3-a4b3-d50d52e93e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:57.088292 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 129/255] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:17:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:57.089114 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93f398-8d1b-4f86-b81c-60fdbcd1fa79 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:57.091844 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cea247-aa53-4ad3-a4b3-d50d52e93e79 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:57.092130 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cea247-aa53-4ad3-a4b3-d50d52e93e79 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:57.092407 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cea247-aa53-4ad3-a4b3-d50d52e93e79 None admin] PATH_INFO: `/v3/users/a0fc05ef0ac942aa9707fbf4e0cddab7` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:57.105284 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cea247-aa53-4ad3-a4b3-d50d52e93e79 None admin] RBAC: Authorizing `identity:get_user(user_id=a0fc05ef0ac942aa9707fbf4e0cddab7)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:57.107768 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cea247-aa53-4ad3-a4b3-d50d52e93e79 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:57.109425 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 127/256] 10.222.0.21 () {56 vars in 1177 bytes} [Mon Feb 28 10:17:56 2022] GET /identity/v3/users/a0fc05ef0ac942aa9707fbf4e0cddab7 => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:57.110174 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cea247-aa53-4ad3-a4b3-d50d52e93e79 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:57.186057 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93f398-8d1b-4f86-b81c-60fdbcd1fa79 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:57.201995 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cea247-aa53-4ad3-a4b3-d50d52e93e79 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:57.218036 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f788dc-169d-4f97-b7ef-2330b75de460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:57.218986 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f788dc-169d-4f97-b7ef-2330b75de460 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:57.219259 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f788dc-169d-4f97-b7ef-2330b75de460 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:57.219523 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f788dc-169d-4f97-b7ef-2330b75de460 None admin] PATH_INFO: `/v3/users/f1855ad3727f4692a794498a9ea98edd` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:57.220692 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f788dc-169d-4f97-b7ef-2330b75de460 None admin] RBAC: Authorizing `identity:get_user(user_id=f1855ad3727f4692a794498a9ea98edd)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:57.222155 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f788dc-169d-4f97-b7ef-2330b75de460 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:57.223788 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 130/257] 10.222.0.21 () {56 vars in 1177 bytes} [Mon Feb 28 10:17:57 2022] GET /identity/v3/users/f1855ad3727f4692a794498a9ea98edd => generated 297 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:57.224504 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f788dc-169d-4f97-b7ef-2330b75de460 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:57.236023 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ab613-eb5c-420b-8baa-1d3ed6b6e677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:57.236815 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ab613-eb5c-420b-8baa-1d3ed6b6e677 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:57.237092 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ab613-eb5c-420b-8baa-1d3ed6b6e677 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:57.237364 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ab613-eb5c-420b-8baa-1d3ed6b6e677 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:57.247772 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529ab613-eb5c-420b-8baa-1d3ed6b6e677 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:17:57.254837 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-529ab613-eb5c-420b-8baa-1d3ed6b6e677 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 10:17:57.256008 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 128/258] 10.222.0.21 () {56 vars in 1114 bytes} [Mon Feb 28 10:17:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:17:57.256755 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ab613-eb5c-420b-8baa-1d3ed6b6e677 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:57.316925 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f788dc-169d-4f97-b7ef-2330b75de460 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:57.349669 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df31c67-a4cc-4f88-8f2c-629910761e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:57.350321 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df31c67-a4cc-4f88-8f2c-629910761e10 None admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:57.350625 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df31c67-a4cc-4f88-8f2c-629910761e10 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:57.350897 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df31c67-a4cc-4f88-8f2c-629910761e10 None admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:57.351594 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df31c67-a4cc-4f88-8f2c-629910761e10 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:57.353012 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df31c67-a4cc-4f88-8f2c-629910761e10 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:57.353672 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ab613-eb5c-420b-8baa-1d3ed6b6e677 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:57.386629 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 131/259] 10.222.0.21 () {60 vars in 1132 bytes} [Mon Feb 28 10:17:57 2022] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:17:57.386629 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df31c67-a4cc-4f88-8f2c-629910761e10 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:57.387228 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba7d5a-0c7e-47ab-8f4d-43e953f1b031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:57.388449 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba7d5a-0c7e-47ab-8f4d-43e953f1b031 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:57.388775 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba7d5a-0c7e-47ab-8f4d-43e953f1b031 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:57.389040 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba7d5a-0c7e-47ab-8f4d-43e953f1b031 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:57.463756 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba7d5a-0c7e-47ab-8f4d-43e953f1b031 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:57.465252 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba7d5a-0c7e-47ab-8f4d-43e953f1b031 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:57.501793 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df31c67-a4cc-4f88-8f2c-629910761e10 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:57.537519 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a209f-c6d1-45c8-a6c7-08dabb4d9d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:57.538376 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a209f-c6d1-45c8-a6c7-08dabb4d9d43 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:57.538678 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a209f-c6d1-45c8-a6c7-08dabb4d9d43 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:57.538952 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a209f-c6d1-45c8-a6c7-08dabb4d9d43 None admin] PATH_INFO: `/v3/projects/6ddffcb5f354434d9e960ae5d51d1a95` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:57.540184 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a209f-c6d1-45c8-a6c7-08dabb4d9d43 None admin] RBAC: Authorizing `identity:get_project(project_id=6ddffcb5f354434d9e960ae5d51d1a95)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:57.541649 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a209f-c6d1-45c8-a6c7-08dabb4d9d43 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:57.543576 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 132/260] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:17:57 2022] GET /identity/v3/projects/6ddffcb5f354434d9e960ae5d51d1a95 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:57.544947 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a209f-c6d1-45c8-a6c7-08dabb4d9d43 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:57.573178 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 129/261] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:17:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:17:57.573925 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba7d5a-0c7e-47ab-8f4d-43e953f1b031 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:57.652655 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a209f-c6d1-45c8-a6c7-08dabb4d9d43 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:57.694683 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba7d5a-0c7e-47ab-8f4d-43e953f1b031 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:57.695979 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e6eff-6d65-457e-ad7f-383de3c597bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:57.696644 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e6eff-6d65-457e-ad7f-383de3c597bd None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:57.696924 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e6eff-6d65-457e-ad7f-383de3c597bd None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:57.697205 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e6eff-6d65-457e-ad7f-383de3c597bd None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:57.697952 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e6eff-6d65-457e-ad7f-383de3c597bd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:17:57.698281 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e6eff-6d65-457e-ad7f-383de3c597bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:57.699768 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e6eff-6d65-457e-ad7f-383de3c597bd None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:57.709008 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 133/262] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:17:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:57.710640 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e6eff-6d65-457e-ad7f-383de3c597bd None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:57.741468 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915dc1df-3489-42b2-9be6-757f776557fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:57.743195 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915dc1df-3489-42b2-9be6-757f776557fa None admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:57.743925 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915dc1df-3489-42b2-9be6-757f776557fa None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:57.744426 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915dc1df-3489-42b2-9be6-757f776557fa None admin] PATH_INFO: `/v3/projects/6ddffcb5f354434d9e960ae5d51d1a95/users/f1855ad3727f4692a794498a9ea98edd/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:57.748060 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915dc1df-3489-42b2-9be6-757f776557fa None admin] RBAC: Authorizing `identity:create_grant(project_id=6ddffcb5f354434d9e960ae5d51d1a95, user_id=f1855ad3727f4692a794498a9ea98edd, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:57.750786 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915dc1df-3489-42b2-9be6-757f776557fa None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:57.768394 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 130/263] 10.222.0.21 () {58 vars in 1439 bytes} [Mon Feb 28 10:17:57 2022] PUT /identity/v3/projects/6ddffcb5f354434d9e960ae5d51d1a95/users/f1855ad3727f4692a794498a9ea98edd/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:17:57.769710 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915dc1df-3489-42b2-9be6-757f776557fa None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:57.837545 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e6eff-6d65-457e-ad7f-383de3c597bd None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:57.886526 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915dc1df-3489-42b2-9be6-757f776557fa None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:57.900125 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc65b6f2-db62-41e4-ac95-535b10979215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:57.901004 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65b6f2-db62-41e4-ac95-535b10979215 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:57.901284 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65b6f2-db62-41e4-ac95-535b10979215 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:57.901559 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65b6f2-db62-41e4-ac95-535b10979215 None admin] PATH_INFO: `/v3/projects/6ddffcb5f354434d9e960ae5d51d1a95` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:57.907508 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc65b6f2-db62-41e4-ac95-535b10979215 None admin] RBAC: Authorizing `identity:get_project(project_id=6ddffcb5f354434d9e960ae5d51d1a95)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:57.909050 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc65b6f2-db62-41e4-ac95-535b10979215 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:57.911145 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 134/264] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:17:57 2022] GET /identity/v3/projects/6ddffcb5f354434d9e960ae5d51d1a95 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:57.918526 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc65b6f2-db62-41e4-ac95-535b10979215 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:57.946432 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77d481-e504-4a92-b858-791910606ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:57.948323 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77d481-e504-4a92-b858-791910606ce8 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:57.948599 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77d481-e504-4a92-b858-791910606ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:57.948873 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77d481-e504-4a92-b858-791910606ce8 None admin] PATH_INFO: `/v3/users/c41ad9db867d4be7a261befd902c0b32` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:57.950618 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f77d481-e504-4a92-b858-791910606ce8 None admin] RBAC: Authorizing `identity:get_user(user_id=c41ad9db867d4be7a261befd902c0b32)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:57.956996 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f77d481-e504-4a92-b858-791910606ce8 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:57.959006 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 131/265] 10.222.0.21 () {56 vars in 1177 bytes} [Mon Feb 28 10:17:57 2022] GET /identity/v3/users/c41ad9db867d4be7a261befd902c0b32 => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:57.964304 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77d481-e504-4a92-b858-791910606ce8 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:58.073826 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc65b6f2-db62-41e4-ac95-535b10979215 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:58.109002 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77d481-e504-4a92-b858-791910606ce8 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:58.109583 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0feca1a-4e6c-439c-aac1-706540c2680b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:58.110455 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0feca1a-4e6c-439c-aac1-706540c2680b None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:58.110986 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0feca1a-4e6c-439c-aac1-706540c2680b None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:58.111480 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0feca1a-4e6c-439c-aac1-706540c2680b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:58.118523 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0feca1a-4e6c-439c-aac1-706540c2680b None admin] RBAC: Adding query filter params (role.id=86661077994d4bb6b80bab41d2f2c953, scope.project.id=6ddffcb5f354434d9e960ae5d51d1a95, user.id=a0fc05ef0ac942aa9707fbf4e0cddab7) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:17:58.119257 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0feca1a-4e6c-439c-aac1-706540c2680b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:58.121271 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0feca1a-4e6c-439c-aac1-706540c2680b None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:58.127843 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 135/266] 10.222.0.21 () {56 vars in 1374 bytes} [Mon Feb 28 10:17:57 2022] GET /identity/v3/role_assignments?user.id=a0fc05ef0ac942aa9707fbf4e0cddab7&scope.project.id=6ddffcb5f354434d9e960ae5d51d1a95&role.id=86661077994d4bb6b80bab41d2f2c953 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:17:58.143594 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d68c73-4537-414a-ad12-1f46ec309858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:58.144250 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d68c73-4537-414a-ad12-1f46ec309858 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:58.144528 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d68c73-4537-414a-ad12-1f46ec309858 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:58.144800 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d68c73-4537-414a-ad12-1f46ec309858 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:58.216605 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d68c73-4537-414a-ad12-1f46ec309858 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:58.218071 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d68c73-4537-414a-ad12-1f46ec309858 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:58.321550 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 132/267] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:17:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:17:58.326887 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0feca1a-4e6c-439c-aac1-706540c2680b None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:58.450465 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0feca1a-4e6c-439c-aac1-706540c2680b None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:58.485003 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7516a74-3161-47c9-8011-4bee8afc6685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:58.486118 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7516a74-3161-47c9-8011-4bee8afc6685 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:58.486550 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7516a74-3161-47c9-8011-4bee8afc6685 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:58.486996 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7516a74-3161-47c9-8011-4bee8afc6685 None admin] PATH_INFO: `/v3/projects/6ddffcb5f354434d9e960ae5d51d1a95` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:58.488346 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7516a74-3161-47c9-8011-4bee8afc6685 None admin] RBAC: Authorizing `identity:get_project(project_id=6ddffcb5f354434d9e960ae5d51d1a95)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:58.490013 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7516a74-3161-47c9-8011-4bee8afc6685 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:58.492220 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 136/268] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:17:58 2022] GET /identity/v3/projects/6ddffcb5f354434d9e960ae5d51d1a95 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:17:58.498393 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d68c73-4537-414a-ad12-1f46ec309858 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:17:58.643773 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d68c73-4537-414a-ad12-1f46ec309858 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:17:58.701284 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b688382-c1b5-4c17-bd23-1eb8700fdf36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:17:58.701854 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b688382-c1b5-4c17-bd23-1eb8700fdf36 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:17:58.702137 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b688382-c1b5-4c17-bd23-1eb8700fdf36 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:17:58.702386 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b688382-c1b5-4c17-bd23-1eb8700fdf36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:17:58.703244 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b688382-c1b5-4c17-bd23-1eb8700fdf36 None admin] RBAC: Adding query filter params (role.id=101ea48f12324cee9b597825e21f34b4, scope.project.id=6ddffcb5f354434d9e960ae5d51d1a95, user.id=c41ad9db867d4be7a261befd902c0b32) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:17:58.703551 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b688382-c1b5-4c17-bd23-1eb8700fdf36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:17:58.704979 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b688382-c1b5-4c17-bd23-1eb8700fdf36 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:17:58.715355 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 133/269] 10.222.0.21 () {56 vars in 1374 bytes} [Mon Feb 28 10:17:58 2022] GET /identity/v3/role_assignments?user.id=c41ad9db867d4be7a261befd902c0b32&scope.project.id=6ddffcb5f354434d9e960ae5d51d1a95&role.id=101ea48f12324cee9b597825e21f34b4 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:00.032322 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ac071-e847-463b-b775-50557a97b052 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:00.033217 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ac071-e847-463b-b775-50557a97b052 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:00.033632 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ac071-e847-463b-b775-50557a97b052 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:00.035799 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 137/270] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:18:00.041328 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6449e-6c74-412a-a4f1-45031a6d1e3c None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:00.042168 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6449e-6c74-412a-a4f1-45031a6d1e3c None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:00.042680 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6449e-6c74-412a-a4f1-45031a6d1e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:00.060508 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-ece6449e-6c74-412a-a4f1-45031a6d1e3c None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:00.062013 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-ece6449e-6c74-412a-a4f1-45031a6d1e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:00.129400 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 134/271] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:18:00.154086 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ac071-e847-463b-b775-50557a97b052 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:00.198292 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202dea4e-f4d2-481a-b333-2a432d4fd4a7 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:00.198942 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202dea4e-f4d2-481a-b333-2a432d4fd4a7 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:00.199413 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202dea4e-f4d2-481a-b333-2a432d4fd4a7 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:00.201607 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 135/272] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:18:00.207613 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb715be-1d6c-4038-927f-e4528c2da9c1 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:00.208122 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb715be-1d6c-4038-927f-e4528c2da9c1 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:00.208589 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb715be-1d6c-4038-927f-e4528c2da9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:00.226112 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-7bb715be-1d6c-4038-927f-e4528c2da9c1 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:00.227635 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-7bb715be-1d6c-4038-927f-e4528c2da9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:00.264075 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ac071-e847-463b-b775-50557a97b052 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:00.296321 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 136/273] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:18:00.304129 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb43e141-159b-4429-8be2-709773bcbae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:00.305135 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43e141-159b-4429-8be2-709773bcbae4 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:00.305606 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43e141-159b-4429-8be2-709773bcbae4 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:00.306088 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43e141-159b-4429-8be2-709773bcbae4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:00.316617 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb43e141-159b-4429-8be2-709773bcbae4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:18:00.323121 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb715be-1d6c-4038-927f-e4528c2da9c1 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:00.324321 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-fb43e141-159b-4429-8be2-709773bcbae4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 10:18:00.327783 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 138/274] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:18:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:00.333701 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb43e141-159b-4429-8be2-709773bcbae4 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:00.449817 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb715be-1d6c-4038-927f-e4528c2da9c1 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:00.458436 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb43e141-159b-4429-8be2-709773bcbae4 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:00.490369 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203863ea-d5d6-4e6f-af35-928a1d15fbaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:00.491574 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203863ea-d5d6-4e6f-af35-928a1d15fbaf None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:00.491927 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203863ea-d5d6-4e6f-af35-928a1d15fbaf None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:00.492210 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203863ea-d5d6-4e6f-af35-928a1d15fbaf None admin] PATH_INFO: `/v3/domains/default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:00.493567 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203863ea-d5d6-4e6f-af35-928a1d15fbaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:00.495495 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203863ea-d5d6-4e6f-af35-928a1d15fbaf None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:00.497453 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 137/275] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:18:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:18:00.500522 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f707d3f-5b23-44ae-b846-6fbe32678c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:00.501427 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f707d3f-5b23-44ae-b846-6fbe32678c01 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:00.502199 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f707d3f-5b23-44ae-b846-6fbe32678c01 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:00.502699 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f707d3f-5b23-44ae-b846-6fbe32678c01 None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:00.503015 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203863ea-d5d6-4e6f-af35-928a1d15fbaf None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:00.503855 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f707d3f-5b23-44ae-b846-6fbe32678c01 None admin] RBAC: Adding query filter params (name=member) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:00.504351 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f707d3f-5b23-44ae-b846-6fbe32678c01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:00.506128 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f707d3f-5b23-44ae-b846-6fbe32678c01 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:00.525659 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 139/276] 10.222.0.21 () {56 vars in 1101 bytes} [Mon Feb 28 10:18:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:18:00.526362 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f707d3f-5b23-44ae-b846-6fbe32678c01 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:00.613112 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203863ea-d5d6-4e6f-af35-928a1d15fbaf None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:00.626489 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f707d3f-5b23-44ae-b846-6fbe32678c01 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:00.647209 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f77e36-7da8-4d31-978f-ef0ca86c472f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:00.647895 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f77e36-7da8-4d31-978f-ef0ca86c472f None admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:00.648173 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f77e36-7da8-4d31-978f-ef0ca86c472f None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:00.648443 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f77e36-7da8-4d31-978f-ef0ca86c472f None admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:00.649140 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f77e36-7da8-4d31-978f-ef0ca86c472f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:00.650568 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f77e36-7da8-4d31-978f-ef0ca86c472f None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:00.660929 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a20b6-12ed-4c0e-b6b9-ce81afe4d1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:00.661781 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a20b6-12ed-4c0e-b6b9-ce81afe4d1e6 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:00.661974 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a20b6-12ed-4c0e-b6b9-ce81afe4d1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:00.662229 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a20b6-12ed-4c0e-b6b9-ce81afe4d1e6 None admin] PATH_INFO: `/v3/users/fdafeb37201a4426abd5a83a67dfcb28` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:00.671272 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 138/277] 10.222.0.21 () {60 vars in 1132 bytes} [Mon Feb 28 10:18:00 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:18:00.672937 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b13520-dd6c-4aa7-84cf-7f449eebebea None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:00.673412 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b13520-dd6c-4aa7-84cf-7f449eebebea None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:00.673687 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b13520-dd6c-4aa7-84cf-7f449eebebea None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:00.675903 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 139/278] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:18:00.682305 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea048fa-becf-4098-b58b-e7b1cd1c0d26 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:00.682773 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea048fa-becf-4098-b58b-e7b1cd1c0d26 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:00.683120 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea048fa-becf-4098-b58b-e7b1cd1c0d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:00.686501 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a20b6-12ed-4c0e-b6b9-ce81afe4d1e6 None admin] RBAC: Authorizing `identity:get_user(user_id=fdafeb37201a4426abd5a83a67dfcb28)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:00.688535 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a20b6-12ed-4c0e-b6b9-ce81afe4d1e6 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:00.690801 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 140/279] 10.222.0.21 () {56 vars in 1177 bytes} [Mon Feb 28 10:18:00 2022] GET /identity/v3/users/fdafeb37201a4426abd5a83a67dfcb28 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:18:00.699640 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a20b6-12ed-4c0e-b6b9-ce81afe4d1e6 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:00.713359 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-9ea048fa-becf-4098-b58b-e7b1cd1c0d26 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:00.715040 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-9ea048fa-becf-4098-b58b-e7b1cd1c0d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:00.787649 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 140/280] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:18:00.796818 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e1df0-6b49-475f-bc6d-2066938fe2f0 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:00.797136 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e1df0-6b49-475f-bc6d-2066938fe2f0 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:00.797418 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e1df0-6b49-475f-bc6d-2066938fe2f0 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:00.799902 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 141/281] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:18:00.805684 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bfcabb-2c93-4219-9fe8-d8874de5fe37 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:00.805965 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bfcabb-2c93-4219-9fe8-d8874de5fe37 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:00.806244 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bfcabb-2c93-4219-9fe8-d8874de5fe37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:00.812921 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a20b6-12ed-4c0e-b6b9-ce81afe4d1e6 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:00.824582 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-35bfcabb-2c93-4219-9fe8-d8874de5fe37 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:00.826400 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-35bfcabb-2c93-4219-9fe8-d8874de5fe37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:00.858365 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62178ac6-4f4b-4aae-b758-e54a322fa1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:00.859577 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62178ac6-4f4b-4aae-b758-e54a322fa1db None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:00.859860 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62178ac6-4f4b-4aae-b758-e54a322fa1db None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:00.860135 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62178ac6-4f4b-4aae-b758-e54a322fa1db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:00.860960 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62178ac6-4f4b-4aae-b758-e54a322fa1db None admin] RBAC: Adding query filter params (role.id=1c79fcc5aeef4042aa382ec20f77f7b9, user.id=fdafeb37201a4426abd5a83a67dfcb28, scope.system=all) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:00.861269 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62178ac6-4f4b-4aae-b758-e54a322fa1db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:00.862738 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62178ac6-4f4b-4aae-b758-e54a322fa1db None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:00.867895 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 141/282] 10.222.0.21 () {56 vars in 1308 bytes} [Mon Feb 28 10:18:00 2022] GET /identity/v3/role_assignments?user.id=fdafeb37201a4426abd5a83a67dfcb28&scope.system=all&role.id=1c79fcc5aeef4042aa382ec20f77f7b9 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:00.868755 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62178ac6-4f4b-4aae-b758-e54a322fa1db None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:00.910374 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 142/283] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:18:00.933156 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bfcabb-2c93-4219-9fe8-d8874de5fe37 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:00.998912 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62178ac6-4f4b-4aae-b758-e54a322fa1db None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:01.046933 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056dcd2c-3453-47fd-acd4-df85e04efd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:01.047738 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056dcd2c-3453-47fd-acd4-df85e04efd6e None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:01.048019 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056dcd2c-3453-47fd-acd4-df85e04efd6e None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:01.048290 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056dcd2c-3453-47fd-acd4-df85e04efd6e None admin] PATH_INFO: `/v3/roles/member` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:01.060723 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056dcd2c-3453-47fd-acd4-df85e04efd6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:18:01.070680 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-056dcd2c-3453-47fd-acd4-df85e04efd6e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 10:18:01.072192 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 142/284] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:18:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:01.073778 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bfcabb-2c93-4219-9fe8-d8874de5fe37 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:01.078339 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056dcd2c-3453-47fd-acd4-df85e04efd6e None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:01.109748 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de5626-554a-4964-9f03-c6f215bbe8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:01.110545 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de5626-554a-4964-9f03-c6f215bbe8ed None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:01.110854 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de5626-554a-4964-9f03-c6f215bbe8ed None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:01.111135 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de5626-554a-4964-9f03-c6f215bbe8ed None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:01.121660 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1de5626-554a-4964-9f03-c6f215bbe8ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:18:01.129340 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-f1de5626-554a-4964-9f03-c6f215bbe8ed None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 28 10:18:01.130889 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 143/285] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:18:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:18:01.138945 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de5626-554a-4964-9f03-c6f215bbe8ed None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:01.180920 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056dcd2c-3453-47fd-acd4-df85e04efd6e None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:01.215560 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b2b95b-095c-4715-8972-5c3c4d687355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:01.216832 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b2b95b-095c-4715-8972-5c3c4d687355 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:01.217110 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b2b95b-095c-4715-8972-5c3c4d687355 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:01.217379 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b2b95b-095c-4715-8972-5c3c4d687355 None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:01.218120 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b2b95b-095c-4715-8972-5c3c4d687355 None admin] RBAC: Adding query filter params (name=member) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:01.218421 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b2b95b-095c-4715-8972-5c3c4d687355 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:01.219826 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b2b95b-095c-4715-8972-5c3c4d687355 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:01.228564 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 143/286] 10.222.0.21 () {56 vars in 1101 bytes} [Mon Feb 28 10:18:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:18:01.234803 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b2b95b-095c-4715-8972-5c3c4d687355 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:01.328775 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de5626-554a-4964-9f03-c6f215bbe8ed None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:01.335158 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b2b95b-095c-4715-8972-5c3c4d687355 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:01.374478 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0e30c-6db5-460f-8d5c-925aede834b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:01.375385 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0e30c-6db5-460f-8d5c-925aede834b0 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:01.375660 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0e30c-6db5-460f-8d5c-925aede834b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:01.375931 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0e30c-6db5-460f-8d5c-925aede834b0 None admin] PATH_INFO: `/v3/users/f1855ad3727f4692a794498a9ea98edd` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:01.377732 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e0e30c-6db5-460f-8d5c-925aede834b0 None admin] RBAC: Authorizing `identity:get_user(user_id=f1855ad3727f4692a794498a9ea98edd)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:01.379198 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e0e30c-6db5-460f-8d5c-925aede834b0 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:01.380988 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 144/287] 10.222.0.21 () {56 vars in 1177 bytes} [Mon Feb 28 10:18:01 2022] GET /identity/v3/users/f1855ad3727f4692a794498a9ea98edd => generated 297 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:01.391331 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0e30c-6db5-460f-8d5c-925aede834b0 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:01.396948 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d77420f-300d-42ea-a8d6-f04de68663a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:01.397614 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77420f-300d-42ea-a8d6-f04de68663a8 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:01.397891 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77420f-300d-42ea-a8d6-f04de68663a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:01.398160 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77420f-300d-42ea-a8d6-f04de68663a8 None admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:01.398945 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d77420f-300d-42ea-a8d6-f04de68663a8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:01.399247 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d77420f-300d-42ea-a8d6-f04de68663a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:01.400601 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d77420f-300d-42ea-a8d6-f04de68663a8 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:01.422507 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 144/288] 10.222.0.21 () {56 vars in 1101 bytes} [Mon Feb 28 10:18:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:01.432866 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d77420f-300d-42ea-a8d6-f04de68663a8 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:01.566009 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d77420f-300d-42ea-a8d6-f04de68663a8 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:01.608478 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be710cd-7b36-4513-8cda-df553a2a8de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:01.609265 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be710cd-7b36-4513-8cda-df553a2a8de2 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:01.609540 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be710cd-7b36-4513-8cda-df553a2a8de2 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:01.609810 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be710cd-7b36-4513-8cda-df553a2a8de2 None admin] PATH_INFO: `/v3/users/a0fc05ef0ac942aa9707fbf4e0cddab7` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:01.613398 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be710cd-7b36-4513-8cda-df553a2a8de2 None admin] RBAC: Authorizing `identity:get_user(user_id=a0fc05ef0ac942aa9707fbf4e0cddab7)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:01.614873 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be710cd-7b36-4513-8cda-df553a2a8de2 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:01.616793 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 145/289] 10.222.0.21 () {56 vars in 1177 bytes} [Mon Feb 28 10:18:01 2022] GET /identity/v3/users/a0fc05ef0ac942aa9707fbf4e0cddab7 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:01.622393 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be710cd-7b36-4513-8cda-df553a2a8de2 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:01.640744 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0e30c-6db5-460f-8d5c-925aede834b0 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:01.709374 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85892c68-a87c-4f6b-968f-cc6490161045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:01.710024 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85892c68-a87c-4f6b-968f-cc6490161045 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:01.710301 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85892c68-a87c-4f6b-968f-cc6490161045 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:01.710572 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85892c68-a87c-4f6b-968f-cc6490161045 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:01.762626 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be710cd-7b36-4513-8cda-df553a2a8de2 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:01.800507 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd5bb3-4d0e-452a-98cf-e5af2888d1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:01.801647 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd5bb3-4d0e-452a-98cf-e5af2888d1b1 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:01.801929 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd5bb3-4d0e-452a-98cf-e5af2888d1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:01.802199 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd5bb3-4d0e-452a-98cf-e5af2888d1b1 None admin] PATH_INFO: `/v3/projects/6ddffcb5f354434d9e960ae5d51d1a95` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:01.803590 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd5bb3-4d0e-452a-98cf-e5af2888d1b1 None admin] RBAC: Authorizing `identity:get_project(project_id=6ddffcb5f354434d9e960ae5d51d1a95)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:01.805043 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd5bb3-4d0e-452a-98cf-e5af2888d1b1 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:01.806947 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 146/290] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:18:01 2022] GET /identity/v3/projects/6ddffcb5f354434d9e960ae5d51d1a95 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:18:01.813027 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd5bb3-4d0e-452a-98cf-e5af2888d1b1 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:01.852014 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85892c68-a87c-4f6b-968f-cc6490161045 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:01.853057 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85892c68-a87c-4f6b-968f-cc6490161045 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:01.985636 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd5bb3-4d0e-452a-98cf-e5af2888d1b1 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:02.042559 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b2dfc-d870-472f-9cad-87936c26cb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:02.043470 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b2dfc-d870-472f-9cad-87936c26cb45 None admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:02.044348 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b2dfc-d870-472f-9cad-87936c26cb45 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:02.044795 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b2dfc-d870-472f-9cad-87936c26cb45 None admin] PATH_INFO: `/v3/projects/6ddffcb5f354434d9e960ae5d51d1a95/users/a0fc05ef0ac942aa9707fbf4e0cddab7/roles/86661077994d4bb6b80bab41d2f2c953` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:02.050085 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 145/291] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:18:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 659 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:18:02.050938 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b2dfc-d870-472f-9cad-87936c26cb45 None admin] RBAC: Authorizing `identity:create_grant(project_id=6ddffcb5f354434d9e960ae5d51d1a95, user_id=a0fc05ef0ac942aa9707fbf4e0cddab7, role_id=86661077994d4bb6b80bab41d2f2c953)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:02.052462 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b2dfc-d870-472f-9cad-87936c26cb45 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:02.055763 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85892c68-a87c-4f6b-968f-cc6490161045 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:02.084970 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 147/292] 10.222.0.21 () {58 vars in 1439 bytes} [Mon Feb 28 10:18:01 2022] PUT /identity/v3/projects/6ddffcb5f354434d9e960ae5d51d1a95/users/a0fc05ef0ac942aa9707fbf4e0cddab7/roles/86661077994d4bb6b80bab41d2f2c953 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:18:02.168944 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85892c68-a87c-4f6b-968f-cc6490161045 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:02.207701 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe18622c-254e-4409-98fb-ac98f6eaee7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:02.208566 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe18622c-254e-4409-98fb-ac98f6eaee7b None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:02.208839 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe18622c-254e-4409-98fb-ac98f6eaee7b None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:02.209102 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe18622c-254e-4409-98fb-ac98f6eaee7b None admin] PATH_INFO: `/v3/projects/6ddffcb5f354434d9e960ae5d51d1a95` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:02.210354 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe18622c-254e-4409-98fb-ac98f6eaee7b None admin] RBAC: Authorizing `identity:get_project(project_id=6ddffcb5f354434d9e960ae5d51d1a95)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:02.211859 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe18622c-254e-4409-98fb-ac98f6eaee7b None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:02.213875 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 146/293] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:18:02 2022] GET /identity/v3/projects/6ddffcb5f354434d9e960ae5d51d1a95 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:02.220491 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b2dfc-d870-472f-9cad-87936c26cb45 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:02.331384 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b2dfc-d870-472f-9cad-87936c26cb45 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:02.368002 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14cd750-9966-450f-b885-c001c3763fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:02.368664 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cd750-9966-450f-b885-c001c3763fd9 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:02.368944 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cd750-9966-450f-b885-c001c3763fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:02.369217 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cd750-9966-450f-b885-c001c3763fd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:02.370038 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14cd750-9966-450f-b885-c001c3763fd9 None admin] RBAC: Adding query filter params (role.id=1c79fcc5aeef4042aa382ec20f77f7b9, scope.project.id=6ddffcb5f354434d9e960ae5d51d1a95, user.id=f1855ad3727f4692a794498a9ea98edd) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:02.370341 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14cd750-9966-450f-b885-c001c3763fd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:02.371786 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14cd750-9966-450f-b885-c001c3763fd9 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:02.378654 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 148/294] 10.222.0.21 () {56 vars in 1374 bytes} [Mon Feb 28 10:18:02 2022] GET /identity/v3/role_assignments?user.id=f1855ad3727f4692a794498a9ea98edd&scope.project.id=6ddffcb5f354434d9e960ae5d51d1a95&role.id=1c79fcc5aeef4042aa382ec20f77f7b9 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:03.545846 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877bd74d-648d-4de6-a03f-bd9ebf47c8e2 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:03.546373 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877bd74d-648d-4de6-a03f-bd9ebf47c8e2 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:03.546373 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877bd74d-648d-4de6-a03f-bd9ebf47c8e2 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:03.548704 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 147/295] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:18:03.553859 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09145c4-6c5a-4744-a87d-ee62d52b44e8 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:03.554718 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09145c4-6c5a-4744-a87d-ee62d52b44e8 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:03.555193 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09145c4-6c5a-4744-a87d-ee62d52b44e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:03.582007 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-d09145c4-6c5a-4744-a87d-ee62d52b44e8 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:03.583591 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-d09145c4-6c5a-4744-a87d-ee62d52b44e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:03.611935 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3cc7a-8ecb-4a3d-8036-3ab004a00d5a None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:03.612544 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3cc7a-8ecb-4a3d-8036-3ab004a00d5a None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:03.613016 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3cc7a-8ecb-4a3d-8036-3ab004a00d5a None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:03.615270 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 148/296] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:18:03.620201 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80d20d-4560-46dc-a644-2b075ee60ab9 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:03.620798 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80d20d-4560-46dc-a644-2b075ee60ab9 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:03.621348 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80d20d-4560-46dc-a644-2b075ee60ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:03.643493 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-3d80d20d-4560-46dc-a644-2b075ee60ab9 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:03.645278 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-3d80d20d-4560-46dc-a644-2b075ee60ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:03.705148 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 149/297] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:18:03.706991 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd652a-8b4f-4423-9f9b-0d767d25cfde None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:03.707468 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd652a-8b4f-4423-9f9b-0d767d25cfde None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:03.707919 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd652a-8b4f-4423-9f9b-0d767d25cfde None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:03.709909 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 150/298] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:18:03.732483 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cd652a-8b4f-4423-9f9b-0d767d25cfde None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:03.842200 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 149/299] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:18:03.853146 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893da3a-84a0-4da9-bb3d-aa1d63a6edcc None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:03.853436 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893da3a-84a0-4da9-bb3d-aa1d63a6edcc None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:03.853712 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893da3a-84a0-4da9-bb3d-aa1d63a6edcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:03.867257 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cd652a-8b4f-4423-9f9b-0d767d25cfde None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:03.870951 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-8893da3a-84a0-4da9-bb3d-aa1d63a6edcc None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:03.872695 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-8893da3a-84a0-4da9-bb3d-aa1d63a6edcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:03.902632 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7084b7-92f4-429d-aabd-76c7c37dc45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:03.903509 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7084b7-92f4-429d-aabd-76c7c37dc45f None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:03.903875 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7084b7-92f4-429d-aabd-76c7c37dc45f None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:03.904159 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7084b7-92f4-429d-aabd-76c7c37dc45f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:03.914107 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7084b7-92f4-429d-aabd-76c7c37dc45f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:18:03.921272 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-ed7084b7-92f4-429d-aabd-76c7c37dc45f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 28 10:18:03.927313 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 151/300] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:18:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:03.927313 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7084b7-92f4-429d-aabd-76c7c37dc45f None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:03.944960 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 150/301] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:18:03.955540 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893da3a-84a0-4da9-bb3d-aa1d63a6edcc None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:04.021282 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7084b7-92f4-429d-aabd-76c7c37dc45f None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:04.053110 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd2b34-3a8f-4e52-8031-ce2a8e8c998a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:04.053454 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893da3a-84a0-4da9-bb3d-aa1d63a6edcc None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:04.053893 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd2b34-3a8f-4e52-8031-ce2a8e8c998a None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:04.054171 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd2b34-3a8f-4e52-8031-ce2a8e8c998a None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:04.054442 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd2b34-3a8f-4e52-8031-ce2a8e8c998a None admin] PATH_INFO: `/v3/domains/default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:04.055647 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bd2b34-3a8f-4e52-8031-ce2a8e8c998a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:04.057084 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bd2b34-3a8f-4e52-8031-ce2a8e8c998a None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:04.063591 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 152/302] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:18:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:04.063591 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd2b34-3a8f-4e52-8031-ce2a8e8c998a None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:04.087582 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f3847-13fc-416c-bff2-bb6a94cf80db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:04.088328 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f3847-13fc-416c-bff2-bb6a94cf80db None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:04.088522 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f3847-13fc-416c-bff2-bb6a94cf80db None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:04.088778 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f3847-13fc-416c-bff2-bb6a94cf80db None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:04.089510 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f3847-13fc-416c-bff2-bb6a94cf80db None admin] RBAC: Adding query filter params (name=reader) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:04.089814 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f3847-13fc-416c-bff2-bb6a94cf80db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:04.091300 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f3847-13fc-416c-bff2-bb6a94cf80db None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:04.099560 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 151/303] 10.222.0.21 () {56 vars in 1101 bytes} [Mon Feb 28 10:18:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:04.100091 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f3847-13fc-416c-bff2-bb6a94cf80db None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:04.168082 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd2b34-3a8f-4e52-8031-ce2a8e8c998a None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:04.199111 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f3847-13fc-416c-bff2-bb6a94cf80db None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:04.201939 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7535f-5bd8-4c9f-9b26-f2a12626003e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:04.202773 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7535f-5bd8-4c9f-9b26-f2a12626003e None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:04.203112 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7535f-5bd8-4c9f-9b26-f2a12626003e None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:04.203394 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7535f-5bd8-4c9f-9b26-f2a12626003e None admin] PATH_INFO: `/v3/roles/member` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:04.213407 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7535f-5bd8-4c9f-9b26-f2a12626003e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:18:04.220430 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-28b7535f-5bd8-4c9f-9b26-f2a12626003e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 10:18:04.226363 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 153/304] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:18:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:04.226363 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7535f-5bd8-4c9f-9b26-f2a12626003e None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:04.240094 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c843ba-403e-42e3-a2a0-48a38b2ef47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:04.240756 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c843ba-403e-42e3-a2a0-48a38b2ef47f None admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:04.241036 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c843ba-403e-42e3-a2a0-48a38b2ef47f None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:04.241312 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c843ba-403e-42e3-a2a0-48a38b2ef47f None admin] PATH_INFO: `/v3/groups` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:04.241986 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c843ba-403e-42e3-a2a0-48a38b2ef47f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:04.243468 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c843ba-403e-42e3-a2a0-48a38b2ef47f None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:04.258021 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 152/305] 10.222.0.21 () {60 vars in 1134 bytes} [Mon Feb 28 10:18:04 2022] POST /identity/v3/groups => generated 229 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:18:04.259025 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c843ba-403e-42e3-a2a0-48a38b2ef47f None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:04.345997 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7535f-5bd8-4c9f-9b26-f2a12626003e None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:04.393372 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f4f004-af19-4490-ace0-3a464491239b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:04.394197 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4f004-af19-4490-ace0-3a464491239b None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:04.394482 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4f004-af19-4490-ace0-3a464491239b None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:04.394810 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4f004-af19-4490-ace0-3a464491239b None admin] PATH_INFO: `/v3/users/ffe7f32e41a84203a24ff170bc7aa2b2` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:04.399384 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c843ba-403e-42e3-a2a0-48a38b2ef47f None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:04.418592 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f4f004-af19-4490-ace0-3a464491239b None admin] RBAC: Authorizing `identity:get_user(user_id=ffe7f32e41a84203a24ff170bc7aa2b2)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:04.421116 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f4f004-af19-4490-ace0-3a464491239b None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:04.426775 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 154/306] 10.222.0.21 () {56 vars in 1177 bytes} [Mon Feb 28 10:18:04 2022] GET /identity/v3/users/ffe7f32e41a84203a24ff170bc7aa2b2 => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:04.430309 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f4f004-af19-4490-ace0-3a464491239b None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:04.443931 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9cacd-614f-4dd3-a936-e3616875a520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:04.445044 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9cacd-614f-4dd3-a936-e3616875a520 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:04.445570 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9cacd-614f-4dd3-a936-e3616875a520 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:04.446313 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9cacd-614f-4dd3-a936-e3616875a520 None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:04.447351 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9cacd-614f-4dd3-a936-e3616875a520 None admin] RBAC: Adding query filter params (name=member) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:04.447869 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9cacd-614f-4dd3-a936-e3616875a520 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:04.449547 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9cacd-614f-4dd3-a936-e3616875a520 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:04.460402 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 153/307] 10.222.0.21 () {56 vars in 1101 bytes} [Mon Feb 28 10:18:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:04.467628 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9cacd-614f-4dd3-a936-e3616875a520 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:04.557553 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f4f004-af19-4490-ace0-3a464491239b None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:04.579701 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9cacd-614f-4dd3-a936-e3616875a520 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:04.593311 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4478906d-f621-4a95-9ac5-09bb6498b863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:04.593969 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478906d-f621-4a95-9ac5-09bb6498b863 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:04.594253 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478906d-f621-4a95-9ac5-09bb6498b863 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:04.594521 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478906d-f621-4a95-9ac5-09bb6498b863 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:04.595363 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4478906d-f621-4a95-9ac5-09bb6498b863 None admin] RBAC: Adding query filter params (role.id=86661077994d4bb6b80bab41d2f2c953, user.id=ffe7f32e41a84203a24ff170bc7aa2b2, scope.system=all) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:04.595732 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4478906d-f621-4a95-9ac5-09bb6498b863 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:04.597078 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4478906d-f621-4a95-9ac5-09bb6498b863 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:04.602228 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 155/308] 10.222.0.21 () {56 vars in 1308 bytes} [Mon Feb 28 10:18:04 2022] GET /identity/v3/role_assignments?user.id=ffe7f32e41a84203a24ff170bc7aa2b2&scope.system=all&role.id=86661077994d4bb6b80bab41d2f2c953 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:04.617618 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846b481-ed49-4234-ad26-d4ba67ab5791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:04.618712 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846b481-ed49-4234-ad26-d4ba67ab5791 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:04.619086 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846b481-ed49-4234-ad26-d4ba67ab5791 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:04.619501 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846b481-ed49-4234-ad26-d4ba67ab5791 None admin] PATH_INFO: `/v3/users/fdafeb37201a4426abd5a83a67dfcb28` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:04.621020 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d846b481-ed49-4234-ad26-d4ba67ab5791 None admin] RBAC: Authorizing `identity:get_user(user_id=fdafeb37201a4426abd5a83a67dfcb28)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:04.623325 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d846b481-ed49-4234-ad26-d4ba67ab5791 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:04.625372 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 154/309] 10.222.0.21 () {56 vars in 1177 bytes} [Mon Feb 28 10:18:04 2022] GET /identity/v3/users/fdafeb37201a4426abd5a83a67dfcb28 => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:04.631266 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4478906d-f621-4a95-9ac5-09bb6498b863 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:04.729981 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba660b3-cb71-4c88-82b3-c13f4796d0d0 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:04.730153 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba660b3-cb71-4c88-82b3-c13f4796d0d0 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:04.730434 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba660b3-cb71-4c88-82b3-c13f4796d0d0 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:04.732342 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 155/310] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:18:04.738079 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f402c3b-33b9-4b5c-b32a-6a2e5d6ff1d8 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:04.738362 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f402c3b-33b9-4b5c-b32a-6a2e5d6ff1d8 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:04.738660 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f402c3b-33b9-4b5c-b32a-6a2e5d6ff1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:04.742047 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4478906d-f621-4a95-9ac5-09bb6498b863 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:04.757689 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-8f402c3b-33b9-4b5c-b32a-6a2e5d6ff1d8 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:04.758921 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-8f402c3b-33b9-4b5c-b32a-6a2e5d6ff1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:04.779727 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55927186-daa5-44fc-9729-a7b7c8034817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:04.780646 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55927186-daa5-44fc-9729-a7b7c8034817 None admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:04.780922 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55927186-daa5-44fc-9729-a7b7c8034817 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:04.781194 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55927186-daa5-44fc-9729-a7b7c8034817 None admin] PATH_INFO: `/v3/system/users/fdafeb37201a4426abd5a83a67dfcb28/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:04.782810 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55927186-daa5-44fc-9729-a7b7c8034817 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fdafeb37201a4426abd5a83a67dfcb28, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:04.784246 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55927186-daa5-44fc-9729-a7b7c8034817 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:04.795705 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 156/311] 10.222.0.21 () {58 vars in 1334 bytes} [Mon Feb 28 10:18:04 2022] PUT /identity/v3/system/users/fdafeb37201a4426abd5a83a67dfcb28/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:18:04.837687 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 156/312] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 10:18:04.861919 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55927186-daa5-44fc-9729-a7b7c8034817 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:04.975846 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55927186-daa5-44fc-9729-a7b7c8034817 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:05.011626 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cbe7bb-09b6-4473-9e0d-6b1031a7b030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:05.012335 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbe7bb-09b6-4473-9e0d-6b1031a7b030 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:05.013321 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbe7bb-09b6-4473-9e0d-6b1031a7b030 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:05.013650 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbe7bb-09b6-4473-9e0d-6b1031a7b030 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:05.023871 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cbe7bb-09b6-4473-9e0d-6b1031a7b030 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:18:05.031073 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-b0cbe7bb-09b6-4473-9e0d-6b1031a7b030 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 28 10:18:05.032595 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 157/313] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:18:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:05.038255 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f402c3b-33b9-4b5c-b32a-6a2e5d6ff1d8 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:05.141197 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f402c3b-33b9-4b5c-b32a-6a2e5d6ff1d8 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:05.175591 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b827e-4689-4e51-a0c0-fa9c0575f79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:05.176603 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b827e-4689-4e51-a0c0-fa9c0575f79a None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:05.177124 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b827e-4689-4e51-a0c0-fa9c0575f79a None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:05.177598 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b827e-4689-4e51-a0c0-fa9c0575f79a None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:05.178539 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b827e-4689-4e51-a0c0-fa9c0575f79a None admin] RBAC: Adding query filter params (name=reader) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:05.179130 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b827e-4689-4e51-a0c0-fa9c0575f79a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:05.180727 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b827e-4689-4e51-a0c0-fa9c0575f79a None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:05.194462 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 157/314] 10.222.0.21 () {56 vars in 1101 bytes} [Mon Feb 28 10:18:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:05.196352 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cbe7bb-09b6-4473-9e0d-6b1031a7b030 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:05.297041 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cbe7bb-09b6-4473-9e0d-6b1031a7b030 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:05.330071 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cae655-5e49-4a67-b025-fddacf7958d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:05.330955 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cae655-5e49-4a67-b025-fddacf7958d4 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:05.331228 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cae655-5e49-4a67-b025-fddacf7958d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:05.331493 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cae655-5e49-4a67-b025-fddacf7958d4 None admin] PATH_INFO: `/v3/users/a0fc05ef0ac942aa9707fbf4e0cddab7` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:05.332671 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cae655-5e49-4a67-b025-fddacf7958d4 None admin] RBAC: Authorizing `identity:get_user(user_id=a0fc05ef0ac942aa9707fbf4e0cddab7)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:05.334108 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cae655-5e49-4a67-b025-fddacf7958d4 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:05.336129 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 158/315] 10.222.0.21 () {56 vars in 1177 bytes} [Mon Feb 28 10:18:05 2022] GET /identity/v3/users/a0fc05ef0ac942aa9707fbf4e0cddab7 => generated 297 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:05.342194 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b827e-4689-4e51-a0c0-fa9c0575f79a None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:05.441587 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b827e-4689-4e51-a0c0-fa9c0575f79a None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:05.478002 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ceadb-e859-431d-abd9-d868641c9b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:05.479049 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ceadb-e859-431d-abd9-d868641c9b1c None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:05.479627 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ceadb-e859-431d-abd9-d868641c9b1c None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:05.480115 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ceadb-e859-431d-abd9-d868641c9b1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:05.552165 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ceadb-e859-431d-abd9-d868641c9b1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:05.553919 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ceadb-e859-431d-abd9-d868641c9b1c None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:05.656659 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 158/316] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:18:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:18:05.658866 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cae655-5e49-4a67-b025-fddacf7958d4 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:05.760549 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cae655-5e49-4a67-b025-fddacf7958d4 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:05.793298 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1907cb4a-db7f-4b62-ad07-48cae825c034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:05.794688 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907cb4a-db7f-4b62-ad07-48cae825c034 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:05.794979 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907cb4a-db7f-4b62-ad07-48cae825c034 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:05.795251 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907cb4a-db7f-4b62-ad07-48cae825c034 None admin] PATH_INFO: `/v3/projects/6ddffcb5f354434d9e960ae5d51d1a95` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:05.796443 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1907cb4a-db7f-4b62-ad07-48cae825c034 None admin] RBAC: Authorizing `identity:get_project(project_id=6ddffcb5f354434d9e960ae5d51d1a95)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:05.797881 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1907cb4a-db7f-4b62-ad07-48cae825c034 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:05.799895 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 159/317] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:18:05 2022] GET /identity/v3/projects/6ddffcb5f354434d9e960ae5d51d1a95 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:18:05.805678 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ceadb-e859-431d-abd9-d868641c9b1c None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:05.908784 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ceadb-e859-431d-abd9-d868641c9b1c None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:05.942760 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b7824-428f-41d2-a981-9168bdf2372f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:05.943410 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b7824-428f-41d2-a981-9168bdf2372f None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:05.943691 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b7824-428f-41d2-a981-9168bdf2372f None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:05.944025 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b7824-428f-41d2-a981-9168bdf2372f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:05.944854 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b7824-428f-41d2-a981-9168bdf2372f None admin] RBAC: Adding query filter params (role.id=86661077994d4bb6b80bab41d2f2c953, scope.project.id=6ddffcb5f354434d9e960ae5d51d1a95, user.id=a0fc05ef0ac942aa9707fbf4e0cddab7) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:05.945200 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b7824-428f-41d2-a981-9168bdf2372f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:05.946915 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b7824-428f-41d2-a981-9168bdf2372f None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:05.958296 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 159/318] 10.222.0.21 () {56 vars in 1374 bytes} [Mon Feb 28 10:18:05 2022] GET /identity/v3/role_assignments?user.id=a0fc05ef0ac942aa9707fbf4e0cddab7&scope.project.id=6ddffcb5f354434d9e960ae5d51d1a95&role.id=86661077994d4bb6b80bab41d2f2c953 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:06.741990 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a0ab3-5890-4908-bf54-b1f95ac6bda8 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:06.742832 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a0ab3-5890-4908-bf54-b1f95ac6bda8 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:06.742832 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a0ab3-5890-4908-bf54-b1f95ac6bda8 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:06.744379 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 160/319] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:18:06.750033 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8802f-6213-40ea-bec1-2d24b96292d0 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:06.750478 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8802f-6213-40ea-bec1-2d24b96292d0 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:06.750686 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8802f-6213-40ea-bec1-2d24b96292d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:06.767841 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-65f8802f-6213-40ea-bec1-2d24b96292d0 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:06.769020 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-65f8802f-6213-40ea-bec1-2d24b96292d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:06.834884 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 160/320] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:18:06.858481 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a0ab3-5890-4908-bf54-b1f95ac6bda8 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:06.959205 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a0ab3-5890-4908-bf54-b1f95ac6bda8 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:06.990615 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3847016-25d8-46a7-b5f5-3a7f926e9ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:06.991421 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3847016-25d8-46a7-b5f5-3a7f926e9ba5 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:06.991705 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3847016-25d8-46a7-b5f5-3a7f926e9ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:06.991981 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3847016-25d8-46a7-b5f5-3a7f926e9ba5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:06.993206 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3847016-25d8-46a7-b5f5-3a7f926e9ba5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:06.994572 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3847016-25d8-46a7-b5f5-3a7f926e9ba5 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:06.996360 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 161/321] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:18:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:07.002319 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8802f-6213-40ea-bec1-2d24b96292d0 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:07.039826 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10feeb60-127f-4f3b-adf0-e3a8df56c166 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:07.040136 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10feeb60-127f-4f3b-adf0-e3a8df56c166 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:07.040383 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10feeb60-127f-4f3b-adf0-e3a8df56c166 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:07.042151 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 162/322] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:18:07.047885 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eba182-6d47-4b39-a975-c5b57de4b156 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:07.048165 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eba182-6d47-4b39-a975-c5b57de4b156 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:07.048439 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eba182-6d47-4b39-a975-c5b57de4b156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:07.064997 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-a5eba182-6d47-4b39-a975-c5b57de4b156 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:07.066412 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-a5eba182-6d47-4b39-a975-c5b57de4b156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:07.105531 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8802f-6213-40ea-bec1-2d24b96292d0 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:07.140599 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 163/323] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 10:18:07.140936 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89baa7b2-1591-44a0-ad88-22bed827fc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:07.141655 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89baa7b2-1591-44a0-ad88-22bed827fc2e None admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:07.141933 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89baa7b2-1591-44a0-ad88-22bed827fc2e None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:07.142196 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89baa7b2-1591-44a0-ad88-22bed827fc2e None admin] PATH_INFO: `/v3/groups` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:07.143130 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89baa7b2-1591-44a0-ad88-22bed827fc2e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:07.144542 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89baa7b2-1591-44a0-ad88-22bed827fc2e None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:07.162654 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 161/324] 10.222.0.21 () {60 vars in 1134 bytes} [Mon Feb 28 10:18:07 2022] POST /identity/v3/groups => generated 226 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:18:07.165452 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eba182-6d47-4b39-a975-c5b57de4b156 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:07.225454 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652b239-c63c-465c-b8ce-3c46f282bd10 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:07.225844 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652b239-c63c-465c-b8ce-3c46f282bd10 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:07.226022 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652b239-c63c-465c-b8ce-3c46f282bd10 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:07.228038 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 162/325] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:18:07.233737 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505b11b-7ae8-4ee3-92f8-a62cf30dba6f None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:07.234030 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505b11b-7ae8-4ee3-92f8-a62cf30dba6f None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:07.234282 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505b11b-7ae8-4ee3-92f8-a62cf30dba6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:07.251287 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-a505b11b-7ae8-4ee3-92f8-a62cf30dba6f None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:07.252397 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-a505b11b-7ae8-4ee3-92f8-a62cf30dba6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:07.275520 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eba182-6d47-4b39-a975-c5b57de4b156 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:07.311329 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c550f7-9533-4a5c-91f5-0cbd4421eca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:07.312503 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c550f7-9533-4a5c-91f5-0cbd4421eca8 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:07.312975 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c550f7-9533-4a5c-91f5-0cbd4421eca8 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:07.313422 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c550f7-9533-4a5c-91f5-0cbd4421eca8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:07.322169 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 163/326] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 10:18:07.326344 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c550f7-9533-4a5c-91f5-0cbd4421eca8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:18:07.333282 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-85c550f7-9533-4a5c-91f5-0cbd4421eca8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 28 10:18:07.334734 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 164/327] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:18:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:07.340302 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505b11b-7ae8-4ee3-92f8-a62cf30dba6f None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:07.346223 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c550f7-9533-4a5c-91f5-0cbd4421eca8 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:07.454692 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505b11b-7ae8-4ee3-92f8-a62cf30dba6f None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:07.460637 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c550f7-9533-4a5c-91f5-0cbd4421eca8 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:07.495174 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a855d-e5d3-4cb9-96b9-5847ae248cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:07.495843 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a855d-e5d3-4cb9-96b9-5847ae248cbf None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:07.496120 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a855d-e5d3-4cb9-96b9-5847ae248cbf None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:07.496488 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a855d-e5d3-4cb9-96b9-5847ae248cbf None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:07.497462 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a855d-e5d3-4cb9-96b9-5847ae248cbf None admin] RBAC: Adding query filter params (name=reader) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:07.497864 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a855d-e5d3-4cb9-96b9-5847ae248cbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:07.499570 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a855d-e5d3-4cb9-96b9-5847ae248cbf None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:07.500467 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbcb08f-c60e-418d-8f37-03fa4e633b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:07.501271 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbcb08f-c60e-418d-8f37-03fa4e633b7f None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:07.501602 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbcb08f-c60e-418d-8f37-03fa4e633b7f None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:07.501835 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbcb08f-c60e-418d-8f37-03fa4e633b7f None admin] PATH_INFO: `/v3/roles/member` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:07.511553 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 164/328] 10.222.0.21 () {56 vars in 1101 bytes} [Mon Feb 28 10:18:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:07.513728 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbcb08f-c60e-418d-8f37-03fa4e633b7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:18:07.518319 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a855d-e5d3-4cb9-96b9-5847ae248cbf None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:07.521092 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-1dbcb08f-c60e-418d-8f37-03fa4e633b7f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 10:18:07.523792 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 165/329] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:18:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:18:07.531637 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbcb08f-c60e-418d-8f37-03fa4e633b7f None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:07.649329 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a855d-e5d3-4cb9-96b9-5847ae248cbf None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:07.651792 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbcb08f-c60e-418d-8f37-03fa4e633b7f None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:07.687643 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a92ffc-761a-46c7-ab21-229752a23b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:07.688320 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a92ffc-761a-46c7-ab21-229752a23b3b None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:07.688605 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a92ffc-761a-46c7-ab21-229752a23b3b None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:07.688881 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a92ffc-761a-46c7-ab21-229752a23b3b None admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:07.689627 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a92ffc-761a-46c7-ab21-229752a23b3b None admin] RBAC: Adding query filter params (name=member) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:07.689931 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a92ffc-761a-46c7-ab21-229752a23b3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:07.691560 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a92ffc-761a-46c7-ab21-229752a23b3b None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:07.692515 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722244b2-e901-450f-b255-a143602683d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:07.693767 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722244b2-e901-450f-b255-a143602683d0 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:07.694256 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722244b2-e901-450f-b255-a143602683d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:07.694793 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722244b2-e901-450f-b255-a143602683d0 None admin] PATH_INFO: `/v3/users/ffe7f32e41a84203a24ff170bc7aa2b2` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:07.696462 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722244b2-e901-450f-b255-a143602683d0 None admin] RBAC: Authorizing `identity:get_user(user_id=ffe7f32e41a84203a24ff170bc7aa2b2)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:07.698080 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722244b2-e901-450f-b255-a143602683d0 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:07.701150 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 165/331] 10.222.0.21 () {56 vars in 1177 bytes} [Mon Feb 28 10:18:07 2022] GET /identity/v3/users/ffe7f32e41a84203a24ff170bc7aa2b2 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:07.701394 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 166/331] 10.222.0.21 () {56 vars in 1101 bytes} [Mon Feb 28 10:18:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:07.707669 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a92ffc-761a-46c7-ab21-229752a23b3b None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:07.708359 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722244b2-e901-450f-b255-a143602683d0 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:07.815285 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722244b2-e901-450f-b255-a143602683d0 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:07.818516 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a92ffc-761a-46c7-ab21-229752a23b3b None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:07.851156 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5b726-2b98-41fb-8d3e-75557dc084a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:07.852027 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5b726-2b98-41fb-8d3e-75557dc084a8 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:07.852306 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5b726-2b98-41fb-8d3e-75557dc084a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:07.852583 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5b726-2b98-41fb-8d3e-75557dc084a8 None admin] PATH_INFO: `/v3/users/fdafeb37201a4426abd5a83a67dfcb28` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:07.854000 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab5b726-2b98-41fb-8d3e-75557dc084a8 None admin] RBAC: Authorizing `identity:get_user(user_id=fdafeb37201a4426abd5a83a67dfcb28)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:07.854624 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce74076-87dd-44e9-8454-4141af927873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:07.855500 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce74076-87dd-44e9-8454-4141af927873 None admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:07.855775 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce74076-87dd-44e9-8454-4141af927873 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:07.856044 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce74076-87dd-44e9-8454-4141af927873 None admin] PATH_INFO: `/v3/system/users/ffe7f32e41a84203a24ff170bc7aa2b2/roles/86661077994d4bb6b80bab41d2f2c953` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:07.856525 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab5b726-2b98-41fb-8d3e-75557dc084a8 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:07.858225 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 166/332] 10.222.0.21 () {56 vars in 1177 bytes} [Mon Feb 28 10:18:07 2022] GET /identity/v3/users/fdafeb37201a4426abd5a83a67dfcb28 => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:07.858451 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce74076-87dd-44e9-8454-4141af927873 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ffe7f32e41a84203a24ff170bc7aa2b2, role_id=86661077994d4bb6b80bab41d2f2c953)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:07.864882 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce74076-87dd-44e9-8454-4141af927873 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:07.865038 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5b726-2b98-41fb-8d3e-75557dc084a8 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:07.873096 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 167/333] 10.222.0.21 () {58 vars in 1334 bytes} [Mon Feb 28 10:18:07 2022] PUT /identity/v3/system/users/ffe7f32e41a84203a24ff170bc7aa2b2/roles/86661077994d4bb6b80bab41d2f2c953 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:18:07.983105 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5b726-2b98-41fb-8d3e-75557dc084a8 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:08.019300 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f15946-abc0-4ee9-8fc6-861968429b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:08.019964 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f15946-abc0-4ee9-8fc6-861968429b0c None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:08.020248 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f15946-abc0-4ee9-8fc6-861968429b0c None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:08.020520 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f15946-abc0-4ee9-8fc6-861968429b0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:08.021368 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f15946-abc0-4ee9-8fc6-861968429b0c None admin] RBAC: Adding query filter params (role.id=1c79fcc5aeef4042aa382ec20f77f7b9, user.id=fdafeb37201a4426abd5a83a67dfcb28, scope.system=all) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:08.021682 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f15946-abc0-4ee9-8fc6-861968429b0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:08.023190 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f15946-abc0-4ee9-8fc6-861968429b0c None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:08.036807 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 167/334] 10.222.0.21 () {56 vars in 1308 bytes} [Mon Feb 28 10:18:07 2022] GET /identity/v3/role_assignments?user.id=fdafeb37201a4426abd5a83a67dfcb28&scope.system=all&role.id=1c79fcc5aeef4042aa382ec20f77f7b9 => generated 510 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:18:09.912840 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831767bf-7219-4497-b0cb-716f9f7d0d55 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:09.913784 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831767bf-7219-4497-b0cb-716f9f7d0d55 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:09.914259 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831767bf-7219-4497-b0cb-716f9f7d0d55 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:09.916529 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 168/335] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:18:09.932528 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d9052-be4f-43f9-87ac-52186b7a09d0 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:09.933011 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d9052-be4f-43f9-87ac-52186b7a09d0 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:09.933087 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d9052-be4f-43f9-87ac-52186b7a09d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:09.955670 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-d66d9052-be4f-43f9-87ac-52186b7a09d0 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:09.956868 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-d66d9052-be4f-43f9-87ac-52186b7a09d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:10.037731 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 168/336] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:18:10.075809 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831767bf-7219-4497-b0cb-716f9f7d0d55 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:10.201040 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831767bf-7219-4497-b0cb-716f9f7d0d55 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:10.243370 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db3ce6-f5ec-45dd-83aa-5286d491178f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:10.244579 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db3ce6-f5ec-45dd-83aa-5286d491178f None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:10.245084 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db3ce6-f5ec-45dd-83aa-5286d491178f None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:10.245565 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db3ce6-f5ec-45dd-83aa-5286d491178f None admin] PATH_INFO: `/v3/roles/member` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:10.261713 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db3ce6-f5ec-45dd-83aa-5286d491178f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:18:10.269811 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-a3db3ce6-f5ec-45dd-83aa-5286d491178f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 10:18:10.275693 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 169/337] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:18:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:10.283199 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d9052-be4f-43f9-87ac-52186b7a09d0 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:10.422443 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d9052-be4f-43f9-87ac-52186b7a09d0 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:10.466277 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a019eb-75af-48ef-8af6-cb4f1adbd2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:10.466900 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a019eb-75af-48ef-8af6-cb4f1adbd2bd None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:10.467181 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a019eb-75af-48ef-8af6-cb4f1adbd2bd None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:10.467451 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a019eb-75af-48ef-8af6-cb4f1adbd2bd None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:10.468200 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a019eb-75af-48ef-8af6-cb4f1adbd2bd None admin] RBAC: Adding query filter params (name=member) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:10.468503 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a019eb-75af-48ef-8af6-cb4f1adbd2bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:10.469880 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a019eb-75af-48ef-8af6-cb4f1adbd2bd None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:10.479046 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 169/338] 10.222.0.21 () {56 vars in 1101 bytes} [Mon Feb 28 10:18:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:10.485281 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db3ce6-f5ec-45dd-83aa-5286d491178f None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:10.634021 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db3ce6-f5ec-45dd-83aa-5286d491178f None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:10.680407 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3435c-7c62-4d84-9130-367554470349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:10.681080 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3435c-7c62-4d84-9130-367554470349 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:10.681365 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3435c-7c62-4d84-9130-367554470349 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:10.681643 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3435c-7c62-4d84-9130-367554470349 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:10.766005 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f3435c-7c62-4d84-9130-367554470349 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:10.767494 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f3435c-7c62-4d84-9130-367554470349 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:10.867286 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37bb145-d181-4d92-959f-506cfd941ed3 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:10.867947 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37bb145-d181-4d92-959f-506cfd941ed3 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:10.868443 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37bb145-d181-4d92-959f-506cfd941ed3 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:10.874705 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 170/339] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:18:10.880039 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73626b-c01c-4251-aef7-f4f2b6b53d79 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:10.880565 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73626b-c01c-4251-aef7-f4f2b6b53d79 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:10.881063 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73626b-c01c-4251-aef7-f4f2b6b53d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:10.883186 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 170/340] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:18:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:18:10.894634 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3435c-7c62-4d84-9130-367554470349 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:10.911508 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-ee73626b-c01c-4251-aef7-f4f2b6b53d79 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:10.913144 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-ee73626b-c01c-4251-aef7-f4f2b6b53d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:10.998462 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3435c-7c62-4d84-9130-367554470349 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:11.033404 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 171/341] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:18:11.036601 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fdb8b7-b2d9-4c87-8a16-5e67893f15b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:11.037720 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fdb8b7-b2d9-4c87-8a16-5e67893f15b4 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:11.038220 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fdb8b7-b2d9-4c87-8a16-5e67893f15b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:11.038723 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fdb8b7-b2d9-4c87-8a16-5e67893f15b4 None admin] PATH_INFO: `/v3/projects/067e263bb06c40a4a0e9fe2adf525073` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:11.040113 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fdb8b7-b2d9-4c87-8a16-5e67893f15b4 None admin] RBAC: Authorizing `identity:get_project(project_id=067e263bb06c40a4a0e9fe2adf525073)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:11.041757 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fdb8b7-b2d9-4c87-8a16-5e67893f15b4 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:11.044057 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 171/342] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:18:10 2022] GET /identity/v3/projects/067e263bb06c40a4a0e9fe2adf525073 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:11.049733 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73626b-c01c-4251-aef7-f4f2b6b53d79 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:11.060754 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33472690-b9bd-4f63-a094-50c7258f3ae5 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:11.061341 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33472690-b9bd-4f63-a094-50c7258f3ae5 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:11.061817 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33472690-b9bd-4f63-a094-50c7258f3ae5 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:11.063968 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 172/343] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:18:11.066556 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33472690-b9bd-4f63-a094-50c7258f3ae5 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:11.172550 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33472690-b9bd-4f63-a094-50c7258f3ae5 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:11.208846 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bfd1d7-94a6-45fd-a61b-7f69ac9b5eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:11.209985 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfd1d7-94a6-45fd-a61b-7f69ac9b5eab None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:11.210464 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfd1d7-94a6-45fd-a61b-7f69ac9b5eab None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:11.210808 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73626b-c01c-4251-aef7-f4f2b6b53d79 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:11.211215 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfd1d7-94a6-45fd-a61b-7f69ac9b5eab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:11.222259 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bfd1d7-94a6-45fd-a61b-7f69ac9b5eab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:18:11.229828 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-e2bfd1d7-94a6-45fd-a61b-7f69ac9b5eab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 10:18:11.231739 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 173/344] 10.222.0.21 () {56 vars in 1114 bytes} [Mon Feb 28 10:18:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:11.233236 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16165f-224e-46dd-94c4-b694170193ef None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:11.233747 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16165f-224e-46dd-94c4-b694170193ef None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:11.234226 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16165f-224e-46dd-94c4-b694170193ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:11.251437 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-4d16165f-224e-46dd-94c4-b694170193ef None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:11.252904 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-4d16165f-224e-46dd-94c4-b694170193ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:11.289711 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134467bb-a31d-45b8-8a06-a3178b1a28d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:11.290652 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134467bb-a31d-45b8-8a06-a3178b1a28d4 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:11.290936 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134467bb-a31d-45b8-8a06-a3178b1a28d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:11.291208 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134467bb-a31d-45b8-8a06-a3178b1a28d4 None admin] PATH_INFO: `/v3/groups/07aaeb66ccf144f6a1e1f7b5d1692a47` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:11.301522 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134467bb-a31d-45b8-8a06-a3178b1a28d4 None admin] RBAC: Authorizing `identity:get_group(group_id=07aaeb66ccf144f6a1e1f7b5d1692a47)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:11.303005 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134467bb-a31d-45b8-8a06-a3178b1a28d4 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:11.305244 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 172/345] 10.222.0.21 () {56 vars in 1180 bytes} [Mon Feb 28 10:18:11 2022] GET /identity/v3/groups/07aaeb66ccf144f6a1e1f7b5d1692a47 => generated 226 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:11.306152 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134467bb-a31d-45b8-8a06-a3178b1a28d4 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:11.331300 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 174/346] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:18:11.332997 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44de50-2cdd-4923-bb2d-6231aa16ae32 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:11.333291 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44de50-2cdd-4923-bb2d-6231aa16ae32 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:11.333617 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44de50-2cdd-4923-bb2d-6231aa16ae32 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:11.339642 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 175/347] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:18:11.341309 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff44de50-2cdd-4923-bb2d-6231aa16ae32 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:11.444329 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134467bb-a31d-45b8-8a06-a3178b1a28d4 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:11.451364 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff44de50-2cdd-4923-bb2d-6231aa16ae32 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:11.479857 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27560ba4-e1b1-4be7-a11a-81c934e80fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:11.480533 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27560ba4-e1b1-4be7-a11a-81c934e80fc1 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:11.480811 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27560ba4-e1b1-4be7-a11a-81c934e80fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:11.481166 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27560ba4-e1b1-4be7-a11a-81c934e80fc1 None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:11.482531 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27560ba4-e1b1-4be7-a11a-81c934e80fc1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:11.482851 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27560ba4-e1b1-4be7-a11a-81c934e80fc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:11.484459 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27560ba4-e1b1-4be7-a11a-81c934e80fc1 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:11.486784 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3ee3c-69b6-4c9f-81a6-e7106c9a722a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:11.487480 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3ee3c-69b6-4c9f-81a6-e7106c9a722a None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:11.487761 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3ee3c-69b6-4c9f-81a6-e7106c9a722a None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:11.488087 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3ee3c-69b6-4c9f-81a6-e7106c9a722a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:11.488951 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa3ee3c-69b6-4c9f-81a6-e7106c9a722a None admin] RBAC: Adding query filter params (group.id=07aaeb66ccf144f6a1e1f7b5d1692a47, role.id=1c79fcc5aeef4042aa382ec20f77f7b9, scope.project.id=067e263bb06c40a4a0e9fe2adf525073) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:11.489271 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa3ee3c-69b6-4c9f-81a6-e7106c9a722a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:11.490780 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa3ee3c-69b6-4c9f-81a6-e7106c9a722a None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:11.493279 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 173/348] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:18:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:11.494588 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca443c90-8bb9-465e-9e69-2584a8d0696f None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:11.494908 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca443c90-8bb9-465e-9e69-2584a8d0696f None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:11.495184 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca443c90-8bb9-465e-9e69-2584a8d0696f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:11.497214 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 176/349] 10.222.0.21 () {56 vars in 1376 bytes} [Mon Feb 28 10:18:11 2022] GET /identity/v3/role_assignments?group.id=07aaeb66ccf144f6a1e1f7b5d1692a47&scope.project.id=067e263bb06c40a4a0e9fe2adf525073&role.id=1c79fcc5aeef4042aa382ec20f77f7b9 => generated 260 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:11.498153 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3ee3c-69b6-4c9f-81a6-e7106c9a722a None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:11.520500 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-ca443c90-8bb9-465e-9e69-2584a8d0696f None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:11.521771 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-ca443c90-8bb9-465e-9e69-2584a8d0696f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:11.601243 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 174/350] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:18:11.602035 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca443c90-8bb9-465e-9e69-2584a8d0696f None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:11.607332 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3ee3c-69b6-4c9f-81a6-e7106c9a722a None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:11.644884 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c841bc-fa60-4c2b-babd-5305a78b898a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:11.645711 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c841bc-fa60-4c2b-babd-5305a78b898a None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:11.646029 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c841bc-fa60-4c2b-babd-5305a78b898a None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:11.646310 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c841bc-fa60-4c2b-babd-5305a78b898a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:11.678736 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c841bc-fa60-4c2b-babd-5305a78b898a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:18:11.690920 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-d6c841bc-fa60-4c2b-babd-5305a78b898a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 28 10:18:11.693129 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 177/351] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:18:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:11.698224 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c841bc-fa60-4c2b-babd-5305a78b898a None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:11.800338 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca443c90-8bb9-465e-9e69-2584a8d0696f None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:11.857164 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a7c4e3-2496-4e69-bb4b-6fcf5d95ad27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:11.857749 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7c4e3-2496-4e69-bb4b-6fcf5d95ad27 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:11.858032 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7c4e3-2496-4e69-bb4b-6fcf5d95ad27 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:11.858318 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7c4e3-2496-4e69-bb4b-6fcf5d95ad27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:11.878885 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c841bc-fa60-4c2b-babd-5305a78b898a None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:11.915122 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa1cd8-21b9-4df8-85a1-7dc973589e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:11.915918 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa1cd8-21b9-4df8-85a1-7dc973589e71 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:11.916198 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa1cd8-21b9-4df8-85a1-7dc973589e71 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:11.916469 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa1cd8-21b9-4df8-85a1-7dc973589e71 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:11.928226 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aa1cd8-21b9-4df8-85a1-7dc973589e71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:18:11.930504 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a7c4e3-2496-4e69-bb4b-6fcf5d95ad27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:11.932012 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a7c4e3-2496-4e69-bb4b-6fcf5d95ad27 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:11.936899 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-33aa1cd8-21b9-4df8-85a1-7dc973589e71 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 10:18:11.938724 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 178/352] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:18:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:11.939598 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa1cd8-21b9-4df8-85a1-7dc973589e71 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:12.037074 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 175/353] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:18:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:18:12.037934 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a7c4e3-2496-4e69-bb4b-6fcf5d95ad27 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:12.050589 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa1cd8-21b9-4df8-85a1-7dc973589e71 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:12.087473 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35667989-f53d-43f8-ace5-4f8428d528be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:12.088147 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35667989-f53d-43f8-ace5-4f8428d528be None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:12.088428 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35667989-f53d-43f8-ace5-4f8428d528be None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:12.088701 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35667989-f53d-43f8-ace5-4f8428d528be None admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:12.089440 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35667989-f53d-43f8-ace5-4f8428d528be None admin] RBAC: Adding query filter params (name=reader) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:12.089744 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35667989-f53d-43f8-ace5-4f8428d528be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:12.091244 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35667989-f53d-43f8-ace5-4f8428d528be None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:12.100166 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 179/354] 10.222.0.21 () {56 vars in 1101 bytes} [Mon Feb 28 10:18:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:12.100987 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35667989-f53d-43f8-ace5-4f8428d528be None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:12.138101 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a7c4e3-2496-4e69-bb4b-6fcf5d95ad27 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:12.175657 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614ed51-de49-4282-bc22-a8a9feb5152f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:12.176339 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614ed51-de49-4282-bc22-a8a9feb5152f None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:12.176613 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614ed51-de49-4282-bc22-a8a9feb5152f None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:12.176891 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614ed51-de49-4282-bc22-a8a9feb5152f None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:12.177642 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3614ed51-de49-4282-bc22-a8a9feb5152f None admin] RBAC: Adding query filter params (name=member) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:12.177946 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3614ed51-de49-4282-bc22-a8a9feb5152f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:12.179376 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3614ed51-de49-4282-bc22-a8a9feb5152f None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:12.189916 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 176/355] 10.222.0.21 () {56 vars in 1101 bytes} [Mon Feb 28 10:18:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:12.190842 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614ed51-de49-4282-bc22-a8a9feb5152f None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:12.218179 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35667989-f53d-43f8-ace5-4f8428d528be None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:12.255918 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90707595-96ee-424e-9e06-7e9e94ce9851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:12.256833 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90707595-96ee-424e-9e06-7e9e94ce9851 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:12.257115 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90707595-96ee-424e-9e06-7e9e94ce9851 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:12.257385 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90707595-96ee-424e-9e06-7e9e94ce9851 None admin] PATH_INFO: `/v3/projects/067e263bb06c40a4a0e9fe2adf525073` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:12.259014 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90707595-96ee-424e-9e06-7e9e94ce9851 None admin] RBAC: Authorizing `identity:get_project(project_id=067e263bb06c40a4a0e9fe2adf525073)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:12.261461 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90707595-96ee-424e-9e06-7e9e94ce9851 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:12.263812 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 180/356] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:18:12 2022] GET /identity/v3/projects/067e263bb06c40a4a0e9fe2adf525073 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:12.264655 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90707595-96ee-424e-9e06-7e9e94ce9851 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:12.295399 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614ed51-de49-4282-bc22-a8a9feb5152f None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:12.330059 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de84874-f4d4-4f08-b605-5621d74843b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:12.330955 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de84874-f4d4-4f08-b605-5621d74843b1 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:12.331239 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de84874-f4d4-4f08-b605-5621d74843b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:12.331512 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de84874-f4d4-4f08-b605-5621d74843b1 None admin] PATH_INFO: `/v3/users/ffe7f32e41a84203a24ff170bc7aa2b2` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:12.332729 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de84874-f4d4-4f08-b605-5621d74843b1 None admin] RBAC: Authorizing `identity:get_user(user_id=ffe7f32e41a84203a24ff170bc7aa2b2)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:12.334166 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de84874-f4d4-4f08-b605-5621d74843b1 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:12.336179 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 177/357] 10.222.0.21 () {56 vars in 1177 bytes} [Mon Feb 28 10:18:12 2022] GET /identity/v3/users/ffe7f32e41a84203a24ff170bc7aa2b2 => generated 293 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:12.336959 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de84874-f4d4-4f08-b605-5621d74843b1 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:12.384959 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90707595-96ee-424e-9e06-7e9e94ce9851 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:12.427948 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff295552-022e-4151-aac6-6334ececf7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:12.428570 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff295552-022e-4151-aac6-6334ececf7a7 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:12.428833 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff295552-022e-4151-aac6-6334ececf7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:12.429187 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff295552-022e-4151-aac6-6334ececf7a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:12.438962 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de84874-f4d4-4f08-b605-5621d74843b1 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:12.473543 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f191c2c-9adc-41db-895f-ba0e2ded661f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:12.474394 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f191c2c-9adc-41db-895f-ba0e2ded661f None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:12.474702 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f191c2c-9adc-41db-895f-ba0e2ded661f None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:12.474978 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f191c2c-9adc-41db-895f-ba0e2ded661f None admin] PATH_INFO: `/v3/groups/07aaeb66ccf144f6a1e1f7b5d1692a47` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:12.476137 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f191c2c-9adc-41db-895f-ba0e2ded661f None admin] RBAC: Authorizing `identity:get_group(group_id=07aaeb66ccf144f6a1e1f7b5d1692a47)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:12.477576 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f191c2c-9adc-41db-895f-ba0e2ded661f None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:12.479568 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 178/358] 10.222.0.21 () {56 vars in 1180 bytes} [Mon Feb 28 10:18:12 2022] GET /identity/v3/groups/07aaeb66ccf144f6a1e1f7b5d1692a47 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:12.480441 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f191c2c-9adc-41db-895f-ba0e2ded661f None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:12.500788 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff295552-022e-4151-aac6-6334ececf7a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:12.502290 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff295552-022e-4151-aac6-6334ececf7a7 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:12.581351 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f191c2c-9adc-41db-895f-ba0e2ded661f None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:12.603791 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 181/359] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:18:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:18:12.605257 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035af8e7-7e81-4c0c-a23f-2ffa9918c583 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:12.605545 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035af8e7-7e81-4c0c-a23f-2ffa9918c583 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:12.605819 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035af8e7-7e81-4c0c-a23f-2ffa9918c583 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:12.612047 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 182/360] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:18:12.612812 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035af8e7-7e81-4c0c-a23f-2ffa9918c583 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:12.615650 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03028228-978f-4c07-80be-f2c31dfb0872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:12.616372 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03028228-978f-4c07-80be-f2c31dfb0872 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:12.616657 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03028228-978f-4c07-80be-f2c31dfb0872 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:12.616934 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03028228-978f-4c07-80be-f2c31dfb0872 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:12.617757 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03028228-978f-4c07-80be-f2c31dfb0872 None admin] RBAC: Adding query filter params (role.id=86661077994d4bb6b80bab41d2f2c953, user.id=ffe7f32e41a84203a24ff170bc7aa2b2, scope.system=all) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:12.618067 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03028228-978f-4c07-80be-f2c31dfb0872 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:12.619521 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03028228-978f-4c07-80be-f2c31dfb0872 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:12.632585 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 179/361] 10.222.0.21 () {56 vars in 1308 bytes} [Mon Feb 28 10:18:12 2022] GET /identity/v3/role_assignments?user.id=ffe7f32e41a84203a24ff170bc7aa2b2&scope.system=all&role.id=86661077994d4bb6b80bab41d2f2c953 => generated 510 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:12.634567 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03028228-978f-4c07-80be-f2c31dfb0872 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:12.758296 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035af8e7-7e81-4c0c-a23f-2ffa9918c583 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:12.759298 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03028228-978f-4c07-80be-f2c31dfb0872 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:12.797724 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59997a-3b34-4a39-93a8-b3799a0f45d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:12.798396 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59997a-3b34-4a39-93a8-b3799a0f45d8 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:12.798721 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59997a-3b34-4a39-93a8-b3799a0f45d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:12.799001 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59997a-3b34-4a39-93a8-b3799a0f45d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:12.799836 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b59997a-3b34-4a39-93a8-b3799a0f45d8 None admin] RBAC: Adding query filter params (group.id=07aaeb66ccf144f6a1e1f7b5d1692a47, role.id=101ea48f12324cee9b597825e21f34b4, scope.project.id=067e263bb06c40a4a0e9fe2adf525073) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:12.800145 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b59997a-3b34-4a39-93a8-b3799a0f45d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:12.802638 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b59997a-3b34-4a39-93a8-b3799a0f45d8 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:12.803280 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1caa084-8dc8-4426-809d-0a7bdc8c7b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:12.804140 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1caa084-8dc8-4426-809d-0a7bdc8c7b1f None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:12.804414 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1caa084-8dc8-4426-809d-0a7bdc8c7b1f None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:12.804910 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1caa084-8dc8-4426-809d-0a7bdc8c7b1f None admin] PATH_INFO: `/v3/projects/6ddffcb5f354434d9e960ae5d51d1a95` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:12.806680 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1caa084-8dc8-4426-809d-0a7bdc8c7b1f None admin] RBAC: Authorizing `identity:get_project(project_id=6ddffcb5f354434d9e960ae5d51d1a95)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:12.808432 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1caa084-8dc8-4426-809d-0a7bdc8c7b1f None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:12.809047 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 183/362] 10.222.0.21 () {56 vars in 1376 bytes} [Mon Feb 28 10:18:12 2022] GET /identity/v3/role_assignments?group.id=07aaeb66ccf144f6a1e1f7b5d1692a47&scope.project.id=067e263bb06c40a4a0e9fe2adf525073&role.id=101ea48f12324cee9b597825e21f34b4 => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:12.811325 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 180/363] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:18:12 2022] GET /identity/v3/projects/6ddffcb5f354434d9e960ae5d51d1a95 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:12.812246 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973473e5-579d-49ad-9173-696d404c318a None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:12.812535 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973473e5-579d-49ad-9173-696d404c318a None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:12.812693 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71eb83c-a4e0-4926-9a29-21e02feffd93 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:12.812862 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973473e5-579d-49ad-9173-696d404c318a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:12.813007 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71eb83c-a4e0-4926-9a29-21e02feffd93 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:12.813165 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71eb83c-a4e0-4926-9a29-21e02feffd93 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:12.815099 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 181/364] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:18:12.820449 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71eb83c-a4e0-4926-9a29-21e02feffd93 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:12.834033 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-973473e5-579d-49ad-9173-696d404c318a None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:12.835338 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-973473e5-579d-49ad-9173-696d404c318a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:12.916403 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 184/365] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:18:12.917922 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316032d-6716-4d68-9d83-92486e5936f1 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:12.918214 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316032d-6716-4d68-9d83-92486e5936f1 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:12.918491 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316032d-6716-4d68-9d83-92486e5936f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:12.944148 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-5316032d-6716-4d68-9d83-92486e5936f1 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:12.945367 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-5316032d-6716-4d68-9d83-92486e5936f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:12.976644 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71eb83c-a4e0-4926-9a29-21e02feffd93 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:13.017260 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea6341-6dc7-43c5-b537-ba7e5d762e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:13.018086 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea6341-6dc7-43c5-b537-ba7e5d762e35 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:13.018371 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea6341-6dc7-43c5-b537-ba7e5d762e35 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:13.018685 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea6341-6dc7-43c5-b537-ba7e5d762e35 None admin] PATH_INFO: `/v3/groups/07aaeb66ccf144f6a1e1f7b5d1692a47` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:13.019974 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eea6341-6dc7-43c5-b537-ba7e5d762e35 None admin] RBAC: Authorizing `identity:get_group(group_id=07aaeb66ccf144f6a1e1f7b5d1692a47)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:13.021587 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eea6341-6dc7-43c5-b537-ba7e5d762e35 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:13.024687 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 182/366] 10.222.0.21 () {56 vars in 1180 bytes} [Mon Feb 28 10:18:12 2022] GET /identity/v3/groups/07aaeb66ccf144f6a1e1f7b5d1692a47 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:13.025562 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea6341-6dc7-43c5-b537-ba7e5d762e35 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:13.039219 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 185/367] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:18:13.040788 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316032d-6716-4d68-9d83-92486e5936f1 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:13.157375 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea6341-6dc7-43c5-b537-ba7e5d762e35 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:13.175637 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316032d-6716-4d68-9d83-92486e5936f1 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:13.198257 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294852f-4771-4b6f-b3a7-63e2fa00c24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:13.199102 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294852f-4771-4b6f-b3a7-63e2fa00c24b None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:13.199382 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294852f-4771-4b6f-b3a7-63e2fa00c24b None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:13.199652 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294852f-4771-4b6f-b3a7-63e2fa00c24b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:13.211901 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8294852f-4771-4b6f-b3a7-63e2fa00c24b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:18:13.219477 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-8294852f-4771-4b6f-b3a7-63e2fa00c24b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 10:18:13.220757 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 183/368] 10.222.0.21 () {56 vars in 1114 bytes} [Mon Feb 28 10:18:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:13.221546 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294852f-4771-4b6f-b3a7-63e2fa00c24b None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:13.342568 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbffb7f-2954-4fef-aea9-04ffbbbed26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:13.343430 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbffb7f-2954-4fef-aea9-04ffbbbed26f None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:13.343897 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbffb7f-2954-4fef-aea9-04ffbbbed26f None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:13.344330 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbffb7f-2954-4fef-aea9-04ffbbbed26f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:13.345310 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbffb7f-2954-4fef-aea9-04ffbbbed26f None admin] RBAC: Adding query filter params (group.id=07aaeb66ccf144f6a1e1f7b5d1692a47, role.id=1c79fcc5aeef4042aa382ec20f77f7b9, scope.project.id=6ddffcb5f354434d9e960ae5d51d1a95) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:13.345765 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbffb7f-2954-4fef-aea9-04ffbbbed26f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:13.346261 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294852f-4771-4b6f-b3a7-63e2fa00c24b None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:13.347569 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbffb7f-2954-4fef-aea9-04ffbbbed26f None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:13.354247 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 186/369] 10.222.0.21 () {56 vars in 1376 bytes} [Mon Feb 28 10:18:13 2022] GET /identity/v3/role_assignments?group.id=07aaeb66ccf144f6a1e1f7b5d1692a47&scope.project.id=6ddffcb5f354434d9e960ae5d51d1a95&role.id=1c79fcc5aeef4042aa382ec20f77f7b9 => generated 260 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:13.355444 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbffb7f-2954-4fef-aea9-04ffbbbed26f None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:13.408725 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52625240-f152-4a83-b15a-c3b2908db446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:13.410795 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52625240-f152-4a83-b15a-c3b2908db446 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:13.411684 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52625240-f152-4a83-b15a-c3b2908db446 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:13.412799 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52625240-f152-4a83-b15a-c3b2908db446 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:13.437700 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52625240-f152-4a83-b15a-c3b2908db446 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:18:13.447333 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-52625240-f152-4a83-b15a-c3b2908db446 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:18:13.468527 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 184/370] 10.222.0.21 () {56 vars in 1096 bytes} [Mon Feb 28 10:18:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:13.468527 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52625240-f152-4a83-b15a-c3b2908db446 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:13.544961 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbffb7f-2954-4fef-aea9-04ffbbbed26f None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:13.604553 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03805949-d273-4e20-87bb-d3d220eda736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:13.605142 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03805949-d273-4e20-87bb-d3d220eda736 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:13.605417 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03805949-d273-4e20-87bb-d3d220eda736 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:13.605685 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03805949-d273-4e20-87bb-d3d220eda736 None admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:13.606996 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03805949-d273-4e20-87bb-d3d220eda736 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:13.607301 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03805949-d273-4e20-87bb-d3d220eda736 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:13.608659 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03805949-d273-4e20-87bb-d3d220eda736 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:13.620268 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 187/371] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:18:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:13.626192 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03805949-d273-4e20-87bb-d3d220eda736 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:13.649902 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52625240-f152-4a83-b15a-c3b2908db446 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:13.718370 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f18c4-c0ba-4862-89f2-def8392601ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:13.719320 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f18c4-c0ba-4862-89f2-def8392601ce None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:13.719763 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f18c4-c0ba-4862-89f2-def8392601ce None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:13.720174 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f18c4-c0ba-4862-89f2-def8392601ce None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:13.721045 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f18c4-c0ba-4862-89f2-def8392601ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:13.721498 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f18c4-c0ba-4862-89f2-def8392601ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:13.723025 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f18c4-c0ba-4862-89f2-def8392601ce None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:13.732266 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 185/372] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:18:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:13.737752 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f18c4-c0ba-4862-89f2-def8392601ce None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:13.821610 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03805949-d273-4e20-87bb-d3d220eda736 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:13.875046 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d3597-16d3-493e-b8b2-0718da45beff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:13.876053 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d3597-16d3-493e-b8b2-0718da45beff None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:13.876927 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d3597-16d3-493e-b8b2-0718da45beff None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:13.877406 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d3597-16d3-493e-b8b2-0718da45beff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:13.907840 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f18c4-c0ba-4862-89f2-def8392601ce None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:13.954664 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d3597-16d3-493e-b8b2-0718da45beff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:13.955626 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b76f2-7941-4b2a-9dc6-7493b244b1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:13.956116 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d3597-16d3-493e-b8b2-0718da45beff None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:13.956745 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b76f2-7941-4b2a-9dc6-7493b244b1c2 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:13.957227 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b76f2-7941-4b2a-9dc6-7493b244b1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:13.957698 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b76f2-7941-4b2a-9dc6-7493b244b1c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:14.036079 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b76f2-7941-4b2a-9dc6-7493b244b1c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:14.037898 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b76f2-7941-4b2a-9dc6-7493b244b1c2 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:14.102788 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 188/373] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:18:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:18:14.109118 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d3597-16d3-493e-b8b2-0718da45beff None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:14.142797 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 186/374] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:18:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Feb 28 10:18:14.145402 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b76f2-7941-4b2a-9dc6-7493b244b1c2 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:14.248100 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b76f2-7941-4b2a-9dc6-7493b244b1c2 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:14.285769 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232f93b-dbef-4e33-933a-6817963ad003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:14.286641 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232f93b-dbef-4e33-933a-6817963ad003 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:14.286931 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232f93b-dbef-4e33-933a-6817963ad003 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:14.287211 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232f93b-dbef-4e33-933a-6817963ad003 None admin] PATH_INFO: `/v3/projects/e5bfe7c1c3cf44edb4e5e5f5ea06d32a` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:14.290983 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232f93b-dbef-4e33-933a-6817963ad003 None admin] RBAC: Authorizing `identity:get_project(project_id=e5bfe7c1c3cf44edb4e5e5f5ea06d32a)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:14.292688 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232f93b-dbef-4e33-933a-6817963ad003 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:14.295112 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 187/375] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:18:14 2022] GET /identity/v3/projects/e5bfe7c1c3cf44edb4e5e5f5ea06d32a => generated 344 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:14.300646 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232f93b-dbef-4e33-933a-6817963ad003 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:14.322587 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d3597-16d3-493e-b8b2-0718da45beff None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:14.406588 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232f93b-dbef-4e33-933a-6817963ad003 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:14.411301 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b74aee-c44f-4811-8820-c770861d3dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:14.412166 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b74aee-c44f-4811-8820-c770861d3dab None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:14.412443 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b74aee-c44f-4811-8820-c770861d3dab None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:14.412709 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b74aee-c44f-4811-8820-c770861d3dab None admin] PATH_INFO: `/v3/projects/6ddffcb5f354434d9e960ae5d51d1a95` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:14.414137 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b74aee-c44f-4811-8820-c770861d3dab None admin] RBAC: Authorizing `identity:get_project(project_id=6ddffcb5f354434d9e960ae5d51d1a95)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:14.415748 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b74aee-c44f-4811-8820-c770861d3dab None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:14.417583 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 189/376] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:18:14 2022] GET /identity/v3/projects/6ddffcb5f354434d9e960ae5d51d1a95 => generated 302 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:18:14.424236 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b74aee-c44f-4811-8820-c770861d3dab None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:14.449500 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8f3bb-1fff-493b-b19f-0b20debf046c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:14.450551 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8f3bb-1fff-493b-b19f-0b20debf046c None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:14.450857 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8f3bb-1fff-493b-b19f-0b20debf046c None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:14.451134 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8f3bb-1fff-493b-b19f-0b20debf046c None admin] PATH_INFO: `/v3/groups/a24623174aee4b259ca2cfbfe437e7e7` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:14.462351 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be8f3bb-1fff-493b-b19f-0b20debf046c None admin] RBAC: Authorizing `identity:get_group(group_id=a24623174aee4b259ca2cfbfe437e7e7)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:14.463867 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be8f3bb-1fff-493b-b19f-0b20debf046c None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:14.470838 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 188/377] 10.222.0.21 () {56 vars in 1180 bytes} [Mon Feb 28 10:18:14 2022] GET /identity/v3/groups/a24623174aee4b259ca2cfbfe437e7e7 => generated 229 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:14.476086 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8f3bb-1fff-493b-b19f-0b20debf046c None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:14.574141 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b74aee-c44f-4811-8820-c770861d3dab None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:14.600812 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8f3bb-1fff-493b-b19f-0b20debf046c None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:14.611424 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5efba60-ab87-4137-be6a-a3c2354d0cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:14.612593 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efba60-ab87-4137-be6a-a3c2354d0cb3 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:14.613099 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efba60-ab87-4137-be6a-a3c2354d0cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:14.613570 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efba60-ab87-4137-be6a-a3c2354d0cb3 None admin] PATH_INFO: `/v3/groups/07aaeb66ccf144f6a1e1f7b5d1692a47` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:14.615725 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5efba60-ab87-4137-be6a-a3c2354d0cb3 None admin] RBAC: Authorizing `identity:get_group(group_id=07aaeb66ccf144f6a1e1f7b5d1692a47)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:14.617398 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5efba60-ab87-4137-be6a-a3c2354d0cb3 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:14.619613 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 190/378] 10.222.0.21 () {56 vars in 1180 bytes} [Mon Feb 28 10:18:14 2022] GET /identity/v3/groups/07aaeb66ccf144f6a1e1f7b5d1692a47 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:18:14.634083 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5efba60-ab87-4137-be6a-a3c2354d0cb3 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:14.642175 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e028752-e4ff-435d-bcb9-8b9d56ffb162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:14.642861 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e028752-e4ff-435d-bcb9-8b9d56ffb162 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:14.643141 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e028752-e4ff-435d-bcb9-8b9d56ffb162 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:14.643412 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e028752-e4ff-435d-bcb9-8b9d56ffb162 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:14.644233 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e028752-e4ff-435d-bcb9-8b9d56ffb162 None admin] RBAC: Adding query filter params (group.id=a24623174aee4b259ca2cfbfe437e7e7, role.id=48e4608a7b3f4b87a20b10c4d1b45aa9, scope.project.id=e5bfe7c1c3cf44edb4e5e5f5ea06d32a) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:14.644538 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e028752-e4ff-435d-bcb9-8b9d56ffb162 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:14.646387 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e028752-e4ff-435d-bcb9-8b9d56ffb162 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:14.658702 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 189/379] 10.222.0.21 () {56 vars in 1376 bytes} [Mon Feb 28 10:18:14 2022] GET /identity/v3/role_assignments?group.id=a24623174aee4b259ca2cfbfe437e7e7&scope.project.id=e5bfe7c1c3cf44edb4e5e5f5ea06d32a&role.id=48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:18:14.752434 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5efba60-ab87-4137-be6a-a3c2354d0cb3 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:14.789269 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc1b13e-0ac8-45fd-98c7-c22a00438928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:14.789935 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1b13e-0ac8-45fd-98c7-c22a00438928 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:14.790212 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1b13e-0ac8-45fd-98c7-c22a00438928 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:14.790479 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1b13e-0ac8-45fd-98c7-c22a00438928 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:14.791331 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc1b13e-0ac8-45fd-98c7-c22a00438928 None admin] RBAC: Adding query filter params (group.id=07aaeb66ccf144f6a1e1f7b5d1692a47, role.id=101ea48f12324cee9b597825e21f34b4, scope.project.id=6ddffcb5f354434d9e960ae5d51d1a95) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:14.791771 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc1b13e-0ac8-45fd-98c7-c22a00438928 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:14.793212 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc1b13e-0ac8-45fd-98c7-c22a00438928 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:14.800444 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 191/380] 10.222.0.21 () {56 vars in 1376 bytes} [Mon Feb 28 10:18:14 2022] GET /identity/v3/role_assignments?group.id=07aaeb66ccf144f6a1e1f7b5d1692a47&scope.project.id=6ddffcb5f354434d9e960ae5d51d1a95&role.id=101ea48f12324cee9b597825e21f34b4 => generated 260 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:18:15.209238 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b6796-56b7-4bf3-baa7-b30a994b9a12 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:15.209563 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b6796-56b7-4bf3-baa7-b30a994b9a12 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:15.209799 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b6796-56b7-4bf3-baa7-b30a994b9a12 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:15.211862 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 190/381] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:18:15.217380 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ab3b1-264a-4774-8fec-a92ecf6764bb None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:15.217921 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ab3b1-264a-4774-8fec-a92ecf6764bb None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:15.218391 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ab3b1-264a-4774-8fec-a92ecf6764bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:15.236591 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-8b1ab3b1-264a-4774-8fec-a92ecf6764bb None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:15.238079 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-8b1ab3b1-264a-4774-8fec-a92ecf6764bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:15.321443 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 192/382] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:18:15.353927 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b6796-56b7-4bf3-baa7-b30a994b9a12 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:15.469295 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b6796-56b7-4bf3-baa7-b30a994b9a12 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:15.509126 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7cc1d8-48f9-4976-b9a5-8a3bf8ea8d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:15.510327 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7cc1d8-48f9-4976-b9a5-8a3bf8ea8d8c None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:15.510851 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7cc1d8-48f9-4976-b9a5-8a3bf8ea8d8c None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:15.511318 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7cc1d8-48f9-4976-b9a5-8a3bf8ea8d8c None admin] PATH_INFO: `/v3/roles/member` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:15.523927 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7cc1d8-48f9-4976-b9a5-8a3bf8ea8d8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:18:15.531832 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-bf7cc1d8-48f9-4976-b9a5-8a3bf8ea8d8c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 10:18:15.533258 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 191/383] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:18:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:15.539295 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ab3b1-264a-4774-8fec-a92ecf6764bb None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:15.667903 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ab3b1-264a-4774-8fec-a92ecf6764bb None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:15.717292 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a01086-6a23-44d1-bba7-af28a718da26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:15.717961 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a01086-6a23-44d1-bba7-af28a718da26 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:15.718238 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a01086-6a23-44d1-bba7-af28a718da26 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:15.718511 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a01086-6a23-44d1-bba7-af28a718da26 None admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:15.719283 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a01086-6a23-44d1-bba7-af28a718da26 None admin] RBAC: Adding query filter params (name=member) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:15.719640 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a01086-6a23-44d1-bba7-af28a718da26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:15.720946 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a01086-6a23-44d1-bba7-af28a718da26 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:15.729518 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 193/384] 10.222.0.21 () {56 vars in 1101 bytes} [Mon Feb 28 10:18:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:15.735194 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7cc1d8-48f9-4976-b9a5-8a3bf8ea8d8c None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:15.899077 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7cc1d8-48f9-4976-b9a5-8a3bf8ea8d8c None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:15.945235 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee2581-3e4b-41d3-b82c-97bed2830d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:15.946842 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee2581-3e4b-41d3-b82c-97bed2830d24 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:15.947337 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee2581-3e4b-41d3-b82c-97bed2830d24 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:15.947826 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee2581-3e4b-41d3-b82c-97bed2830d24 None admin] PATH_INFO: `/v3/groups/07aaeb66ccf144f6a1e1f7b5d1692a47` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:15.951353 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee2581-3e4b-41d3-b82c-97bed2830d24 None admin] RBAC: Authorizing `identity:get_group(group_id=07aaeb66ccf144f6a1e1f7b5d1692a47)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:15.953020 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee2581-3e4b-41d3-b82c-97bed2830d24 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:15.954921 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 192/385] 10.222.0.21 () {56 vars in 1180 bytes} [Mon Feb 28 10:18:15 2022] GET /identity/v3/groups/07aaeb66ccf144f6a1e1f7b5d1692a47 => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:15.960495 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a01086-6a23-44d1-bba7-af28a718da26 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:16.024945 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725cfcb-7115-4a08-9128-3907a45005a6 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:16.025546 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725cfcb-7115-4a08-9128-3907a45005a6 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:16.026017 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725cfcb-7115-4a08-9128-3907a45005a6 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:16.028767 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 193/386] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:18:16.034114 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16dea7-68a7-4327-9953-27d50389a5b2 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:16.034691 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16dea7-68a7-4327-9953-27d50389a5b2 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:16.035167 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16dea7-68a7-4327-9953-27d50389a5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:16.067621 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-ef16dea7-68a7-4327-9953-27d50389a5b2 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:16.069203 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-ef16dea7-68a7-4327-9953-27d50389a5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:16.092192 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a01086-6a23-44d1-bba7-af28a718da26 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:16.136771 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339fcd7e-98aa-4113-854a-927f89c39836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:16.136771 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339fcd7e-98aa-4113-854a-927f89c39836 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:16.136771 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339fcd7e-98aa-4113-854a-927f89c39836 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:16.136771 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339fcd7e-98aa-4113-854a-927f89c39836 None admin] PATH_INFO: `/v3/projects/067e263bb06c40a4a0e9fe2adf525073` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:16.139870 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339fcd7e-98aa-4113-854a-927f89c39836 None admin] RBAC: Authorizing `identity:get_project(project_id=067e263bb06c40a4a0e9fe2adf525073)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:16.141586 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339fcd7e-98aa-4113-854a-927f89c39836 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:16.144727 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 194/387] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:18:15 2022] GET /identity/v3/projects/067e263bb06c40a4a0e9fe2adf525073 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:16.154681 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339fcd7e-98aa-4113-854a-927f89c39836 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:16.154859 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 194/388] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 10:18:16.181169 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef16dea7-68a7-4327-9953-27d50389a5b2 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:16.257733 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339fcd7e-98aa-4113-854a-927f89c39836 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:16.298352 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c37174-fd16-4e3d-9b39-34876ac46cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:16.299283 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c37174-fd16-4e3d-9b39-34876ac46cd6 None admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:16.299566 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c37174-fd16-4e3d-9b39-34876ac46cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:16.299840 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c37174-fd16-4e3d-9b39-34876ac46cd6 None admin] PATH_INFO: `/v3/projects/067e263bb06c40a4a0e9fe2adf525073/groups/07aaeb66ccf144f6a1e1f7b5d1692a47/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:16.301865 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c37174-fd16-4e3d-9b39-34876ac46cd6 None admin] RBAC: Authorizing `identity:create_grant(project_id=067e263bb06c40a4a0e9fe2adf525073, group_id=07aaeb66ccf144f6a1e1f7b5d1692a47, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:16.303329 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c37174-fd16-4e3d-9b39-34876ac46cd6 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:16.320865 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 195/389] 10.222.0.21 () {58 vars in 1442 bytes} [Mon Feb 28 10:18:16 2022] PUT /identity/v3/projects/067e263bb06c40a4a0e9fe2adf525073/groups/07aaeb66ccf144f6a1e1f7b5d1692a47/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:18:16.365605 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef16dea7-68a7-4327-9953-27d50389a5b2 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:16.399416 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ea98c-e2c1-4da6-b18c-98021d66da73 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:16.400158 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ea98c-e2c1-4da6-b18c-98021d66da73 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:16.400637 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ea98c-e2c1-4da6-b18c-98021d66da73 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:16.403382 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 196/390] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:18:16.406623 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27022a4-8079-4823-af36-fad14543776e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:16.406623 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27022a4-8079-4823-af36-fad14543776e None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:16.406623 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27022a4-8079-4823-af36-fad14543776e None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:16.406623 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27022a4-8079-4823-af36-fad14543776e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:16.410382 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdea04-51d4-404b-a0de-200fabc40ae6 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:16.410935 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdea04-51d4-404b-a0de-200fabc40ae6 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:16.411407 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdea04-51d4-404b-a0de-200fabc40ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:16.417329 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27022a4-8079-4823-af36-fad14543776e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:18:16.433126 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-a27022a4-8079-4823-af36-fad14543776e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 10:18:16.434755 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-b6bdea04-51d4-404b-a0de-200fabc40ae6 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:16.434915 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 195/391] 10.222.0.21 () {56 vars in 1114 bytes} [Mon Feb 28 10:18:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:18:16.436418 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-b6bdea04-51d4-404b-a0de-200fabc40ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:16.440974 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27022a4-8079-4823-af36-fad14543776e None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:16.526740 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 197/392] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:18:16.547034 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bdea04-51d4-404b-a0de-200fabc40ae6 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:16.558738 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27022a4-8079-4823-af36-fad14543776e None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:16.593754 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d84b6-459f-49d8-9377-1530995a0e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:16.594424 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d84b6-459f-49d8-9377-1530995a0e77 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:16.594729 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d84b6-459f-49d8-9377-1530995a0e77 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:16.594997 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d84b6-459f-49d8-9377-1530995a0e77 None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:16.595734 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d84b6-459f-49d8-9377-1530995a0e77 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:16.596085 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d84b6-459f-49d8-9377-1530995a0e77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:16.597464 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d84b6-459f-49d8-9377-1530995a0e77 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:16.610685 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 196/393] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:18:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:18:16.614619 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d84b6-459f-49d8-9377-1530995a0e77 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:16.718796 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bdea04-51d4-404b-a0de-200fabc40ae6 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:16.752273 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d84b6-459f-49d8-9377-1530995a0e77 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:16.756389 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d0012f-f7c0-4773-932a-5ff306fcd984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:16.757449 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0012f-f7c0-4773-932a-5ff306fcd984 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:16.757930 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0012f-f7c0-4773-932a-5ff306fcd984 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:16.758423 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0012f-f7c0-4773-932a-5ff306fcd984 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:16.770730 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d0012f-f7c0-4773-932a-5ff306fcd984 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:18:16.778447 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-e6d0012f-f7c0-4773-932a-5ff306fcd984 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 10:18:16.781311 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 198/394] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:18:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:16.786263 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d0012f-f7c0-4773-932a-5ff306fcd984 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:16.796582 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d8107-f81c-43b3-a657-eff1a7eb9af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:16.799198 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d8107-f81c-43b3-a657-eff1a7eb9af4 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:16.799717 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d8107-f81c-43b3-a657-eff1a7eb9af4 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:16.799994 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d8107-f81c-43b3-a657-eff1a7eb9af4 None admin] PATH_INFO: `/v3/groups/07aaeb66ccf144f6a1e1f7b5d1692a47` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:16.803363 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d8107-f81c-43b3-a657-eff1a7eb9af4 None admin] RBAC: Authorizing `identity:get_group(group_id=07aaeb66ccf144f6a1e1f7b5d1692a47)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:16.805035 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d8107-f81c-43b3-a657-eff1a7eb9af4 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:16.806997 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 197/395] 10.222.0.21 () {56 vars in 1180 bytes} [Mon Feb 28 10:18:16 2022] GET /identity/v3/groups/07aaeb66ccf144f6a1e1f7b5d1692a47 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:18:16.814185 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d8107-f81c-43b3-a657-eff1a7eb9af4 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:16.911935 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d0012f-f7c0-4773-932a-5ff306fcd984 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:16.922832 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d8107-f81c-43b3-a657-eff1a7eb9af4 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:16.947592 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57565e3a-2de9-4da3-b1ae-3f817edfbab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:16.948557 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57565e3a-2de9-4da3-b1ae-3f817edfbab5 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:16.949054 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57565e3a-2de9-4da3-b1ae-3f817edfbab5 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:16.949528 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57565e3a-2de9-4da3-b1ae-3f817edfbab5 None admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:16.950709 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57565e3a-2de9-4da3-b1ae-3f817edfbab5 None admin] RBAC: Adding query filter params (name=member) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:16.951222 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57565e3a-2de9-4da3-b1ae-3f817edfbab5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:16.952792 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57565e3a-2de9-4da3-b1ae-3f817edfbab5 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:16.960747 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae3328-32c9-403a-9604-8a1e9e9ea070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:16.961598 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae3328-32c9-403a-9604-8a1e9e9ea070 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:16.961874 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae3328-32c9-403a-9604-8a1e9e9ea070 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:16.962145 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae3328-32c9-403a-9604-8a1e9e9ea070 None admin] PATH_INFO: `/v3/projects/067e263bb06c40a4a0e9fe2adf525073` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:16.966636 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae3328-32c9-403a-9604-8a1e9e9ea070 None admin] RBAC: Authorizing `identity:get_project(project_id=067e263bb06c40a4a0e9fe2adf525073)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:16.966636 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae3328-32c9-403a-9604-8a1e9e9ea070 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:16.967135 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 199/396] 10.222.0.21 () {56 vars in 1101 bytes} [Mon Feb 28 10:18:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:18:16.967675 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 198/397] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:18:16 2022] GET /identity/v3/projects/067e263bb06c40a4a0e9fe2adf525073 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:18:16.970249 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57565e3a-2de9-4da3-b1ae-3f817edfbab5 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:16.973355 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae3328-32c9-403a-9604-8a1e9e9ea070 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:17.071499 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57565e3a-2de9-4da3-b1ae-3f817edfbab5 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:17.078253 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae3328-32c9-403a-9604-8a1e9e9ea070 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:17.107279 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba94b98-4e87-45e3-bef8-2417219c9fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:17.108490 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba94b98-4e87-45e3-bef8-2417219c9fe9 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:17.108977 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba94b98-4e87-45e3-bef8-2417219c9fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:17.109452 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba94b98-4e87-45e3-bef8-2417219c9fe9 None admin] PATH_INFO: `/v3/groups/07aaeb66ccf144f6a1e1f7b5d1692a47` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:17.110885 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba94b98-4e87-45e3-bef8-2417219c9fe9 None admin] RBAC: Authorizing `identity:get_group(group_id=07aaeb66ccf144f6a1e1f7b5d1692a47)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:17.112657 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba94b98-4e87-45e3-bef8-2417219c9fe9 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:17.115031 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 200/398] 10.222.0.21 () {56 vars in 1180 bytes} [Mon Feb 28 10:18:16 2022] GET /identity/v3/groups/07aaeb66ccf144f6a1e1f7b5d1692a47 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:17.120085 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba94b98-4e87-45e3-bef8-2417219c9fe9 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:17.120971 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce24bfa-28aa-48e0-945b-26c8c7726db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:17.122467 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce24bfa-28aa-48e0-945b-26c8c7726db1 None admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:17.124710 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce24bfa-28aa-48e0-945b-26c8c7726db1 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:17.125153 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce24bfa-28aa-48e0-945b-26c8c7726db1 None admin] PATH_INFO: `/v3/projects/067e263bb06c40a4a0e9fe2adf525073/groups/07aaeb66ccf144f6a1e1f7b5d1692a47/roles/101ea48f12324cee9b597825e21f34b4` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:17.131452 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce24bfa-28aa-48e0-945b-26c8c7726db1 None admin] RBAC: Authorizing `identity:create_grant(project_id=067e263bb06c40a4a0e9fe2adf525073, group_id=07aaeb66ccf144f6a1e1f7b5d1692a47, role_id=101ea48f12324cee9b597825e21f34b4)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:17.133184 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce24bfa-28aa-48e0-945b-26c8c7726db1 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:17.161679 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 199/399] 10.222.0.21 () {58 vars in 1442 bytes} [Mon Feb 28 10:18:16 2022] PUT /identity/v3/projects/067e263bb06c40a4a0e9fe2adf525073/groups/07aaeb66ccf144f6a1e1f7b5d1692a47/roles/101ea48f12324cee9b597825e21f34b4 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:18:17.249309 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba94b98-4e87-45e3-bef8-2417219c9fe9 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:17.293482 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16659f-75f8-4733-8732-16c559791495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:17.295977 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16659f-75f8-4733-8732-16c559791495 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:17.296507 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16659f-75f8-4733-8732-16c559791495 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:17.297003 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16659f-75f8-4733-8732-16c559791495 None admin] PATH_INFO: `/v3/projects/6ddffcb5f354434d9e960ae5d51d1a95` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:17.303583 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c16659f-75f8-4733-8732-16c559791495 None admin] RBAC: Authorizing `identity:get_project(project_id=6ddffcb5f354434d9e960ae5d51d1a95)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:17.305052 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c16659f-75f8-4733-8732-16c559791495 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:17.307295 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 201/400] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:18:17 2022] GET /identity/v3/projects/6ddffcb5f354434d9e960ae5d51d1a95 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:17.313841 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce24bfa-28aa-48e0-945b-26c8c7726db1 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:17.462563 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce24bfa-28aa-48e0-945b-26c8c7726db1 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:17.497414 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d5411e-5d42-4d9f-8fe2-a3f96d9b532c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:17.498639 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5411e-5d42-4d9f-8fe2-a3f96d9b532c None admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:17.499072 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5411e-5d42-4d9f-8fe2-a3f96d9b532c None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:17.499495 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5411e-5d42-4d9f-8fe2-a3f96d9b532c None admin] PATH_INFO: `/v3/projects/6ddffcb5f354434d9e960ae5d51d1a95/groups/07aaeb66ccf144f6a1e1f7b5d1692a47/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:17.501663 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d5411e-5d42-4d9f-8fe2-a3f96d9b532c None admin] RBAC: Authorizing `identity:create_grant(project_id=6ddffcb5f354434d9e960ae5d51d1a95, group_id=07aaeb66ccf144f6a1e1f7b5d1692a47, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:17.503465 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d5411e-5d42-4d9f-8fe2-a3f96d9b532c None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:17.522706 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 200/401] 10.222.0.21 () {58 vars in 1442 bytes} [Mon Feb 28 10:18:17 2022] PUT /identity/v3/projects/6ddffcb5f354434d9e960ae5d51d1a95/groups/07aaeb66ccf144f6a1e1f7b5d1692a47/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:18:17.732386 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de639846-058f-4bdb-9163-a05a837b3d71 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:17.732886 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de639846-058f-4bdb-9163-a05a837b3d71 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:17.732886 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de639846-058f-4bdb-9163-a05a837b3d71 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:17.734892 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 202/402] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:18:17.740459 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e63cbe-2a1a-4e80-8c44-1201c91dd6d2 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:17.741036 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e63cbe-2a1a-4e80-8c44-1201c91dd6d2 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:17.741515 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e63cbe-2a1a-4e80-8c44-1201c91dd6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:17.766087 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-02e63cbe-2a1a-4e80-8c44-1201c91dd6d2 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:17.767630 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-02e63cbe-2a1a-4e80-8c44-1201c91dd6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:17.853599 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 201/403] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:18:17.891594 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de639846-058f-4bdb-9163-a05a837b3d71 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:18.007760 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5e00d-a9c6-4ba4-afc2-aefc14e24760 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:18.008056 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5e00d-a9c6-4ba4-afc2-aefc14e24760 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:18.008222 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5e00d-a9c6-4ba4-afc2-aefc14e24760 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:18.010198 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 202/404] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:18:18.015282 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67e56e-66dd-4be6-82dc-69daccea23e4 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:18.015562 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67e56e-66dd-4be6-82dc-69daccea23e4 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:18.015831 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67e56e-66dd-4be6-82dc-69daccea23e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:18.018999 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de639846-058f-4bdb-9163-a05a837b3d71 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:18.048261 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-2e67e56e-66dd-4be6-82dc-69daccea23e4 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:18.050499 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-2e67e56e-66dd-4be6-82dc-69daccea23e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:18.091127 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a9122-fbdc-4821-95bd-286386c09c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:18.092184 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a9122-fbdc-4821-95bd-286386c09c0c None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:18.092463 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a9122-fbdc-4821-95bd-286386c09c0c None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:18.092734 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a9122-fbdc-4821-95bd-286386c09c0c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:18.123646 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7a9122-fbdc-4821-95bd-286386c09c0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:18:18.128568 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 203/405] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 10:18:18.130480 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-8e7a9122-fbdc-4821-95bd-286386c09c0c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:18:18.134919 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 203/406] 10.222.0.21 () {56 vars in 1096 bytes} [Mon Feb 28 10:18:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:18.139850 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67e56e-66dd-4be6-82dc-69daccea23e4 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:18.166173 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a9122-fbdc-4821-95bd-286386c09c0c None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:18.251918 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67e56e-66dd-4be6-82dc-69daccea23e4 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:18.288617 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa02ee-d390-440f-baec-51439cc9e7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:18.289653 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa02ee-d390-440f-baec-51439cc9e7e1 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:18.290139 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa02ee-d390-440f-baec-51439cc9e7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:18.290631 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa02ee-d390-440f-baec-51439cc9e7e1 None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:18.291601 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa02ee-d390-440f-baec-51439cc9e7e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:18.292124 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa02ee-d390-440f-baec-51439cc9e7e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:18.294723 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa02ee-d390-440f-baec-51439cc9e7e1 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:18.303911 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 204/407] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:18:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:18.309824 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa02ee-d390-440f-baec-51439cc9e7e1 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:18.323529 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a9122-fbdc-4821-95bd-286386c09c0c None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:18.379340 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa630d-03b8-478d-a2e9-977a2cf1c501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:18.380162 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa630d-03b8-478d-a2e9-977a2cf1c501 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:18.380447 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa630d-03b8-478d-a2e9-977a2cf1c501 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:18.380750 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa630d-03b8-478d-a2e9-977a2cf1c501 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:18.395753 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa630d-03b8-478d-a2e9-977a2cf1c501 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:18:18.407103 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-62fa630d-03b8-478d-a2e9-977a2cf1c501 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 10:18:18.408667 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 204/408] 10.222.0.21 () {56 vars in 1114 bytes} [Mon Feb 28 10:18:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:18.413885 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa630d-03b8-478d-a2e9-977a2cf1c501 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:18.419149 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa02ee-d390-440f-baec-51439cc9e7e1 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:18.455160 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521fea5-406d-48b5-b81e-139490023551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:18.456483 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521fea5-406d-48b5-b81e-139490023551 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:18.456971 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521fea5-406d-48b5-b81e-139490023551 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:18.457467 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521fea5-406d-48b5-b81e-139490023551 None admin] PATH_INFO: `/v3/groups/a24623174aee4b259ca2cfbfe437e7e7` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:18.458978 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521fea5-406d-48b5-b81e-139490023551 None admin] RBAC: Authorizing `identity:get_group(group_id=a24623174aee4b259ca2cfbfe437e7e7)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:18.460666 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521fea5-406d-48b5-b81e-139490023551 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:18.462848 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 205/409] 10.222.0.21 () {56 vars in 1180 bytes} [Mon Feb 28 10:18:18 2022] GET /identity/v3/groups/a24623174aee4b259ca2cfbfe437e7e7 => generated 229 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:18:18.470197 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521fea5-406d-48b5-b81e-139490023551 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:18.567127 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa630d-03b8-478d-a2e9-977a2cf1c501 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:18.578576 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521fea5-406d-48b5-b81e-139490023551 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:18.614949 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f0a3a-b56a-47b2-a8d0-681e0dd398c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:18.615956 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b8924-4ee6-4691-ab6d-255b133e4ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:18.617040 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f0a3a-b56a-47b2-a8d0-681e0dd398c3 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:18.617905 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b8924-4ee6-4691-ab6d-255b133e4ab7 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:18.618388 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f0a3a-b56a-47b2-a8d0-681e0dd398c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:18.618905 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b8924-4ee6-4691-ab6d-255b133e4ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:18.619380 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f0a3a-b56a-47b2-a8d0-681e0dd398c3 None admin] PATH_INFO: `/v3/projects/e5bfe7c1c3cf44edb4e5e5f5ea06d32a` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:18.619863 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b8924-4ee6-4691-ab6d-255b133e4ab7 None admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:18.621383 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9b8924-4ee6-4691-ab6d-255b133e4ab7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:18.622829 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863f0a3a-b56a-47b2-a8d0-681e0dd398c3 None admin] RBAC: Authorizing `identity:get_project(project_id=e5bfe7c1c3cf44edb4e5e5f5ea06d32a)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:18.623375 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9b8924-4ee6-4691-ab6d-255b133e4ab7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:18.626105 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9b8924-4ee6-4691-ab6d-255b133e4ab7 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:18.628108 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863f0a3a-b56a-47b2-a8d0-681e0dd398c3 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:18.630050 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 206/410] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:18:18 2022] GET /identity/v3/projects/e5bfe7c1c3cf44edb4e5e5f5ea06d32a => generated 344 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:18:18.638175 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 205/411] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:18:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:18:18.639652 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f0a3a-b56a-47b2-a8d0-681e0dd398c3 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:18.644445 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b8924-4ee6-4691-ab6d-255b133e4ab7 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:18.794253 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f0a3a-b56a-47b2-a8d0-681e0dd398c3 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:18.834411 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f2dac9-daaf-4576-94c1-2f2fad0995d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:18.836160 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2dac9-daaf-4576-94c1-2f2fad0995d5 None admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:18.836986 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2dac9-daaf-4576-94c1-2f2fad0995d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:18.837471 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2dac9-daaf-4576-94c1-2f2fad0995d5 None admin] PATH_INFO: `/v3/projects/e5bfe7c1c3cf44edb4e5e5f5ea06d32a/groups/a24623174aee4b259ca2cfbfe437e7e7/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:18.839739 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f2dac9-daaf-4576-94c1-2f2fad0995d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=e5bfe7c1c3cf44edb4e5e5f5ea06d32a, group_id=a24623174aee4b259ca2cfbfe437e7e7, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:18.841932 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f2dac9-daaf-4576-94c1-2f2fad0995d5 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:18.862533 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 207/412] 10.222.0.21 () {58 vars in 1442 bytes} [Mon Feb 28 10:18:18 2022] PUT /identity/v3/projects/e5bfe7c1c3cf44edb4e5e5f5ea06d32a/groups/a24623174aee4b259ca2cfbfe437e7e7/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:18:18.879778 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b8924-4ee6-4691-ab6d-255b133e4ab7 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:18.919742 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c068d5-949e-40c2-886c-62215ff6c002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:18.920633 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c068d5-949e-40c2-886c-62215ff6c002 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:18.920916 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c068d5-949e-40c2-886c-62215ff6c002 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:18.921191 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c068d5-949e-40c2-886c-62215ff6c002 None admin] PATH_INFO: `/v3/groups/07aaeb66ccf144f6a1e1f7b5d1692a47` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:18.922694 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c068d5-949e-40c2-886c-62215ff6c002 None admin] RBAC: Authorizing `identity:get_group(group_id=07aaeb66ccf144f6a1e1f7b5d1692a47)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:18.924262 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c068d5-949e-40c2-886c-62215ff6c002 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:18.926258 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 206/413] 10.222.0.21 () {56 vars in 1180 bytes} [Mon Feb 28 10:18:18 2022] GET /identity/v3/groups/07aaeb66ccf144f6a1e1f7b5d1692a47 => generated 226 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:18.931719 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f2dac9-daaf-4576-94c1-2f2fad0995d5 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:19.044788 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f2dac9-daaf-4576-94c1-2f2fad0995d5 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:19.081551 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32a479-22bc-4f60-9f3c-5c576e1bdd11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:19.082739 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32a479-22bc-4f60-9f3c-5c576e1bdd11 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:19.083025 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32a479-22bc-4f60-9f3c-5c576e1bdd11 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:19.083304 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32a479-22bc-4f60-9f3c-5c576e1bdd11 None admin] PATH_INFO: `/v3/projects/6ddffcb5f354434d9e960ae5d51d1a95` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:19.084565 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a32a479-22bc-4f60-9f3c-5c576e1bdd11 None admin] RBAC: Authorizing `identity:get_project(project_id=6ddffcb5f354434d9e960ae5d51d1a95)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:19.085943 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a32a479-22bc-4f60-9f3c-5c576e1bdd11 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:19.087974 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 208/414] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:18:18 2022] GET /identity/v3/projects/6ddffcb5f354434d9e960ae5d51d1a95 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:19.094823 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c068d5-949e-40c2-886c-62215ff6c002 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:19.207241 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c068d5-949e-40c2-886c-62215ff6c002 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:19.241496 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e3b1bd-073c-424f-94cc-04575a9d5cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:19.242372 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3b1bd-073c-424f-94cc-04575a9d5cc8 None admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:19.242681 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3b1bd-073c-424f-94cc-04575a9d5cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:19.242960 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3b1bd-073c-424f-94cc-04575a9d5cc8 None admin] PATH_INFO: `/v3/projects/6ddffcb5f354434d9e960ae5d51d1a95/groups/07aaeb66ccf144f6a1e1f7b5d1692a47/roles/101ea48f12324cee9b597825e21f34b4` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:19.245298 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e3b1bd-073c-424f-94cc-04575a9d5cc8 None admin] RBAC: Authorizing `identity:create_grant(project_id=6ddffcb5f354434d9e960ae5d51d1a95, group_id=07aaeb66ccf144f6a1e1f7b5d1692a47, role_id=101ea48f12324cee9b597825e21f34b4)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:19.247312 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e3b1bd-073c-424f-94cc-04575a9d5cc8 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:19.263940 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 207/415] 10.222.0.21 () {58 vars in 1442 bytes} [Mon Feb 28 10:18:19 2022] PUT /identity/v3/projects/6ddffcb5f354434d9e960ae5d51d1a95/groups/07aaeb66ccf144f6a1e1f7b5d1692a47/roles/101ea48f12324cee9b597825e21f34b4 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:18:19.998677 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b7655-ce66-4b6b-b4e9-79c2db5e27f9 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:19.999219 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b7655-ce66-4b6b-b4e9-79c2db5e27f9 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:19.999219 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b7655-ce66-4b6b-b4e9-79c2db5e27f9 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:20.001267 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 209/416] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:18:20.006453 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab97dbf-d7e9-4db6-9aed-f803c14aa149 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:20.006872 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab97dbf-d7e9-4db6-9aed-f803c14aa149 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:20.007059 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab97dbf-d7e9-4db6-9aed-f803c14aa149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:20.031664 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-0ab97dbf-d7e9-4db6-9aed-f803c14aa149 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:20.032865 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-0ab97dbf-d7e9-4db6-9aed-f803c14aa149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:20.115892 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 208/417] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:18:20.139994 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b7655-ce66-4b6b-b4e9-79c2db5e27f9 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:20.301554 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e8288-8f90-4564-b549-cf883e753cb2 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:20.302119 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e8288-8f90-4564-b549-cf883e753cb2 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:20.302568 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e8288-8f90-4564-b549-cf883e753cb2 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:20.305867 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 209/418] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:18:20.310495 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d04d9-d565-4284-ae89-8d02c743654d None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:20.311004 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d04d9-d565-4284-ae89-8d02c743654d None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:20.311482 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d04d9-d565-4284-ae89-8d02c743654d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:20.334623 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-b19d04d9-d565-4284-ae89-8d02c743654d None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:20.337051 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-b19d04d9-d565-4284-ae89-8d02c743654d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:20.351212 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b7655-ce66-4b6b-b4e9-79c2db5e27f9 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:20.396345 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6da08-b9b5-48e3-9aac-e4b5da1abc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:20.397061 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6da08-b9b5-48e3-9aac-e4b5da1abc52 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:20.397337 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6da08-b9b5-48e3-9aac-e4b5da1abc52 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:20.397604 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6da08-b9b5-48e3-9aac-e4b5da1abc52 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:20.420321 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e6da08-b9b5-48e3-9aac-e4b5da1abc52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:18:20.428798 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-37e6da08-b9b5-48e3-9aac-e4b5da1abc52 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 10:18:20.428798 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 210/419] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:18:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:20.438225 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6da08-b9b5-48e3-9aac-e4b5da1abc52 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:20.463747 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 210/420] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:18:20.491998 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d04d9-d565-4284-ae89-8d02c743654d None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:20.574170 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6da08-b9b5-48e3-9aac-e4b5da1abc52 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:20.622275 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905dc0b-c74d-420c-986c-cb6ac8096202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:20.623366 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905dc0b-c74d-420c-986c-cb6ac8096202 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:20.623985 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905dc0b-c74d-420c-986c-cb6ac8096202 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:20.624749 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905dc0b-c74d-420c-986c-cb6ac8096202 None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:20.626107 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e905dc0b-c74d-420c-986c-cb6ac8096202 None admin] RBAC: Adding query filter params (name=member) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:20.626612 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e905dc0b-c74d-420c-986c-cb6ac8096202 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:20.628158 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e905dc0b-c74d-420c-986c-cb6ac8096202 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:20.630284 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d04d9-d565-4284-ae89-8d02c743654d None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:20.637962 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 211/421] 10.222.0.21 () {56 vars in 1101 bytes} [Mon Feb 28 10:18:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:18:20.639605 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52071e3d-efcd-4a6f-a8ee-f6b1656bd17c None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:20.640086 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52071e3d-efcd-4a6f-a8ee-f6b1656bd17c None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:20.640520 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52071e3d-efcd-4a6f-a8ee-f6b1656bd17c None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:20.642878 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 212/422] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:18:20.643900 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52071e3d-efcd-4a6f-a8ee-f6b1656bd17c None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:20.670100 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f00e78-ba9b-4731-9d97-1a2b3cff75fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:20.670826 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f00e78-ba9b-4731-9d97-1a2b3cff75fd None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:20.671156 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f00e78-ba9b-4731-9d97-1a2b3cff75fd None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:20.671423 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f00e78-ba9b-4731-9d97-1a2b3cff75fd None admin] PATH_INFO: `/v3/roles/member` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:20.682491 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f00e78-ba9b-4731-9d97-1a2b3cff75fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:18:20.690218 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-f2f00e78-ba9b-4731-9d97-1a2b3cff75fd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 10:18:20.696500 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 211/423] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:18:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:18:20.696500 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a40dd-bf4d-49ca-a477-3d6ce3a18d64 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:20.696500 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a40dd-bf4d-49ca-a477-3d6ce3a18d64 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:20.696500 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a40dd-bf4d-49ca-a477-3d6ce3a18d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:20.711754 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-117a40dd-bf4d-49ca-a477-3d6ce3a18d64 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:20.713004 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-117a40dd-bf4d-49ca-a477-3d6ce3a18d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:20.755054 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52071e3d-efcd-4a6f-a8ee-f6b1656bd17c None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:20.781920 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 212/424] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:18:20.782811 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a40dd-bf4d-49ca-a477-3d6ce3a18d64 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:20.791990 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc61678-4bce-4235-b77b-fb55530f13a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:20.792920 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc61678-4bce-4235-b77b-fb55530f13a5 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:20.793438 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc61678-4bce-4235-b77b-fb55530f13a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:20.793913 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc61678-4bce-4235-b77b-fb55530f13a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:20.862207 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc61678-4bce-4235-b77b-fb55530f13a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:20.864095 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc61678-4bce-4235-b77b-fb55530f13a5 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:20.883845 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a40dd-bf4d-49ca-a477-3d6ce3a18d64 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:20.918142 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796dc310-ea09-44ce-b250-112c6de365c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:20.919344 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796dc310-ea09-44ce-b250-112c6de365c4 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:20.919828 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796dc310-ea09-44ce-b250-112c6de365c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:20.920325 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796dc310-ea09-44ce-b250-112c6de365c4 None admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:20.921231 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796dc310-ea09-44ce-b250-112c6de365c4 None admin] RBAC: Adding query filter params (name=member) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:20.921702 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796dc310-ea09-44ce-b250-112c6de365c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:20.923242 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796dc310-ea09-44ce-b250-112c6de365c4 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:20.931717 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 213/425] 10.222.0.21 () {56 vars in 1101 bytes} [Mon Feb 28 10:18:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:20.932794 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796dc310-ea09-44ce-b250-112c6de365c4 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:20.972590 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 213/426] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:18:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:18:20.973572 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc61678-4bce-4235-b77b-fb55530f13a5 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:21.030406 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796dc310-ea09-44ce-b250-112c6de365c4 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:21.063640 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac22d3-c4e4-49d2-a0b1-cfafca8d6bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:21.064752 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac22d3-c4e4-49d2-a0b1-cfafca8d6bdb None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:21.065210 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac22d3-c4e4-49d2-a0b1-cfafca8d6bdb None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:21.065679 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac22d3-c4e4-49d2-a0b1-cfafca8d6bdb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:21.070929 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc61678-4bce-4235-b77b-fb55530f13a5 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:21.076874 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aac22d3-c4e4-49d2-a0b1-cfafca8d6bdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:18:21.084140 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-4aac22d3-c4e4-49d2-a0b1-cfafca8d6bdb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 10:18:21.085812 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 214/427] 10.222.0.21 () {56 vars in 1114 bytes} [Mon Feb 28 10:18:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:21.086844 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac22d3-c4e4-49d2-a0b1-cfafca8d6bdb None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:21.106988 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab60cf-a32d-43a9-8e85-eaae6a9a88dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:21.107936 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab60cf-a32d-43a9-8e85-eaae6a9a88dc None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:21.108364 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab60cf-a32d-43a9-8e85-eaae6a9a88dc None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:21.108780 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab60cf-a32d-43a9-8e85-eaae6a9a88dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:21.181268 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab60cf-a32d-43a9-8e85-eaae6a9a88dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:21.182952 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab60cf-a32d-43a9-8e85-eaae6a9a88dc None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:21.185580 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac22d3-c4e4-49d2-a0b1-cfafca8d6bdb None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:21.219096 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a129f5-c6f7-4f73-a633-b977188f6ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:21.220297 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a129f5-c6f7-4f73-a633-b977188f6ba4 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:21.220774 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a129f5-c6f7-4f73-a633-b977188f6ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:21.221239 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a129f5-c6f7-4f73-a633-b977188f6ba4 None admin] PATH_INFO: `/v3/projects/067e263bb06c40a4a0e9fe2adf525073` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:21.222694 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a129f5-c6f7-4f73-a633-b977188f6ba4 None admin] RBAC: Authorizing `identity:get_project(project_id=067e263bb06c40a4a0e9fe2adf525073)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:21.224311 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a129f5-c6f7-4f73-a633-b977188f6ba4 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:21.226483 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 215/428] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:18:21 2022] GET /identity/v3/projects/067e263bb06c40a4a0e9fe2adf525073 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:21.227448 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a129f5-c6f7-4f73-a633-b977188f6ba4 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:21.297466 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 214/429] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:18:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:18:21.298443 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab60cf-a32d-43a9-8e85-eaae6a9a88dc None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:21.327785 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a129f5-c6f7-4f73-a633-b977188f6ba4 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:21.361592 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316c423-d95b-4bd1-9121-1dc84f9bdcdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:21.362635 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316c423-d95b-4bd1-9121-1dc84f9bdcdf None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:21.363113 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316c423-d95b-4bd1-9121-1dc84f9bdcdf None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:21.363601 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316c423-d95b-4bd1-9121-1dc84f9bdcdf None admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:21.364529 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2316c423-d95b-4bd1-9121-1dc84f9bdcdf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:21.365026 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2316c423-d95b-4bd1-9121-1dc84f9bdcdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:21.366576 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2316c423-d95b-4bd1-9121-1dc84f9bdcdf None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:21.375343 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 216/430] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:18:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:21.376517 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316c423-d95b-4bd1-9121-1dc84f9bdcdf None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:21.398953 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab60cf-a32d-43a9-8e85-eaae6a9a88dc None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:21.435991 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a66c1-e0b4-4d5f-97c8-1ebcd9a316fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:21.437078 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a66c1-e0b4-4d5f-97c8-1ebcd9a316fd None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:21.437542 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a66c1-e0b4-4d5f-97c8-1ebcd9a316fd None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:21.438006 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a66c1-e0b4-4d5f-97c8-1ebcd9a316fd None admin] PATH_INFO: `/v3/groups/07aaeb66ccf144f6a1e1f7b5d1692a47` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:21.442146 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a66c1-e0b4-4d5f-97c8-1ebcd9a316fd None admin] RBAC: Authorizing `identity:get_group(group_id=07aaeb66ccf144f6a1e1f7b5d1692a47)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:21.444102 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a66c1-e0b4-4d5f-97c8-1ebcd9a316fd None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:21.453695 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 215/431] 10.222.0.21 () {56 vars in 1180 bytes} [Mon Feb 28 10:18:21 2022] GET /identity/v3/groups/07aaeb66ccf144f6a1e1f7b5d1692a47 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:21.455500 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a66c1-e0b4-4d5f-97c8-1ebcd9a316fd None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:21.481582 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316c423-d95b-4bd1-9121-1dc84f9bdcdf None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:21.515983 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1b4fd-0541-47db-b952-479c16f65709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:21.517159 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1b4fd-0541-47db-b952-479c16f65709 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:21.517612 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1b4fd-0541-47db-b952-479c16f65709 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:21.518063 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1b4fd-0541-47db-b952-479c16f65709 None admin] PATH_INFO: `/v3/projects/6ddffcb5f354434d9e960ae5d51d1a95` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:21.519466 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1b4fd-0541-47db-b952-479c16f65709 None admin] RBAC: Authorizing `identity:get_project(project_id=6ddffcb5f354434d9e960ae5d51d1a95)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:21.521053 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1b4fd-0541-47db-b952-479c16f65709 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:21.522929 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 217/432] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:18:21 2022] GET /identity/v3/projects/6ddffcb5f354434d9e960ae5d51d1a95 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:21.523969 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1b4fd-0541-47db-b952-479c16f65709 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:21.565894 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a66c1-e0b4-4d5f-97c8-1ebcd9a316fd None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:21.601091 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ea6d1-4290-49db-8a31-827ffc192dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:21.602039 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ea6d1-4290-49db-8a31-827ffc192dce None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:21.602496 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ea6d1-4290-49db-8a31-827ffc192dce None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:21.603160 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ea6d1-4290-49db-8a31-827ffc192dce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:21.626717 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1b4fd-0541-47db-b952-479c16f65709 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:21.661737 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34245ae8-d6b4-462f-a69e-c2b36f6430a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:21.662390 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34245ae8-d6b4-462f-a69e-c2b36f6430a1 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:21.662694 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34245ae8-d6b4-462f-a69e-c2b36f6430a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:21.662967 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34245ae8-d6b4-462f-a69e-c2b36f6430a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:21.663801 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34245ae8-d6b4-462f-a69e-c2b36f6430a1 None admin] RBAC: Adding query filter params (group.id=07aaeb66ccf144f6a1e1f7b5d1692a47, role.id=1c79fcc5aeef4042aa382ec20f77f7b9, scope.project.id=067e263bb06c40a4a0e9fe2adf525073) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:21.664106 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34245ae8-d6b4-462f-a69e-c2b36f6430a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:21.665763 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34245ae8-d6b4-462f-a69e-c2b36f6430a1 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:21.678633 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 218/433] 10.222.0.21 () {56 vars in 1376 bytes} [Mon Feb 28 10:18:21 2022] GET /identity/v3/role_assignments?group.id=07aaeb66ccf144f6a1e1f7b5d1692a47&scope.project.id=067e263bb06c40a4a0e9fe2adf525073&role.id=1c79fcc5aeef4042aa382ec20f77f7b9 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:21.678633 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34245ae8-d6b4-462f-a69e-c2b36f6430a1 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:21.687994 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ea6d1-4290-49db-8a31-827ffc192dce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:21.698966 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ea6d1-4290-49db-8a31-827ffc192dce None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:21.803277 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34245ae8-d6b4-462f-a69e-c2b36f6430a1 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:21.847290 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c55a94-404b-498b-9bad-8acc67fd9e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:21.848150 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c55a94-404b-498b-9bad-8acc67fd9e59 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:21.848427 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c55a94-404b-498b-9bad-8acc67fd9e59 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:21.848698 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c55a94-404b-498b-9bad-8acc67fd9e59 None admin] PATH_INFO: `/v3/groups/07aaeb66ccf144f6a1e1f7b5d1692a47` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:21.849900 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c55a94-404b-498b-9bad-8acc67fd9e59 None admin] RBAC: Authorizing `identity:get_group(group_id=07aaeb66ccf144f6a1e1f7b5d1692a47)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:21.851426 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c55a94-404b-498b-9bad-8acc67fd9e59 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:21.853117 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 219/434] 10.222.0.21 () {56 vars in 1180 bytes} [Mon Feb 28 10:18:21 2022] GET /identity/v3/groups/07aaeb66ccf144f6a1e1f7b5d1692a47 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:21.854556 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0736c-51c4-4ef4-803b-cfde2973c802 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:21.854852 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0736c-51c4-4ef4-803b-cfde2973c802 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:21.855127 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0736c-51c4-4ef4-803b-cfde2973c802 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:21.857643 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 220/435] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:18:21.860189 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 216/436] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:18:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:18:21.864682 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0736c-51c4-4ef4-803b-cfde2973c802 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:21.865497 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd113a67-e952-471d-a6d9-6fa2b4db84a0 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:21.866564 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd113a67-e952-471d-a6d9-6fa2b4db84a0 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:21.867111 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd113a67-e952-471d-a6d9-6fa2b4db84a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:21.886844 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-bd113a67-e952-471d-a6d9-6fa2b4db84a0 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:21.889037 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-bd113a67-e952-471d-a6d9-6fa2b4db84a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:21.968276 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 217/437] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:18:21.969948 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd113a67-e952-471d-a6d9-6fa2b4db84a0 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:22.000995 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0736c-51c4-4ef4-803b-cfde2973c802 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:22.041031 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a216a3-da07-4ee6-ad3e-694ad5bef4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:22.041031 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a216a3-da07-4ee6-ad3e-694ad5bef4e9 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:22.041031 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a216a3-da07-4ee6-ad3e-694ad5bef4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:22.041031 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a216a3-da07-4ee6-ad3e-694ad5bef4e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:22.049224 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a216a3-da07-4ee6-ad3e-694ad5bef4e9 None admin] RBAC: Adding query filter params (group.id=07aaeb66ccf144f6a1e1f7b5d1692a47, role.id=1c79fcc5aeef4042aa382ec20f77f7b9, scope.project.id=6ddffcb5f354434d9e960ae5d51d1a95) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:22.049224 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a216a3-da07-4ee6-ad3e-694ad5bef4e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:22.049224 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a216a3-da07-4ee6-ad3e-694ad5bef4e9 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:22.051836 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 221/438] 10.222.0.21 () {56 vars in 1376 bytes} [Mon Feb 28 10:18:21 2022] GET /identity/v3/role_assignments?group.id=07aaeb66ccf144f6a1e1f7b5d1692a47&scope.project.id=6ddffcb5f354434d9e960ae5d51d1a95&role.id=1c79fcc5aeef4042aa382ec20f77f7b9 => generated 611 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:22.053553 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a216a3-da07-4ee6-ad3e-694ad5bef4e9 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:22.093049 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd113a67-e952-471d-a6d9-6fa2b4db84a0 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:22.131856 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098a6ab-c3a4-49a5-accf-6b7157961ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:22.132732 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098a6ab-c3a4-49a5-accf-6b7157961ba0 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:22.133013 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098a6ab-c3a4-49a5-accf-6b7157961ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:22.133291 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098a6ab-c3a4-49a5-accf-6b7157961ba0 None admin] PATH_INFO: `/v3/projects/067e263bb06c40a4a0e9fe2adf525073` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:22.141958 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d098a6ab-c3a4-49a5-accf-6b7157961ba0 None admin] RBAC: Authorizing `identity:get_project(project_id=067e263bb06c40a4a0e9fe2adf525073)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:22.143788 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d098a6ab-c3a4-49a5-accf-6b7157961ba0 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:22.147806 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 218/439] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:18:21 2022] GET /identity/v3/projects/067e263bb06c40a4a0e9fe2adf525073 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:22.153873 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098a6ab-c3a4-49a5-accf-6b7157961ba0 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:22.197813 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a216a3-da07-4ee6-ad3e-694ad5bef4e9 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:22.244798 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ee0c0-5b03-48c3-b216-3da3cc8eb652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:22.245556 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ee0c0-5b03-48c3-b216-3da3cc8eb652 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:22.245836 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ee0c0-5b03-48c3-b216-3da3cc8eb652 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:22.246104 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ee0c0-5b03-48c3-b216-3da3cc8eb652 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:22.267302 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9ee0c0-5b03-48c3-b216-3da3cc8eb652 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:18:22.274536 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-9c9ee0c0-5b03-48c3-b216-3da3cc8eb652 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:18:22.276143 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 222/440] 10.222.0.21 () {56 vars in 1096 bytes} [Mon Feb 28 10:18:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:22.277475 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d51cf-9a85-430a-92d2-38214d0bbeaf None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:22.277760 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d51cf-9a85-430a-92d2-38214d0bbeaf None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:22.278852 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d51cf-9a85-430a-92d2-38214d0bbeaf None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:22.280915 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 223/441] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:18:22.288333 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e4cf0-1934-4721-9435-0e6d0414a379 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:22.288869 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e4cf0-1934-4721-9435-0e6d0414a379 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:22.289828 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e4cf0-1934-4721-9435-0e6d0414a379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:22.303968 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098a6ab-c3a4-49a5-accf-6b7157961ba0 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:22.313127 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-978e4cf0-1934-4721-9435-0e6d0414a379 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:22.314705 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-978e4cf0-1934-4721-9435-0e6d0414a379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:22.353593 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68abe902-e2cc-4c53-bc42-5dabf368750a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:22.354463 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68abe902-e2cc-4c53-bc42-5dabf368750a None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:22.354799 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68abe902-e2cc-4c53-bc42-5dabf368750a None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:22.355070 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68abe902-e2cc-4c53-bc42-5dabf368750a None admin] PATH_INFO: `/v3/groups/07aaeb66ccf144f6a1e1f7b5d1692a47` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:22.359170 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68abe902-e2cc-4c53-bc42-5dabf368750a None admin] RBAC: Authorizing `identity:get_group(group_id=07aaeb66ccf144f6a1e1f7b5d1692a47)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:22.359576 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68abe902-e2cc-4c53-bc42-5dabf368750a None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:22.361472 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 219/442] 10.222.0.21 () {56 vars in 1180 bytes} [Mon Feb 28 10:18:22 2022] GET /identity/v3/groups/07aaeb66ccf144f6a1e1f7b5d1692a47 => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:18:22.362051 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68abe902-e2cc-4c53-bc42-5dabf368750a None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:22.415930 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 224/443] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:18:22.422822 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e4cf0-1934-4721-9435-0e6d0414a379 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:22.480670 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68abe902-e2cc-4c53-bc42-5dabf368750a None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:22.513675 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53f033-4586-4946-b558-7cb4d94ff28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:22.514359 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53f033-4586-4946-b558-7cb4d94ff28d None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:22.514679 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53f033-4586-4946-b558-7cb4d94ff28d None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:22.514958 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53f033-4586-4946-b558-7cb4d94ff28d None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:22.515694 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c53f033-4586-4946-b558-7cb4d94ff28d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:22.515997 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c53f033-4586-4946-b558-7cb4d94ff28d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:22.517359 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c53f033-4586-4946-b558-7cb4d94ff28d None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:22.518357 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e4cf0-1934-4721-9435-0e6d0414a379 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:22.525820 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 220/444] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:18:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:22.526638 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53f033-4586-4946-b558-7cb4d94ff28d None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:22.550185 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b9726-e119-4712-afa3-17d7ba1723f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:22.550848 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b9726-e119-4712-afa3-17d7ba1723f8 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:22.551125 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b9726-e119-4712-afa3-17d7ba1723f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:22.551389 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b9726-e119-4712-afa3-17d7ba1723f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:22.552190 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b9726-e119-4712-afa3-17d7ba1723f8 None admin] RBAC: Adding query filter params (group.id=07aaeb66ccf144f6a1e1f7b5d1692a47, role.id=101ea48f12324cee9b597825e21f34b4, scope.project.id=067e263bb06c40a4a0e9fe2adf525073) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:22.552498 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b9726-e119-4712-afa3-17d7ba1723f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:22.553886 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b9726-e119-4712-afa3-17d7ba1723f8 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:22.560044 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 225/445] 10.222.0.21 () {56 vars in 1376 bytes} [Mon Feb 28 10:18:22 2022] GET /identity/v3/role_assignments?group.id=07aaeb66ccf144f6a1e1f7b5d1692a47&scope.project.id=067e263bb06c40a4a0e9fe2adf525073&role.id=101ea48f12324cee9b597825e21f34b4 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:22.560851 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b9726-e119-4712-afa3-17d7ba1723f8 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:22.628474 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53f033-4586-4946-b558-7cb4d94ff28d None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:22.663255 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b5268-c76c-4223-a1b8-b08f160cba51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:22.664062 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b5268-c76c-4223-a1b8-b08f160cba51 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:22.664348 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b5268-c76c-4223-a1b8-b08f160cba51 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:22.664616 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b5268-c76c-4223-a1b8-b08f160cba51 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:22.673321 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b9726-e119-4712-afa3-17d7ba1723f8 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:22.675411 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721b5268-c76c-4223-a1b8-b08f160cba51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:18:22.682770 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-721b5268-c76c-4223-a1b8-b08f160cba51 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 10:18:22.684549 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 221/446] 10.222.0.21 () {56 vars in 1114 bytes} [Mon Feb 28 10:18:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:22.690677 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b5268-c76c-4223-a1b8-b08f160cba51 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:22.717786 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26092743-f5ad-4cd9-a86f-41a5da4182e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:22.718440 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26092743-f5ad-4cd9-a86f-41a5da4182e0 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:22.718759 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26092743-f5ad-4cd9-a86f-41a5da4182e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:22.719033 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26092743-f5ad-4cd9-a86f-41a5da4182e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:22.798219 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26092743-f5ad-4cd9-a86f-41a5da4182e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:22.799708 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26092743-f5ad-4cd9-a86f-41a5da4182e0 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:22.802540 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b5268-c76c-4223-a1b8-b08f160cba51 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:22.838555 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e3a91-8ca6-4f86-bfca-f7c0d0878beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:22.839244 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e3a91-8ca6-4f86-bfca-f7c0d0878beb None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:22.839523 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e3a91-8ca6-4f86-bfca-f7c0d0878beb None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:22.839794 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e3a91-8ca6-4f86-bfca-f7c0d0878beb None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:22.840628 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e3a91-8ca6-4f86-bfca-f7c0d0878beb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:22.840932 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e3a91-8ca6-4f86-bfca-f7c0d0878beb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:22.842299 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e3a91-8ca6-4f86-bfca-f7c0d0878beb None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:22.857998 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 222/447] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:18:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:18:22.863682 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e3a91-8ca6-4f86-bfca-f7c0d0878beb None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:22.916570 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 226/448] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:18:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:18:22.922800 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26092743-f5ad-4cd9-a86f-41a5da4182e0 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:22.971866 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e3a91-8ca6-4f86-bfca-f7c0d0878beb None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:23.009751 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d729890-1c49-41d0-8ad0-d7c9de36e5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:23.010407 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d729890-1c49-41d0-8ad0-d7c9de36e5b3 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:23.011088 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d729890-1c49-41d0-8ad0-d7c9de36e5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:23.011088 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d729890-1c49-41d0-8ad0-d7c9de36e5b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:23.030525 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26092743-f5ad-4cd9-a86f-41a5da4182e0 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:23.071671 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed711d-af12-407b-88d7-c747c0ba54d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:23.072264 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed711d-af12-407b-88d7-c747c0ba54d4 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:23.072528 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed711d-af12-407b-88d7-c747c0ba54d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:23.072795 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed711d-af12-407b-88d7-c747c0ba54d4 None admin] PATH_INFO: `/v3/projects/e5bfe7c1c3cf44edb4e5e5f5ea06d32a` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:23.074692 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed711d-af12-407b-88d7-c747c0ba54d4 None admin] RBAC: Authorizing `identity:get_project(project_id=e5bfe7c1c3cf44edb4e5e5f5ea06d32a)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:23.075513 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed711d-af12-407b-88d7-c747c0ba54d4 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:23.078635 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 227/449] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:18:22 2022] GET /identity/v3/projects/e5bfe7c1c3cf44edb4e5e5f5ea06d32a => generated 344 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:18:23.083009 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed711d-af12-407b-88d7-c747c0ba54d4 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:23.089326 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d729890-1c49-41d0-8ad0-d7c9de36e5b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:23.091229 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d729890-1c49-41d0-8ad0-d7c9de36e5b3 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:23.179734 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed711d-af12-407b-88d7-c747c0ba54d4 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:23.185924 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 223/450] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:18:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Feb 28 10:18:23.191555 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d729890-1c49-41d0-8ad0-d7c9de36e5b3 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:23.211891 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457a46b-c66c-47ca-8020-fc202f8e6c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:23.212717 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457a46b-c66c-47ca-8020-fc202f8e6c01 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:23.212989 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457a46b-c66c-47ca-8020-fc202f8e6c01 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:23.213262 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457a46b-c66c-47ca-8020-fc202f8e6c01 None admin] PATH_INFO: `/v3/groups/a24623174aee4b259ca2cfbfe437e7e7` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:23.214405 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f457a46b-c66c-47ca-8020-fc202f8e6c01 None admin] RBAC: Authorizing `identity:get_group(group_id=a24623174aee4b259ca2cfbfe437e7e7)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:23.216518 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f457a46b-c66c-47ca-8020-fc202f8e6c01 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:23.218234 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 228/451] 10.222.0.21 () {56 vars in 1180 bytes} [Mon Feb 28 10:18:23 2022] GET /identity/v3/groups/a24623174aee4b259ca2cfbfe437e7e7 => generated 229 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:18:23.223584 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457a46b-c66c-47ca-8020-fc202f8e6c01 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:23.283874 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d729890-1c49-41d0-8ad0-d7c9de36e5b3 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:23.314378 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457a46b-c66c-47ca-8020-fc202f8e6c01 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:23.315639 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090534ee-341c-4c6a-b32e-63ce1154ccd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:23.316554 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090534ee-341c-4c6a-b32e-63ce1154ccd5 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:23.316906 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090534ee-341c-4c6a-b32e-63ce1154ccd5 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:23.317270 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090534ee-341c-4c6a-b32e-63ce1154ccd5 None admin] PATH_INFO: `/v3/projects/6ddffcb5f354434d9e960ae5d51d1a95` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:23.318443 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090534ee-341c-4c6a-b32e-63ce1154ccd5 None admin] RBAC: Authorizing `identity:get_project(project_id=6ddffcb5f354434d9e960ae5d51d1a95)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:23.319894 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090534ee-341c-4c6a-b32e-63ce1154ccd5 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:23.321863 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 224/452] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:18:23 2022] GET /identity/v3/projects/6ddffcb5f354434d9e960ae5d51d1a95 => generated 302 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:18:23.327479 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090534ee-341c-4c6a-b32e-63ce1154ccd5 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:23.349736 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d5115-1b2f-4697-bb0c-d7a309a9a972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:23.350372 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d5115-1b2f-4697-bb0c-d7a309a9a972 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:23.350680 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d5115-1b2f-4697-bb0c-d7a309a9a972 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:23.350954 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d5115-1b2f-4697-bb0c-d7a309a9a972 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:23.351758 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900d5115-1b2f-4697-bb0c-d7a309a9a972 None admin] RBAC: Adding query filter params (group.id=a24623174aee4b259ca2cfbfe437e7e7, role.id=48e4608a7b3f4b87a20b10c4d1b45aa9, scope.project.id=e5bfe7c1c3cf44edb4e5e5f5ea06d32a) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:23.352062 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900d5115-1b2f-4697-bb0c-d7a309a9a972 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:23.353475 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900d5115-1b2f-4697-bb0c-d7a309a9a972 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:23.359811 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 229/453] 10.222.0.21 () {56 vars in 1376 bytes} [Mon Feb 28 10:18:23 2022] GET /identity/v3/role_assignments?group.id=a24623174aee4b259ca2cfbfe437e7e7&scope.project.id=e5bfe7c1c3cf44edb4e5e5f5ea06d32a&role.id=48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 611 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:18:23.426383 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090534ee-341c-4c6a-b32e-63ce1154ccd5 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:23.461792 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f886e-81f3-444e-bf2b-ecf72b359529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:23.462672 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f886e-81f3-444e-bf2b-ecf72b359529 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:23.462951 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f886e-81f3-444e-bf2b-ecf72b359529 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:23.463217 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f886e-81f3-444e-bf2b-ecf72b359529 None admin] PATH_INFO: `/v3/groups/07aaeb66ccf144f6a1e1f7b5d1692a47` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:23.464426 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f886e-81f3-444e-bf2b-ecf72b359529 None admin] RBAC: Authorizing `identity:get_group(group_id=07aaeb66ccf144f6a1e1f7b5d1692a47)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:23.466255 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f886e-81f3-444e-bf2b-ecf72b359529 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:23.468005 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 225/454] 10.222.0.21 () {56 vars in 1180 bytes} [Mon Feb 28 10:18:23 2022] GET /identity/v3/groups/07aaeb66ccf144f6a1e1f7b5d1692a47 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:23.474101 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d5115-1b2f-4697-bb0c-d7a309a9a972 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:23.573713 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d5115-1b2f-4697-bb0c-d7a309a9a972 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:23.607256 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a49f27-2d6f-4d39-a140-47af9093ed6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:23.607900 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a49f27-2d6f-4d39-a140-47af9093ed6d None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:23.608181 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a49f27-2d6f-4d39-a140-47af9093ed6d None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:23.608452 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a49f27-2d6f-4d39-a140-47af9093ed6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:23.609294 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a49f27-2d6f-4d39-a140-47af9093ed6d None admin] RBAC: Adding query filter params (group.id=07aaeb66ccf144f6a1e1f7b5d1692a47, role.id=101ea48f12324cee9b597825e21f34b4, scope.project.id=6ddffcb5f354434d9e960ae5d51d1a95) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:23.609598 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a49f27-2d6f-4d39-a140-47af9093ed6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:23.611046 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a49f27-2d6f-4d39-a140-47af9093ed6d None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:23.616505 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 230/455] 10.222.0.21 () {56 vars in 1376 bytes} [Mon Feb 28 10:18:23 2022] GET /identity/v3/role_assignments?group.id=07aaeb66ccf144f6a1e1f7b5d1692a47&scope.project.id=6ddffcb5f354434d9e960ae5d51d1a95&role.id=101ea48f12324cee9b597825e21f34b4 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:18:26.489559 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa055c6-6098-4311-b35f-c6de35ef04d8 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:26.490083 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa055c6-6098-4311-b35f-c6de35ef04d8 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:26.490083 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa055c6-6098-4311-b35f-c6de35ef04d8 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:26.492211 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 226/456] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:18:26.497906 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0dfb45-2788-4a71-b1a1-846db26094d5 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:26.498382 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0dfb45-2788-4a71-b1a1-846db26094d5 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:26.498457 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0dfb45-2788-4a71-b1a1-846db26094d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:26.523749 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-df0dfb45-2788-4a71-b1a1-846db26094d5 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:26.524956 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-df0dfb45-2788-4a71-b1a1-846db26094d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:26.612282 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 231/457] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 10:18:26.653238 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa055c6-6098-4311-b35f-c6de35ef04d8 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:26.790284 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa055c6-6098-4311-b35f-c6de35ef04d8 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:26.837957 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826675f-3834-42e2-acaa-e0fd35e73918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:26.838774 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826675f-3834-42e2-acaa-e0fd35e73918 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:26.839055 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826675f-3834-42e2-acaa-e0fd35e73918 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:26.839325 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826675f-3834-42e2-acaa-e0fd35e73918 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:26.860623 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826675f-3834-42e2-acaa-e0fd35e73918 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:26.862088 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826675f-3834-42e2-acaa-e0fd35e73918 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:26.886619 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-6826675f-3834-42e2-acaa-e0fd35e73918 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:18:26.893309 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 227/458] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:18:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:26.894691 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0dfb45-2788-4a71-b1a1-846db26094d5 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:27.002793 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0dfb45-2788-4a71-b1a1-846db26094d5 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:27.041746 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41569c50-547f-4bed-ae23-cb4ea21a1bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:27.042331 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41569c50-547f-4bed-ae23-cb4ea21a1bd9 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:27.042628 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41569c50-547f-4bed-ae23-cb4ea21a1bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:27.042913 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41569c50-547f-4bed-ae23-cb4ea21a1bd9 None admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:27.043697 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41569c50-547f-4bed-ae23-cb4ea21a1bd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:27.044199 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41569c50-547f-4bed-ae23-cb4ea21a1bd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:27.045572 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41569c50-547f-4bed-ae23-cb4ea21a1bd9 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:27.062537 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 232/459] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:27.063915 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826675f-3834-42e2-acaa-e0fd35e73918 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:27.094853 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e45b78-f15f-40f9-95d3-c38dd48e13ba None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:27.095187 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e45b78-f15f-40f9-95d3-c38dd48e13ba None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:27.095407 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e45b78-f15f-40f9-95d3-c38dd48e13ba None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:27.097304 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 233/460] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:18:27.102342 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f0fa0-0177-4d88-846d-5772f6a5b975 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:27.102641 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f0fa0-0177-4d88-846d-5772f6a5b975 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:27.102923 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f0fa0-0177-4d88-846d-5772f6a5b975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:27.130645 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-2a6f0fa0-0177-4d88-846d-5772f6a5b975 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:27.131820 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-2a6f0fa0-0177-4d88-846d-5772f6a5b975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:27.207412 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826675f-3834-42e2-acaa-e0fd35e73918 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:27.224202 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 234/461] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Feb 28 10:18:27.226064 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3d1fc-847e-4af0-8f19-1f51c5d8edff None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:27.226353 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3d1fc-847e-4af0-8f19-1f51c5d8edff None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:27.226641 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3d1fc-847e-4af0-8f19-1f51c5d8edff None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:27.230647 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 235/462] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:18:27.234740 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37980b1-9ae5-4e50-96c9-b14100c76eec None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:27.235240 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37980b1-9ae5-4e50-96c9-b14100c76eec None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:27.235864 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37980b1-9ae5-4e50-96c9-b14100c76eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:27.247128 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1170f91-ac93-4e29-ba7d-e56aba31c8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:27.248321 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1170f91-ac93-4e29-ba7d-e56aba31c8e1 None admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:27.248780 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1170f91-ac93-4e29-ba7d-e56aba31c8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:27.249224 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1170f91-ac93-4e29-ba7d-e56aba31c8e1 None admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:27.250124 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1170f91-ac93-4e29-ba7d-e56aba31c8e1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:27.251808 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1170f91-ac93-4e29-ba7d-e56aba31c8e1 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:27.256394 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-a37980b1-9ae5-4e50-96c9-b14100c76eec None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:27.257663 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-a37980b1-9ae5-4e50-96c9-b14100c76eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:27.273721 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 228/463] 10.222.0.21 () {60 vars in 1132 bytes} [Mon Feb 28 10:18:27 2022] POST /identity/v3/users => generated 246 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:18:27.275003 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1170f91-ac93-4e29-ba7d-e56aba31c8e1 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:27.335200 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 236/464] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 10:18:27.367345 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37980b1-9ae5-4e50-96c9-b14100c76eec None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:27.430671 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1170f91-ac93-4e29-ba7d-e56aba31c8e1 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:27.484144 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98584b-16d6-46d7-ad3e-29ab7be06861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:27.485696 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98584b-16d6-46d7-ad3e-29ab7be06861 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:27.486135 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98584b-16d6-46d7-ad3e-29ab7be06861 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:27.486934 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98584b-16d6-46d7-ad3e-29ab7be06861 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:27.501965 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa98584b-16d6-46d7-ad3e-29ab7be06861 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:27.504170 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa98584b-16d6-46d7-ad3e-29ab7be06861 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:27.509951 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37980b1-9ae5-4e50-96c9-b14100c76eec None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:27.522370 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-aa98584b-16d6-46d7-ad3e-29ab7be06861 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:18:27.524652 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 229/465] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:18:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:27.526281 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ee54b-78fa-4667-abff-bfd9e59fa723 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:27.526951 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ee54b-78fa-4667-abff-bfd9e59fa723 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:27.527473 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ee54b-78fa-4667-abff-bfd9e59fa723 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:27.529698 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 230/466] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:18:27.530580 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ee54b-78fa-4667-abff-bfd9e59fa723 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:27.553757 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7088926-98a1-41f3-b89a-3d846ca19786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:27.554536 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7088926-98a1-41f3-b89a-3d846ca19786 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:27.554872 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7088926-98a1-41f3-b89a-3d846ca19786 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:27.555144 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7088926-98a1-41f3-b89a-3d846ca19786 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:27.565813 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7088926-98a1-41f3-b89a-3d846ca19786 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:27.567296 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7088926-98a1-41f3-b89a-3d846ca19786 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:27.584729 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-a7088926-98a1-41f3-b89a-3d846ca19786 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:18:27.586144 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 237/467] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:18:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:18:27.587520 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceef0a8-2dbe-474b-a9ad-363493d01c3a None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:27.587520 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceef0a8-2dbe-474b-a9ad-363493d01c3a None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:27.587700 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceef0a8-2dbe-474b-a9ad-363493d01c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:27.604844 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-2ceef0a8-2dbe-474b-a9ad-363493d01c3a None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:27.606672 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-2ceef0a8-2dbe-474b-a9ad-363493d01c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:27.637143 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ee54b-78fa-4667-abff-bfd9e59fa723 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:27.672653 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed41b1-a600-4765-b5ae-9f98ac1d7f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:27.673311 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed41b1-a600-4765-b5ae-9f98ac1d7f57 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:27.673593 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed41b1-a600-4765-b5ae-9f98ac1d7f57 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:27.673869 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed41b1-a600-4765-b5ae-9f98ac1d7f57 None admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:27.674585 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed41b1-a600-4765-b5ae-9f98ac1d7f57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:27.674912 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed41b1-a600-4765-b5ae-9f98ac1d7f57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:27.676289 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed41b1-a600-4765-b5ae-9f98ac1d7f57 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:27.679570 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 238/468] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:18:27.680424 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceef0a8-2dbe-474b-a9ad-363493d01c3a None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:27.701210 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 231/469] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:27.706344 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed41b1-a600-4765-b5ae-9f98ac1d7f57 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:27.793692 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceef0a8-2dbe-474b-a9ad-363493d01c3a None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:27.808174 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed41b1-a600-4765-b5ae-9f98ac1d7f57 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:27.828912 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c307c0a5-49be-4af1-bbc1-67455ccef13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:27.829641 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c307c0a5-49be-4af1-bbc1-67455ccef13e None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:27.829925 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c307c0a5-49be-4af1-bbc1-67455ccef13e None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:27.830200 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c307c0a5-49be-4af1-bbc1-67455ccef13e None admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:27.830988 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c307c0a5-49be-4af1-bbc1-67455ccef13e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:27.831292 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c307c0a5-49be-4af1-bbc1-67455ccef13e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:27.832716 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c307c0a5-49be-4af1-bbc1-67455ccef13e None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:27.844981 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 239/470] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:27.845348 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c307c0a5-49be-4af1-bbc1-67455ccef13e None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:27.851143 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3a5f7-49f5-41c2-ada4-d37c655b4522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:27.851818 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3a5f7-49f5-41c2-ada4-d37c655b4522 None admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:27.852094 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3a5f7-49f5-41c2-ada4-d37c655b4522 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:27.852364 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3a5f7-49f5-41c2-ada4-d37c655b4522 None admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:27.853070 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3a5f7-49f5-41c2-ada4-d37c655b4522 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:27.854509 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3a5f7-49f5-41c2-ada4-d37c655b4522 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:27.875144 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 232/471] 10.222.0.21 () {60 vars in 1132 bytes} [Mon Feb 28 10:18:27 2022] POST /identity/v3/users => generated 248 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:18:27.876762 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca399ad-726c-4771-a288-616e0ed23402 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:27.877309 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca399ad-726c-4771-a288-616e0ed23402 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:27.877783 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca399ad-726c-4771-a288-616e0ed23402 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:27.884168 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 233/472] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:18:27.885372 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca399ad-726c-4771-a288-616e0ed23402 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:27.979490 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c307c0a5-49be-4af1-bbc1-67455ccef13e None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:28.016145 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ef13f9-c606-46b5-bd5c-7928c23d1c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:28.016748 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca399ad-726c-4771-a288-616e0ed23402 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:28.017652 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ef13f9-c606-46b5-bd5c-7928c23d1c44 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:28.018139 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ef13f9-c606-46b5-bd5c-7928c23d1c44 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:28.018660 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ef13f9-c606-46b5-bd5c-7928c23d1c44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:28.031390 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ef13f9-c606-46b5-bd5c-7928c23d1c44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:28.033319 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ef13f9-c606-46b5-bd5c-7928c23d1c44 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:28.053916 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-62ef13f9-c606-46b5-bd5c-7928c23d1c44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:18:28.055624 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 240/473] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:18:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:28.057118 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71ab9c-2d8d-428b-8cc2-e036a4d17594 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:28.057599 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71ab9c-2d8d-428b-8cc2-e036a4d17594 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:28.058069 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71ab9c-2d8d-428b-8cc2-e036a4d17594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:28.063385 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc67d4-9c03-48e9-942e-7fa1b55623cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:28.064059 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc67d4-9c03-48e9-942e-7fa1b55623cc None admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:28.064340 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc67d4-9c03-48e9-942e-7fa1b55623cc None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:28.064613 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc67d4-9c03-48e9-942e-7fa1b55623cc None admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:28.065310 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc67d4-9c03-48e9-942e-7fa1b55623cc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:28.067901 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc67d4-9c03-48e9-942e-7fa1b55623cc None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:28.079234 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-ae71ab9c-2d8d-428b-8cc2-e036a4d17594 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:28.080740 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-ae71ab9c-2d8d-428b-8cc2-e036a4d17594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:28.092229 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 234/474] 10.222.0.21 () {60 vars in 1132 bytes} [Mon Feb 28 10:18:27 2022] POST /identity/v3/users => generated 248 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:18:28.093313 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc67d4-9c03-48e9-942e-7fa1b55623cc None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:28.179347 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 241/475] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:18:28.202172 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae71ab9c-2d8d-428b-8cc2-e036a4d17594 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:28.256973 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc67d4-9c03-48e9-942e-7fa1b55623cc None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:28.298258 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1855ab-dfee-4f70-83cb-1abd3f972eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:28.298980 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1855ab-dfee-4f70-83cb-1abd3f972eca None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:28.299319 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1855ab-dfee-4f70-83cb-1abd3f972eca None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:28.299594 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1855ab-dfee-4f70-83cb-1abd3f972eca None admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:28.300371 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1855ab-dfee-4f70-83cb-1abd3f972eca None admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:28.300681 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1855ab-dfee-4f70-83cb-1abd3f972eca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:28.302082 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1855ab-dfee-4f70-83cb-1abd3f972eca None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:28.315024 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 235/476] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:28.320484 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1855ab-dfee-4f70-83cb-1abd3f972eca None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:28.331456 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae71ab9c-2d8d-428b-8cc2-e036a4d17594 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:28.366363 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635199bd-cdd0-4b17-bc00-7171a529bb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:28.367073 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635199bd-cdd0-4b17-bc00-7171a529bb3a None admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:28.367342 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635199bd-cdd0-4b17-bc00-7171a529bb3a None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:28.367608 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635199bd-cdd0-4b17-bc00-7171a529bb3a None admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:28.368340 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635199bd-cdd0-4b17-bc00-7171a529bb3a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:28.369748 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635199bd-cdd0-4b17-bc00-7171a529bb3a None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:28.377316 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.sql.core [None req-635199bd-cdd0-4b17-bc00-7171a529bb3a None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Feb 28 10:18:28.377316 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Feb 28 10:18:28.377316 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [parameters: {'id': '92ba3dc7c056427499ef0e7dee672309', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Feb 28 10:18:28.377316 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79318) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 28 10:18:28.393289 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-635199bd-cdd0-4b17-bc00-7171a529bb3a None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Feb 28 10:18:28.395150 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 242/477] 10.222.0.21 () {60 vars in 1131 bytes} [Mon Feb 28 10:18:28 2022] POST /identity/v3/roles => generated 144 bytes in 194 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:28.400717 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635199bd-cdd0-4b17-bc00-7171a529bb3a None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:28.422988 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1855ab-dfee-4f70-83cb-1abd3f972eca None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:28.458742 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e634b-bdc0-46fb-8bd7-359b163331c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:28.459389 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e634b-bdc0-46fb-8bd7-359b163331c5 None admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:28.459671 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e634b-bdc0-46fb-8bd7-359b163331c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:28.459945 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e634b-bdc0-46fb-8bd7-359b163331c5 None admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:28.460648 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e634b-bdc0-46fb-8bd7-359b163331c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:28.462896 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e634b-bdc0-46fb-8bd7-359b163331c5 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:28.493723 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 236/478] 10.222.0.21 () {60 vars in 1132 bytes} [Mon Feb 28 10:18:28 2022] POST /identity/v3/users => generated 249 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:18:28.519816 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635199bd-cdd0-4b17-bc00-7171a529bb3a None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:28.559573 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00931a44-01e8-4e04-8823-a8b7be09a5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:28.560470 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00931a44-01e8-4e04-8823-a8b7be09a5bc None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:28.560749 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00931a44-01e8-4e04-8823-a8b7be09a5bc None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:28.561022 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00931a44-01e8-4e04-8823-a8b7be09a5bc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:28.573990 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00931a44-01e8-4e04-8823-a8b7be09a5bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:18:28.582117 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-00931a44-01e8-4e04-8823-a8b7be09a5bc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 10:18:28.583754 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 243/479] 10.222.0.21 () {56 vars in 1114 bytes} [Mon Feb 28 10:18:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:28.589371 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e634b-bdc0-46fb-8bd7-359b163331c5 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:28.700192 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e634b-bdc0-46fb-8bd7-359b163331c5 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:28.736464 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad00c1-24a2-4703-a5a3-14709e2a790f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:28.737056 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad00c1-24a2-4703-a5a3-14709e2a790f None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:28.737337 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad00c1-24a2-4703-a5a3-14709e2a790f None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:28.737607 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad00c1-24a2-4703-a5a3-14709e2a790f None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:28.738414 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ad00c1-24a2-4703-a5a3-14709e2a790f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:28.738748 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ad00c1-24a2-4703-a5a3-14709e2a790f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:28.740172 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ad00c1-24a2-4703-a5a3-14709e2a790f None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:28.749462 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 237/480] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:18:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:18:30.082237 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b4f28-53d8-4cde-8143-f65bc82a4d05 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:30.082822 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b4f28-53d8-4cde-8143-f65bc82a4d05 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:30.082822 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b4f28-53d8-4cde-8143-f65bc82a4d05 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:30.084791 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 244/481] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:18:30.096418 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8db574-e373-4a59-a1c6-73dccc1af2fa None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:30.096905 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8db574-e373-4a59-a1c6-73dccc1af2fa None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:30.097005 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8db574-e373-4a59-a1c6-73dccc1af2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:30.118697 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-5f8db574-e373-4a59-a1c6-73dccc1af2fa None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:30.119784 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-5f8db574-e373-4a59-a1c6-73dccc1af2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:30.197288 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 238/482] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:18:30.244575 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b4f28-53d8-4cde-8143-f65bc82a4d05 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:30.376253 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b4f28-53d8-4cde-8143-f65bc82a4d05 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:30.419761 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe27b8-33d8-4f1f-9cb6-50aca52e4a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:30.420502 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe27b8-33d8-4f1f-9cb6-50aca52e4a99 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:30.420779 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe27b8-33d8-4f1f-9cb6-50aca52e4a99 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:30.421046 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe27b8-33d8-4f1f-9cb6-50aca52e4a99 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:30.435478 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebe27b8-33d8-4f1f-9cb6-50aca52e4a99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:18:30.442948 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-cebe27b8-33d8-4f1f-9cb6-50aca52e4a99 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 10:18:30.444456 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 245/483] 10.222.0.21 () {56 vars in 1102 bytes} [Mon Feb 28 10:18:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:30.450521 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8db574-e373-4a59-a1c6-73dccc1af2fa None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:30.611590 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8db574-e373-4a59-a1c6-73dccc1af2fa None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:30.655079 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f6106-b386-407b-9b93-2609afe12488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:30.656095 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f6106-b386-407b-9b93-2609afe12488 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:30.656581 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f6106-b386-407b-9b93-2609afe12488 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:30.657056 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f6106-b386-407b-9b93-2609afe12488 None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:30.658010 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f6106-b386-407b-9b93-2609afe12488 None admin] RBAC: Adding query filter params (name=service) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:30.658718 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f6106-b386-407b-9b93-2609afe12488 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:30.660306 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f6106-b386-407b-9b93-2609afe12488 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:30.674353 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 239/484] 10.222.0.21 () {56 vars in 1103 bytes} [Mon Feb 28 10:18:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:30.679580 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe27b8-33d8-4f1f-9cb6-50aca52e4a99 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:30.705329 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b0cd3-4af0-4a54-ae07-41e5c23621a6 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:30.705646 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b0cd3-4af0-4a54-ae07-41e5c23621a6 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:30.705876 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b0cd3-4af0-4a54-ae07-41e5c23621a6 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:30.710745 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 240/485] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:18:30.717414 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bbc571-28e1-4936-bd17-7ff1bf26e259 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:30.717693 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bbc571-28e1-4936-bd17-7ff1bf26e259 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:30.717969 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bbc571-28e1-4936-bd17-7ff1bf26e259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:30.748691 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-16bbc571-28e1-4936-bd17-7ff1bf26e259 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:30.749893 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-16bbc571-28e1-4936-bd17-7ff1bf26e259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:30.805729 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe27b8-33d8-4f1f-9cb6-50aca52e4a99 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:30.845753 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738b06f-ac00-4e5f-a435-d703328bb19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:30.845753 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738b06f-ac00-4e5f-a435-d703328bb19c None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:30.845753 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738b06f-ac00-4e5f-a435-d703328bb19c None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:30.845753 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738b06f-ac00-4e5f-a435-d703328bb19c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:30.866142 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2738b06f-ac00-4e5f-a435-d703328bb19c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:30.867641 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2738b06f-ac00-4e5f-a435-d703328bb19c None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:30.882940 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 241/486] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 10:18:30.901402 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-2738b06f-ac00-4e5f-a435-d703328bb19c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:18:30.904245 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 246/487] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:18:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:30.908838 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bbc571-28e1-4936-bd17-7ff1bf26e259 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:30.939151 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738b06f-ac00-4e5f-a435-d703328bb19c None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:31.041720 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738b06f-ac00-4e5f-a435-d703328bb19c None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:31.082888 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c92ec13-bb14-4785-a52b-ccc161283847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:31.083664 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92ec13-bb14-4785-a52b-ccc161283847 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:31.086636 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92ec13-bb14-4785-a52b-ccc161283847 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:31.086636 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92ec13-bb14-4785-a52b-ccc161283847 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:31.096483 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bbc571-28e1-4936-bd17-7ff1bf26e259 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:31.112291 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c92ec13-bb14-4785-a52b-ccc161283847 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:18:31.119185 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-2c92ec13-bb14-4785-a52b-ccc161283847 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 10:18:31.126978 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 247/488] 10.222.0.21 () {56 vars in 1102 bytes} [Mon Feb 28 10:18:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:18:31.127858 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c92ec13-bb14-4785-a52b-ccc161283847 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:31.167385 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14842bc7-3546-4f72-9fbf-b5c8c6a2ef74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:31.167970 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14842bc7-3546-4f72-9fbf-b5c8c6a2ef74 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:31.168246 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14842bc7-3546-4f72-9fbf-b5c8c6a2ef74 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:31.169051 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14842bc7-3546-4f72-9fbf-b5c8c6a2ef74 None admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:31.170389 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14842bc7-3546-4f72-9fbf-b5c8c6a2ef74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:31.170718 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14842bc7-3546-4f72-9fbf-b5c8c6a2ef74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:31.172092 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14842bc7-3546-4f72-9fbf-b5c8c6a2ef74 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:31.190169 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 242/489] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:18:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:31.195119 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14842bc7-3546-4f72-9fbf-b5c8c6a2ef74 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:31.273489 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c92ec13-bb14-4785-a52b-ccc161283847 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:31.304266 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14842bc7-3546-4f72-9fbf-b5c8c6a2ef74 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:31.315579 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f4f6b-d7d5-487c-9b5f-1d809f02a5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:31.316239 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f4f6b-d7d5-487c-9b5f-1d809f02a5e6 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:31.316514 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f4f6b-d7d5-487c-9b5f-1d809f02a5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:31.316782 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f4f6b-d7d5-487c-9b5f-1d809f02a5e6 None admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:31.317511 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f4f6b-d7d5-487c-9b5f-1d809f02a5e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:31.317807 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f4f6b-d7d5-487c-9b5f-1d809f02a5e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:31.319185 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f4f6b-d7d5-487c-9b5f-1d809f02a5e6 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:31.328750 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 248/490] 10.222.0.21 () {56 vars in 1103 bytes} [Mon Feb 28 10:18:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:31.330134 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c8eac-b31c-4dbf-b29d-69a05ce29cd8 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:31.330422 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c8eac-b31c-4dbf-b29d-69a05ce29cd8 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:31.330740 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c8eac-b31c-4dbf-b29d-69a05ce29cd8 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:31.332595 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 249/491] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:18:31.333673 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c8eac-b31c-4dbf-b29d-69a05ce29cd8 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:31.340564 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567bbaa2-ed4f-4b23-ac26-e3dbcb3d6a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:31.341387 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bbaa2-ed4f-4b23-ac26-e3dbcb3d6a87 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:31.341666 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bbaa2-ed4f-4b23-ac26-e3dbcb3d6a87 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:31.341939 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bbaa2-ed4f-4b23-ac26-e3dbcb3d6a87 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:31.349839 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567bbaa2-ed4f-4b23-ac26-e3dbcb3d6a87 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:31.351261 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567bbaa2-ed4f-4b23-ac26-e3dbcb3d6a87 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:31.365638 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-567bbaa2-ed4f-4b23-ac26-e3dbcb3d6a87 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 10:18:31.367203 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 243/492] 10.222.0.21 () {56 vars in 1093 bytes} [Mon Feb 28 10:18:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:31.368452 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5f76b-44c1-41ad-8266-9fa9d8994b4e None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:31.368739 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5f76b-44c1-41ad-8266-9fa9d8994b4e None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:31.369009 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5f76b-44c1-41ad-8266-9fa9d8994b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:31.388162 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-fcd5f76b-44c1-41ad-8266-9fa9d8994b4e None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:31.389343 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-fcd5f76b-44c1-41ad-8266-9fa9d8994b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:31.446410 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c8eac-b31c-4dbf-b29d-69a05ce29cd8 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:31.462651 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 244/493] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:18:31.462651 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd5f76b-44c1-41ad-8266-9fa9d8994b4e None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:31.510233 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb3ac6-bcd6-4567-92dc-0ecc1894db6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:31.511058 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb3ac6-bcd6-4567-92dc-0ecc1894db6f None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:31.511337 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb3ac6-bcd6-4567-92dc-0ecc1894db6f None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:31.511611 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb3ac6-bcd6-4567-92dc-0ecc1894db6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:31.523683 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb3ac6-bcd6-4567-92dc-0ecc1894db6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:31.525371 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb3ac6-bcd6-4567-92dc-0ecc1894db6f None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:31.545413 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-2adb3ac6-bcd6-4567-92dc-0ecc1894db6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:18:31.547005 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 250/494] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:18:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:31.547909 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb3ac6-bcd6-4567-92dc-0ecc1894db6f None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:31.574341 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd5f76b-44c1-41ad-8266-9fa9d8994b4e None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:31.612039 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e19272-7639-4b2b-9fd9-1db7271d2480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:31.612708 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e19272-7639-4b2b-9fd9-1db7271d2480 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:31.612981 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e19272-7639-4b2b-9fd9-1db7271d2480 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:31.613250 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e19272-7639-4b2b-9fd9-1db7271d2480 None admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:31.614079 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e19272-7639-4b2b-9fd9-1db7271d2480 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:31.614383 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e19272-7639-4b2b-9fd9-1db7271d2480 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:31.615859 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e19272-7639-4b2b-9fd9-1db7271d2480 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:31.652338 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 245/495] 10.222.0.21 () {56 vars in 1133 bytes} [Mon Feb 28 10:18:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:31.652338 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e19272-7639-4b2b-9fd9-1db7271d2480 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:31.662235 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb3ac6-bcd6-4567-92dc-0ecc1894db6f None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:31.694560 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d848af-09d7-440a-b3c1-86f477afbd2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:31.695375 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d848af-09d7-440a-b3c1-86f477afbd2d None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:31.695654 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d848af-09d7-440a-b3c1-86f477afbd2d None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:31.695930 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d848af-09d7-440a-b3c1-86f477afbd2d None admin] PATH_INFO: `/v3/roles/service` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:31.707329 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d848af-09d7-440a-b3c1-86f477afbd2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:18:31.714159 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-95d848af-09d7-440a-b3c1-86f477afbd2d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 10:18:31.715409 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 251/496] 10.222.0.21 () {56 vars in 1102 bytes} [Mon Feb 28 10:18:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:31.720631 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8edc6-d8ce-4478-b919-6f3e2710ef3a None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:31.720995 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8edc6-d8ce-4478-b919-6f3e2710ef3a None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:31.721346 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8edc6-d8ce-4478-b919-6f3e2710ef3a None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:31.724157 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 252/497] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:18:31.724157 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8edc6-d8ce-4478-b919-6f3e2710ef3a None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:31.757845 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e19272-7639-4b2b-9fd9-1db7271d2480 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:31.791309 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e598707-9703-4146-8168-b5d60f2cabb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:31.792255 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e598707-9703-4146-8168-b5d60f2cabb1 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:31.792610 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e598707-9703-4146-8168-b5d60f2cabb1 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:31.792886 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e598707-9703-4146-8168-b5d60f2cabb1 None admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:31.793659 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e598707-9703-4146-8168-b5d60f2cabb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:31.793966 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e598707-9703-4146-8168-b5d60f2cabb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:31.795390 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e598707-9703-4146-8168-b5d60f2cabb1 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:31.806667 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 246/498] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:31.807488 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e598707-9703-4146-8168-b5d60f2cabb1 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:31.828210 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8edc6-d8ce-4478-b919-6f3e2710ef3a None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:31.864303 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17ce13-71e9-4e26-b3d9-2c369e0d9b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:31.865039 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17ce13-71e9-4e26-b3d9-2c369e0d9b61 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:31.865321 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17ce13-71e9-4e26-b3d9-2c369e0d9b61 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:31.865597 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17ce13-71e9-4e26-b3d9-2c369e0d9b61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:31.912584 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e598707-9703-4146-8168-b5d60f2cabb1 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:31.930274 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17ce13-71e9-4e26-b3d9-2c369e0d9b61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:31.931768 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17ce13-71e9-4e26-b3d9-2c369e0d9b61 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:31.944853 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028043b-e76b-4fd6-86a0-f7afe97391c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:31.945512 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028043b-e76b-4fd6-86a0-f7afe97391c8 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:31.945792 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028043b-e76b-4fd6-86a0-f7afe97391c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:31.946062 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028043b-e76b-4fd6-86a0-f7afe97391c8 None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:31.947080 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028043b-e76b-4fd6-86a0-f7afe97391c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:31.947384 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028043b-e76b-4fd6-86a0-f7afe97391c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:31.948734 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028043b-e76b-4fd6-86a0-f7afe97391c8 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:31.956708 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 247/499] 10.222.0.21 () {56 vars in 1103 bytes} [Mon Feb 28 10:18:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:31.957930 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c7ca3-4fb7-4539-9741-6b86ed1a10b4 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:31.958265 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c7ca3-4fb7-4539-9741-6b86ed1a10b4 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:31.958546 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c7ca3-4fb7-4539-9741-6b86ed1a10b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:31.974114 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-4b8c7ca3-4fb7-4539-9741-6b86ed1a10b4 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:31.975325 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-4b8c7ca3-4fb7-4539-9741-6b86ed1a10b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:32.024966 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 253/500] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:18:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:18:32.025864 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17ce13-71e9-4e26-b3d9-2c369e0d9b61 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:32.037776 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 248/501] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:18:32.039115 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786e3d5-88d4-4e58-b3b9-f56b21983601 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:32.039407 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786e3d5-88d4-4e58-b3b9-f56b21983601 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:32.039688 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786e3d5-88d4-4e58-b3b9-f56b21983601 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:32.041357 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 249/502] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:18:32.042720 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e786e3d5-88d4-4e58-b3b9-f56b21983601 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:32.122007 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17ce13-71e9-4e26-b3d9-2c369e0d9b61 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:32.141666 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e786e3d5-88d4-4e58-b3b9-f56b21983601 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:32.154655 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16ba03-76b8-4a7c-8ef6-d554e936ec87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:32.155464 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16ba03-76b8-4a7c-8ef6-d554e936ec87 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:32.155744 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16ba03-76b8-4a7c-8ef6-d554e936ec87 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:32.156011 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16ba03-76b8-4a7c-8ef6-d554e936ec87 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:32.162837 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee16ba03-76b8-4a7c-8ef6-d554e936ec87 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:32.164274 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee16ba03-76b8-4a7c-8ef6-d554e936ec87 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:32.174559 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95cbe2c-5c91-4f18-96d2-ead8e9e5271e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:32.175349 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cbe2c-5c91-4f18-96d2-ead8e9e5271e None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:32.175629 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cbe2c-5c91-4f18-96d2-ead8e9e5271e None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:32.175900 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cbe2c-5c91-4f18-96d2-ead8e9e5271e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:32.178220 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-ee16ba03-76b8-4a7c-8ef6-d554e936ec87 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 28 10:18:32.179402 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 254/503] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:18:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:32.180180 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16ba03-76b8-4a7c-8ef6-d554e936ec87 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:32.189852 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95cbe2c-5c91-4f18-96d2-ead8e9e5271e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:32.191342 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95cbe2c-5c91-4f18-96d2-ead8e9e5271e None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:32.207785 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-a95cbe2c-5c91-4f18-96d2-ead8e9e5271e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:18:32.209012 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 250/504] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:18:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:32.210130 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4a71c-6766-4f2a-a170-e2103b5fadca None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:32.210408 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4a71c-6766-4f2a-a170-e2103b5fadca None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:32.210699 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4a71c-6766-4f2a-a170-e2103b5fadca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:32.228437 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-c6b4a71c-6766-4f2a-a170-e2103b5fadca None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:32.229609 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-c6b4a71c-6766-4f2a-a170-e2103b5fadca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:32.274361 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16ba03-76b8-4a7c-8ef6-d554e936ec87 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:32.291642 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 251/505] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:18:32.292438 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b4a71c-6766-4f2a-a170-e2103b5fadca None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:32.308935 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee13ce1-ab41-4461-bb5c-5959c296bb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:32.310720 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee13ce1-ab41-4461-bb5c-5959c296bb59 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:32.311493 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee13ce1-ab41-4461-bb5c-5959c296bb59 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:32.311994 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee13ce1-ab41-4461-bb5c-5959c296bb59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:32.323023 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee13ce1-ab41-4461-bb5c-5959c296bb59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:32.324450 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee13ce1-ab41-4461-bb5c-5959c296bb59 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:32.341913 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-bee13ce1-ab41-4461-bb5c-5959c296bb59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:18:32.343105 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 255/506] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:18:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:32.343929 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee13ce1-ab41-4461-bb5c-5959c296bb59 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:32.386969 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b4a71c-6766-4f2a-a170-e2103b5fadca None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:32.418504 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda7566-ec78-45ea-848d-669476acebb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:32.419353 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda7566-ec78-45ea-848d-669476acebb4 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:32.419626 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda7566-ec78-45ea-848d-669476acebb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:32.419890 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda7566-ec78-45ea-848d-669476acebb4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:32.429305 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda7566-ec78-45ea-848d-669476acebb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:18:32.436615 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-2dda7566-ec78-45ea-848d-669476acebb4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 10:18:32.437547 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee13ce1-ab41-4461-bb5c-5959c296bb59 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:32.437768 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 252/507] 10.222.0.21 () {56 vars in 1102 bytes} [Mon Feb 28 10:18:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:32.438512 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda7566-ec78-45ea-848d-669476acebb4 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:32.471113 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256bbad-0be3-4b21-a9d8-260ad2de23f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:32.471690 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256bbad-0be3-4b21-a9d8-260ad2de23f8 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:32.471971 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256bbad-0be3-4b21-a9d8-260ad2de23f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:32.472246 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256bbad-0be3-4b21-a9d8-260ad2de23f8 None admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:32.473068 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3256bbad-0be3-4b21-a9d8-260ad2de23f8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:32.473372 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3256bbad-0be3-4b21-a9d8-260ad2de23f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:32.474838 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3256bbad-0be3-4b21-a9d8-260ad2de23f8 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:32.511335 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 256/508] 10.222.0.21 () {56 vars in 1137 bytes} [Mon Feb 28 10:18:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:32.512803 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256bbad-0be3-4b21-a9d8-260ad2de23f8 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:32.536378 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda7566-ec78-45ea-848d-669476acebb4 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:32.569439 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506cf38-ff37-41cd-972b-e017a8a1f7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:32.570084 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506cf38-ff37-41cd-972b-e017a8a1f7f6 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:32.570365 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506cf38-ff37-41cd-972b-e017a8a1f7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:32.570664 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506cf38-ff37-41cd-972b-e017a8a1f7f6 None admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:32.571371 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a506cf38-ff37-41cd-972b-e017a8a1f7f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:32.571940 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a506cf38-ff37-41cd-972b-e017a8a1f7f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:32.573321 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a506cf38-ff37-41cd-972b-e017a8a1f7f6 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:32.584854 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 253/509] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:18:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:32.585471 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506cf38-ff37-41cd-972b-e017a8a1f7f6 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:32.610078 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256bbad-0be3-4b21-a9d8-260ad2de23f8 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:32.642165 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447247a-c5e2-4aeb-bae2-2cce6a40abbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:32.643000 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447247a-c5e2-4aeb-bae2-2cce6a40abbc None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:32.643268 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447247a-c5e2-4aeb-bae2-2cce6a40abbc None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:32.643541 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447247a-c5e2-4aeb-bae2-2cce6a40abbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:32.653001 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8447247a-c5e2-4aeb-bae2-2cce6a40abbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:32.654445 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8447247a-c5e2-4aeb-bae2-2cce6a40abbc None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:32.671083 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-8447247a-c5e2-4aeb-bae2-2cce6a40abbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:18:32.672235 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 257/510] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:18:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:32.672993 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447247a-c5e2-4aeb-bae2-2cce6a40abbc None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:32.683383 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506cf38-ff37-41cd-972b-e017a8a1f7f6 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:32.716611 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c9671-6761-4a96-b5e5-8403f1e14181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:32.717263 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c9671-6761-4a96-b5e5-8403f1e14181 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:32.717541 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c9671-6761-4a96-b5e5-8403f1e14181 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:32.717810 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c9671-6761-4a96-b5e5-8403f1e14181 None admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:32.718514 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c9671-6761-4a96-b5e5-8403f1e14181 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:32.718844 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c9671-6761-4a96-b5e5-8403f1e14181 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:32.720225 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c9671-6761-4a96-b5e5-8403f1e14181 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:32.731222 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 254/511] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:18:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:32.731781 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c9671-6761-4a96-b5e5-8403f1e14181 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:32.771290 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447247a-c5e2-4aeb-bae2-2cce6a40abbc None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:32.802966 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a945d-45c1-4eb8-b31c-d5d85832cc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:32.803614 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a945d-45c1-4eb8-b31c-d5d85832cc7b None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:32.803897 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a945d-45c1-4eb8-b31c-d5d85832cc7b None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:32.804166 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a945d-45c1-4eb8-b31c-d5d85832cc7b None admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:32.804888 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a945d-45c1-4eb8-b31c-d5d85832cc7b None admin] RBAC: Adding query filter params (name=service) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:32.805188 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a945d-45c1-4eb8-b31c-d5d85832cc7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:32.806531 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a945d-45c1-4eb8-b31c-d5d85832cc7b None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:32.814639 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 258/512] 10.222.0.21 () {56 vars in 1103 bytes} [Mon Feb 28 10:18:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:32.815205 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a945d-45c1-4eb8-b31c-d5d85832cc7b None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:32.823954 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c9671-6761-4a96-b5e5-8403f1e14181 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:32.857402 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586a4ee-d066-46a2-a14e-e9d684afeb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:32.858047 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586a4ee-d066-46a2-a14e-e9d684afeb87 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:32.858409 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586a4ee-d066-46a2-a14e-e9d684afeb87 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:32.858717 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586a4ee-d066-46a2-a14e-e9d684afeb87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:32.911684 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a945d-45c1-4eb8-b31c-d5d85832cc7b None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:32.921574 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c586a4ee-d066-46a2-a14e-e9d684afeb87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:32.923070 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c586a4ee-d066-46a2-a14e-e9d684afeb87 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:32.948128 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce630f45-fee7-48c5-bdf8-88dc00f41bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:32.948899 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce630f45-fee7-48c5-bdf8-88dc00f41bf3 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:32.949177 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce630f45-fee7-48c5-bdf8-88dc00f41bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:32.949444 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce630f45-fee7-48c5-bdf8-88dc00f41bf3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:32.957255 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce630f45-fee7-48c5-bdf8-88dc00f41bf3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:32.958638 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce630f45-fee7-48c5-bdf8-88dc00f41bf3 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:32.971673 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-ce630f45-fee7-48c5-bdf8-88dc00f41bf3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 28 10:18:32.972815 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 259/513] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:18:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:32.973572 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce630f45-fee7-48c5-bdf8-88dc00f41bf3 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:33.019105 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 255/514] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:18:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:18:33.019862 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586a4ee-d066-46a2-a14e-e9d684afeb87 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:33.068392 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce630f45-fee7-48c5-bdf8-88dc00f41bf3 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:33.099866 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd93bb-c18d-451d-85c6-dfca0e4fc6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:33.100507 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd93bb-c18d-451d-85c6-dfca0e4fc6a2 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:33.100789 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd93bb-c18d-451d-85c6-dfca0e4fc6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:33.101063 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd93bb-c18d-451d-85c6-dfca0e4fc6a2 None admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:33.101767 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd93bb-c18d-451d-85c6-dfca0e4fc6a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:33.102067 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd93bb-c18d-451d-85c6-dfca0e4fc6a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:33.103478 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd93bb-c18d-451d-85c6-dfca0e4fc6a2 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:33.113878 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586a4ee-d066-46a2-a14e-e9d684afeb87 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:33.115207 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 260/515] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:18:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:33.115993 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd93bb-c18d-451d-85c6-dfca0e4fc6a2 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:33.146795 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e5093-377f-45ee-81ed-45e239e3c455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:33.147569 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e5093-377f-45ee-81ed-45e239e3c455 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:33.147848 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e5093-377f-45ee-81ed-45e239e3c455 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:33.148119 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e5093-377f-45ee-81ed-45e239e3c455 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:33.155085 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1e5093-377f-45ee-81ed-45e239e3c455 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:33.156521 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1e5093-377f-45ee-81ed-45e239e3c455 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:33.169773 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-2d1e5093-377f-45ee-81ed-45e239e3c455 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:18:33.171166 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 256/516] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:18:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:33.171722 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e5093-377f-45ee-81ed-45e239e3c455 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:33.209781 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd93bb-c18d-451d-85c6-dfca0e4fc6a2 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:33.241261 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99cd68-aca7-42c5-8e4f-ff27dd80cb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:33.242028 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99cd68-aca7-42c5-8e4f-ff27dd80cb77 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:33.242302 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99cd68-aca7-42c5-8e4f-ff27dd80cb77 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:33.242565 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99cd68-aca7-42c5-8e4f-ff27dd80cb77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:33.252766 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99cd68-aca7-42c5-8e4f-ff27dd80cb77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:33.254298 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99cd68-aca7-42c5-8e4f-ff27dd80cb77 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:33.265041 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e5093-377f-45ee-81ed-45e239e3c455 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:33.271416 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-1c99cd68-aca7-42c5-8e4f-ff27dd80cb77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:18:33.272527 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 261/517] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:18:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:33.273273 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99cd68-aca7-42c5-8e4f-ff27dd80cb77 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:33.296899 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab148c5-81ac-4ff1-aced-1f16c225a02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:33.297557 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab148c5-81ac-4ff1-aced-1f16c225a02a None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:33.297832 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab148c5-81ac-4ff1-aced-1f16c225a02a None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:33.298103 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab148c5-81ac-4ff1-aced-1f16c225a02a None admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:33.298948 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab148c5-81ac-4ff1-aced-1f16c225a02a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:33.299254 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab148c5-81ac-4ff1-aced-1f16c225a02a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:33.300666 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab148c5-81ac-4ff1-aced-1f16c225a02a None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:33.317930 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 257/518] 10.222.0.21 () {56 vars in 1137 bytes} [Mon Feb 28 10:18:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:33.318728 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab148c5-81ac-4ff1-aced-1f16c225a02a None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:33.378751 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99cd68-aca7-42c5-8e4f-ff27dd80cb77 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:33.411548 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd69adf6-4f66-4443-a290-2edd34a64522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:33.412322 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69adf6-4f66-4443-a290-2edd34a64522 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:33.412597 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69adf6-4f66-4443-a290-2edd34a64522 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:33.412857 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69adf6-4f66-4443-a290-2edd34a64522 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:33.414586 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab148c5-81ac-4ff1-aced-1f16c225a02a None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:33.422455 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd69adf6-4f66-4443-a290-2edd34a64522 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:33.423922 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd69adf6-4f66-4443-a290-2edd34a64522 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:33.439755 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-bd69adf6-4f66-4443-a290-2edd34a64522 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:18:33.445329 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 262/519] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:18:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:33.445329 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd69adf6-4f66-4443-a290-2edd34a64522 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:33.446069 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368036c5-434b-4ae9-a951-624dcd2f35f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:33.447023 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368036c5-434b-4ae9-a951-624dcd2f35f4 None admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:33.447303 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368036c5-434b-4ae9-a951-624dcd2f35f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:33.447572 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368036c5-434b-4ae9-a951-624dcd2f35f4 None admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:33.448263 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368036c5-434b-4ae9-a951-624dcd2f35f4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:33.450211 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368036c5-434b-4ae9-a951-624dcd2f35f4 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:33.469536 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 258/520] 10.222.0.21 () {60 vars in 1132 bytes} [Mon Feb 28 10:18:33 2022] POST /identity/v3/users => generated 247 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:18:33.470431 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368036c5-434b-4ae9-a951-624dcd2f35f4 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:33.550218 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd69adf6-4f66-4443-a290-2edd34a64522 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:33.584199 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368036c5-434b-4ae9-a951-624dcd2f35f4 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:33.585829 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2ba50-c925-455f-9fcd-25f7e31a2ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:33.586501 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2ba50-c925-455f-9fcd-25f7e31a2ce1 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:33.586814 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2ba50-c925-455f-9fcd-25f7e31a2ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:33.587088 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2ba50-c925-455f-9fcd-25f7e31a2ce1 None admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:33.587903 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d2ba50-c925-455f-9fcd-25f7e31a2ce1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:33.588209 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d2ba50-c925-455f-9fcd-25f7e31a2ce1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:33.589661 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d2ba50-c925-455f-9fcd-25f7e31a2ce1 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:33.609125 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 263/521] 10.222.0.21 () {56 vars in 1148 bytes} [Mon Feb 28 10:18:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:33.610001 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2ba50-c925-455f-9fcd-25f7e31a2ce1 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:33.627589 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1800de-ebe1-4f1d-8d00-94a5bdd5cbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:33.628629 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1800de-ebe1-4f1d-8d00-94a5bdd5cbcb None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:33.629101 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1800de-ebe1-4f1d-8d00-94a5bdd5cbcb None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:33.629374 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1800de-ebe1-4f1d-8d00-94a5bdd5cbcb None admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:33.630106 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1800de-ebe1-4f1d-8d00-94a5bdd5cbcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:33.630408 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1800de-ebe1-4f1d-8d00-94a5bdd5cbcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:33.631883 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1800de-ebe1-4f1d-8d00-94a5bdd5cbcb None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:33.644881 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 259/522] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:18:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:33.650639 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1800de-ebe1-4f1d-8d00-94a5bdd5cbcb None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:33.721016 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2ba50-c925-455f-9fcd-25f7e31a2ce1 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:33.753480 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdc75f-4dff-44fa-b7bb-268386a1b07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:33.754121 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdc75f-4dff-44fa-b7bb-268386a1b07b None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:33.754401 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdc75f-4dff-44fa-b7bb-268386a1b07b None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:33.754700 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdc75f-4dff-44fa-b7bb-268386a1b07b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:33.757792 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1800de-ebe1-4f1d-8d00-94a5bdd5cbcb None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:33.794900 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88903b70-4686-4e48-8ab5-85cd0e62680a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:33.795872 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88903b70-4686-4e48-8ab5-85cd0e62680a None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:33.796154 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88903b70-4686-4e48-8ab5-85cd0e62680a None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:33.796694 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88903b70-4686-4e48-8ab5-85cd0e62680a None admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:33.797408 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88903b70-4686-4e48-8ab5-85cd0e62680a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:33.797716 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88903b70-4686-4e48-8ab5-85cd0e62680a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:33.799729 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88903b70-4686-4e48-8ab5-85cd0e62680a None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:33.818738 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 260/523] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:18:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:33.819415 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88903b70-4686-4e48-8ab5-85cd0e62680a None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:33.820598 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cdc75f-4dff-44fa-b7bb-268386a1b07b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:33.822324 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cdc75f-4dff-44fa-b7bb-268386a1b07b None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:33.918966 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88903b70-4686-4e48-8ab5-85cd0e62680a None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:33.921970 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 264/524] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:18:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:18:33.927298 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdc75f-4dff-44fa-b7bb-268386a1b07b None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:33.952909 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dcd348-af56-4fd1-b738-2ab9ff93f31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:33.953562 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dcd348-af56-4fd1-b738-2ab9ff93f31f None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:33.953841 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dcd348-af56-4fd1-b738-2ab9ff93f31f None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:33.954113 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dcd348-af56-4fd1-b738-2ab9ff93f31f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:33.954957 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dcd348-af56-4fd1-b738-2ab9ff93f31f None admin] RBAC: Adding query filter params (role.id=060d4a1eef7a45858664a42696ff4a19, scope.project.id=5d1d6f8141924b2d99b766f975a3d43b, user.id=ec202a34db8e47f4a6c18285245e3f5b) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:33.955266 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dcd348-af56-4fd1-b738-2ab9ff93f31f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:33.956682 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dcd348-af56-4fd1-b738-2ab9ff93f31f None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:33.966638 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 261/525] 10.222.0.21 () {56 vars in 1374 bytes} [Mon Feb 28 10:18:33 2022] GET /identity/v3/role_assignments?user.id=ec202a34db8e47f4a6c18285245e3f5b&scope.project.id=5d1d6f8141924b2d99b766f975a3d43b&role.id=060d4a1eef7a45858664a42696ff4a19 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:33.966638 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dcd348-af56-4fd1-b738-2ab9ff93f31f None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:34.037744 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdc75f-4dff-44fa-b7bb-268386a1b07b None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:34.078729 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f420d886-1502-4baf-894d-c9d5cf1caeda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:34.079456 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420d886-1502-4baf-894d-c9d5cf1caeda None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:34.079742 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420d886-1502-4baf-894d-c9d5cf1caeda None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:34.080012 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420d886-1502-4baf-894d-c9d5cf1caeda None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:34.087899 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f420d886-1502-4baf-894d-c9d5cf1caeda None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:34.089377 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f420d886-1502-4baf-894d-c9d5cf1caeda None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:34.098896 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dcd348-af56-4fd1-b738-2ab9ff93f31f None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:34.105414 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-f420d886-1502-4baf-894d-c9d5cf1caeda None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 28 10:18:34.112049 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 265/526] 10.222.0.21 () {56 vars in 1102 bytes} [Mon Feb 28 10:18:33 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:34.113008 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f420d886-1502-4baf-894d-c9d5cf1caeda None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:34.137967 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d305e70-b1e7-46bf-80b8-1d1acfdb07e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:34.139220 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d305e70-b1e7-46bf-80b8-1d1acfdb07e0 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:34.139751 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d305e70-b1e7-46bf-80b8-1d1acfdb07e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:34.140213 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d305e70-b1e7-46bf-80b8-1d1acfdb07e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:34.148160 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d305e70-b1e7-46bf-80b8-1d1acfdb07e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:34.150463 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d305e70-b1e7-46bf-80b8-1d1acfdb07e0 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:34.165272 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-3d305e70-b1e7-46bf-80b8-1d1acfdb07e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:18:34.166961 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 262/527] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:18:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:34.168002 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d305e70-b1e7-46bf-80b8-1d1acfdb07e0 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:34.219077 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f420d886-1502-4baf-894d-c9d5cf1caeda None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:34.254878 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4793a2-4e03-47c4-83ef-f88f45667589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:34.255769 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4793a2-4e03-47c4-83ef-f88f45667589 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:34.256118 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4793a2-4e03-47c4-83ef-f88f45667589 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:34.256467 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4793a2-4e03-47c4-83ef-f88f45667589 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:34.267251 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4793a2-4e03-47c4-83ef-f88f45667589 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:34.268809 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4793a2-4e03-47c4-83ef-f88f45667589 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:34.270071 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d305e70-b1e7-46bf-80b8-1d1acfdb07e0 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:34.285982 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-ed4793a2-4e03-47c4-83ef-f88f45667589 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:18:34.287657 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 266/528] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:18:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:34.288516 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4793a2-4e03-47c4-83ef-f88f45667589 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:34.310825 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48bb8f2-fa0e-4b8c-b428-187a3054a1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:34.311492 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bb8f2-fa0e-4b8c-b428-187a3054a1c4 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:34.311770 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bb8f2-fa0e-4b8c-b428-187a3054a1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:34.312042 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bb8f2-fa0e-4b8c-b428-187a3054a1c4 None admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:34.313022 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48bb8f2-fa0e-4b8c-b428-187a3054a1c4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:34.313334 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48bb8f2-fa0e-4b8c-b428-187a3054a1c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:34.314808 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48bb8f2-fa0e-4b8c-b428-187a3054a1c4 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:34.333273 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 263/529] 10.222.0.21 () {56 vars in 1139 bytes} [Mon Feb 28 10:18:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:34.338379 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48bb8f2-fa0e-4b8c-b428-187a3054a1c4 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:34.390776 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4793a2-4e03-47c4-83ef-f88f45667589 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:34.424642 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a2fdc-879c-4716-88a8-e0013a6f28ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:34.425303 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a2fdc-879c-4716-88a8-e0013a6f28ca None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:34.425586 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a2fdc-879c-4716-88a8-e0013a6f28ca None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:34.425860 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a2fdc-879c-4716-88a8-e0013a6f28ca None admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:34.426782 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a2fdc-879c-4716-88a8-e0013a6f28ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:34.426953 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a2fdc-879c-4716-88a8-e0013a6f28ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:34.428383 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a2fdc-879c-4716-88a8-e0013a6f28ca None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:34.437221 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48bb8f2-fa0e-4b8c-b428-187a3054a1c4 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:34.440728 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 267/530] 10.222.0.21 () {56 vars in 1148 bytes} [Mon Feb 28 10:18:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:34.441548 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a2fdc-879c-4716-88a8-e0013a6f28ca None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:34.477384 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f390d4-2c5e-4261-be2f-696fc21bda36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:34.478042 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f390d4-2c5e-4261-be2f-696fc21bda36 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:34.478318 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f390d4-2c5e-4261-be2f-696fc21bda36 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:34.478589 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f390d4-2c5e-4261-be2f-696fc21bda36 None admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:34.479357 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f390d4-2c5e-4261-be2f-696fc21bda36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:34.479670 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f390d4-2c5e-4261-be2f-696fc21bda36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:34.481671 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f390d4-2c5e-4261-be2f-696fc21bda36 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:34.498138 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 264/531] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:18:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:34.499060 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f390d4-2c5e-4261-be2f-696fc21bda36 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:34.540753 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a2fdc-879c-4716-88a8-e0013a6f28ca None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:34.575303 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f3b18-d555-498c-98c3-377b4f41ab78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:34.575956 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f3b18-d555-498c-98c3-377b4f41ab78 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:34.576240 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f3b18-d555-498c-98c3-377b4f41ab78 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:34.576515 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f3b18-d555-498c-98c3-377b4f41ab78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:34.601868 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f390d4-2c5e-4261-be2f-696fc21bda36 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:34.636045 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9330df5-52b9-4721-805a-2f2796e112c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:34.636746 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9330df5-52b9-4721-805a-2f2796e112c7 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:34.637068 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9330df5-52b9-4721-805a-2f2796e112c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:34.637470 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9330df5-52b9-4721-805a-2f2796e112c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:34.638284 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9330df5-52b9-4721-805a-2f2796e112c7 None admin] RBAC: Adding query filter params (role.id=060d4a1eef7a45858664a42696ff4a19, scope.project.id=5d1d6f8141924b2d99b766f975a3d43b, user.id=d99b63b9b6e44219921569db1bf2e0dd) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:34.638591 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9330df5-52b9-4721-805a-2f2796e112c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:34.640045 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9330df5-52b9-4721-805a-2f2796e112c7 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:34.643446 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f3b18-d555-498c-98c3-377b4f41ab78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:34.644897 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f3b18-d555-498c-98c3-377b4f41ab78 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:34.654806 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 265/532] 10.222.0.21 () {56 vars in 1374 bytes} [Mon Feb 28 10:18:34 2022] GET /identity/v3/role_assignments?user.id=d99b63b9b6e44219921569db1bf2e0dd&scope.project.id=5d1d6f8141924b2d99b766f975a3d43b&role.id=060d4a1eef7a45858664a42696ff4a19 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:34.655856 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9330df5-52b9-4721-805a-2f2796e112c7 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:34.750990 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 268/533] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:18:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:18:34.768186 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f3b18-d555-498c-98c3-377b4f41ab78 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:34.784368 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9330df5-52b9-4721-805a-2f2796e112c7 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:34.819749 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d49f8-f05a-427d-925c-c94ae5c81f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:34.820543 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d49f8-f05a-427d-925c-c94ae5c81f2b None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:34.820817 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d49f8-f05a-427d-925c-c94ae5c81f2b None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:34.821086 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d49f8-f05a-427d-925c-c94ae5c81f2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:34.829435 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d49f8-f05a-427d-925c-c94ae5c81f2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:34.830924 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d49f8-f05a-427d-925c-c94ae5c81f2b None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:34.850318 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-675d49f8-f05a-427d-925c-c94ae5c81f2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:18:34.851240 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 266/534] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:18:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:34.858804 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d49f8-f05a-427d-925c-c94ae5c81f2b None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:34.982765 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d49f8-f05a-427d-925c-c94ae5c81f2b None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:35.004583 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f3b18-d555-498c-98c3-377b4f41ab78 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:35.031847 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8406d900-c38b-413b-b67c-65dde083213b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:35.032768 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406d900-c38b-413b-b67c-65dde083213b None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:35.032768 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406d900-c38b-413b-b67c-65dde083213b None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:35.033075 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406d900-c38b-413b-b67c-65dde083213b None admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:35.033809 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8406d900-c38b-413b-b67c-65dde083213b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:35.034114 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8406d900-c38b-413b-b67c-65dde083213b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:35.035568 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8406d900-c38b-413b-b67c-65dde083213b None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:35.071190 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 267/535] 10.222.0.21 () {56 vars in 1148 bytes} [Mon Feb 28 10:18:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:18:35.073974 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58e937-abd5-4e9c-8964-785c6f94229a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:35.075468 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58e937-abd5-4e9c-8964-785c6f94229a None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:35.075752 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58e937-abd5-4e9c-8964-785c6f94229a None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:35.076024 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58e937-abd5-4e9c-8964-785c6f94229a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:35.078652 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8406d900-c38b-413b-b67c-65dde083213b None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:35.097314 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f58e937-abd5-4e9c-8964-785c6f94229a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:35.099107 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f58e937-abd5-4e9c-8964-785c6f94229a None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:35.118177 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-0f58e937-abd5-4e9c-8964-785c6f94229a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:18:35.124402 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 269/536] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:18:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:18:35.125733 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58e937-abd5-4e9c-8964-785c6f94229a None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:35.243288 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58e937-abd5-4e9c-8964-785c6f94229a None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:35.284492 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a2662-5994-491f-a84f-fd1c24d31094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:35.285156 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a2662-5994-491f-a84f-fd1c24d31094 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:35.285436 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a2662-5994-491f-a84f-fd1c24d31094 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:35.285709 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a2662-5994-491f-a84f-fd1c24d31094 None admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:35.286424 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25a2662-5994-491f-a84f-fd1c24d31094 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:35.286772 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25a2662-5994-491f-a84f-fd1c24d31094 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:35.290621 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25a2662-5994-491f-a84f-fd1c24d31094 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:35.305815 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 270/537] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:18:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:35.307392 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a2662-5994-491f-a84f-fd1c24d31094 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:35.320830 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8406d900-c38b-413b-b67c-65dde083213b None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:35.414501 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9dec74-589b-407c-9866-e322a11442b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:35.415487 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9dec74-589b-407c-9866-e322a11442b1 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:35.415949 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9dec74-589b-407c-9866-e322a11442b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:35.416396 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9dec74-589b-407c-9866-e322a11442b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:35.417082 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a2662-5994-491f-a84f-fd1c24d31094 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:35.417611 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9dec74-589b-407c-9866-e322a11442b1 None admin] RBAC: Adding query filter params (role.id=060d4a1eef7a45858664a42696ff4a19, scope.project.id=5d1d6f8141924b2d99b766f975a3d43b, user.id=b2e92304833d47828c52ae737f6b96cc) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:35.418108 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9dec74-589b-407c-9866-e322a11442b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:35.420092 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9dec74-589b-407c-9866-e322a11442b1 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:35.430897 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 268/538] 10.222.0.21 () {56 vars in 1374 bytes} [Mon Feb 28 10:18:35 2022] GET /identity/v3/role_assignments?user.id=b2e92304833d47828c52ae737f6b96cc&scope.project.id=5d1d6f8141924b2d99b766f975a3d43b&role.id=060d4a1eef7a45858664a42696ff4a19 => generated 259 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:35.455925 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234135d9-0f1f-45a9-a397-16e25dba6dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:35.456808 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234135d9-0f1f-45a9-a397-16e25dba6dca None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:35.457172 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234135d9-0f1f-45a9-a397-16e25dba6dca None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:35.457515 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234135d9-0f1f-45a9-a397-16e25dba6dca None admin] PATH_INFO: `/v3/projects/service` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:35.465160 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234135d9-0f1f-45a9-a397-16e25dba6dca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:35.466794 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234135d9-0f1f-45a9-a397-16e25dba6dca None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:35.481778 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-234135d9-0f1f-45a9-a397-16e25dba6dca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:18:35.490766 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 271/539] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:18:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:35.493024 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9dec74-589b-407c-9866-e322a11442b1 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:35.644706 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9dec74-589b-407c-9866-e322a11442b1 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:35.689011 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac7d8f-9896-4c03-aa68-4ca69ecac3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:35.689655 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac7d8f-9896-4c03-aa68-4ca69ecac3a8 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:35.689936 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac7d8f-9896-4c03-aa68-4ca69ecac3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:35.690211 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac7d8f-9896-4c03-aa68-4ca69ecac3a8 None admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:35.691087 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac7d8f-9896-4c03-aa68-4ca69ecac3a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:35.691391 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac7d8f-9896-4c03-aa68-4ca69ecac3a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:35.692846 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac7d8f-9896-4c03-aa68-4ca69ecac3a8 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:35.710052 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 269/540] 10.222.0.21 () {56 vars in 1148 bytes} [Mon Feb 28 10:18:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:35.715793 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234135d9-0f1f-45a9-a397-16e25dba6dca None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:35.836802 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234135d9-0f1f-45a9-a397-16e25dba6dca None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:35.879342 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341bfc72-54cc-432c-859c-4f43014519ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:35.880000 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341bfc72-54cc-432c-859c-4f43014519ae None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:35.880280 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341bfc72-54cc-432c-859c-4f43014519ae None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:35.880555 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341bfc72-54cc-432c-859c-4f43014519ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:35.881374 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341bfc72-54cc-432c-859c-4f43014519ae None admin] RBAC: Adding query filter params (role.id=060d4a1eef7a45858664a42696ff4a19, scope.project.id=5d1d6f8141924b2d99b766f975a3d43b, user.id=abaa12b94c834676bb17bf997dace5d1) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:35.881683 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341bfc72-54cc-432c-859c-4f43014519ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:35.883154 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341bfc72-54cc-432c-859c-4f43014519ae None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:35.889670 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 272/541] 10.222.0.21 () {56 vars in 1374 bytes} [Mon Feb 28 10:18:35 2022] GET /identity/v3/role_assignments?user.id=abaa12b94c834676bb17bf997dace5d1&scope.project.id=5d1d6f8141924b2d99b766f975a3d43b&role.id=060d4a1eef7a45858664a42696ff4a19 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:36.081236 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ded72-9f99-4e24-b80c-147a7d971b60 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:36.083682 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ded72-9f99-4e24-b80c-147a7d971b60 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:36.083682 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ded72-9f99-4e24-b80c-147a7d971b60 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:36.084221 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 270/542] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:18:36.091050 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da7c35-f600-4007-9607-184af5bbdf1d None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:36.091897 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da7c35-f600-4007-9607-184af5bbdf1d None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:36.092383 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da7c35-f600-4007-9607-184af5bbdf1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:36.110640 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-27da7c35-f600-4007-9607-184af5bbdf1d None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:36.112219 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-27da7c35-f600-4007-9607-184af5bbdf1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:36.186733 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 273/543] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:18:36.206058 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ded72-9f99-4e24-b80c-147a7d971b60 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:36.317519 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ded72-9f99-4e24-b80c-147a7d971b60 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:36.357108 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78c5df-3273-4d15-9226-d04654171a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:36.357847 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78c5df-3273-4d15-9226-d04654171a53 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:36.358119 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78c5df-3273-4d15-9226-d04654171a53 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:36.358465 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78c5df-3273-4d15-9226-d04654171a53 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:36.370844 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78c5df-3273-4d15-9226-d04654171a53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:18:36.378036 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-ff78c5df-3273-4d15-9226-d04654171a53 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 10:18:36.379316 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 271/544] 10.222.0.21 () {56 vars in 1102 bytes} [Mon Feb 28 10:18:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:36.385575 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da7c35-f600-4007-9607-184af5bbdf1d None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:36.537354 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da7c35-f600-4007-9607-184af5bbdf1d None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:36.582379 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552b649-77d7-4842-b197-419542d27a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:36.583077 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552b649-77d7-4842-b197-419542d27a74 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:36.583358 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552b649-77d7-4842-b197-419542d27a74 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:36.583633 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552b649-77d7-4842-b197-419542d27a74 None admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:36.584378 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552b649-77d7-4842-b197-419542d27a74 None admin] RBAC: Adding query filter params (name=service) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:36.584681 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552b649-77d7-4842-b197-419542d27a74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:36.586062 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552b649-77d7-4842-b197-419542d27a74 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:36.594941 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 274/545] 10.222.0.21 () {56 vars in 1103 bytes} [Mon Feb 28 10:18:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:36.600444 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78c5df-3273-4d15-9226-d04654171a53 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:36.723635 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78c5df-3273-4d15-9226-d04654171a53 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:36.767595 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b6522-d232-4d97-acff-03dec06df7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:36.768428 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b6522-d232-4d97-acff-03dec06df7ab None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:36.768709 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b6522-d232-4d97-acff-03dec06df7ab None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:36.769019 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b6522-d232-4d97-acff-03dec06df7ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:36.782877 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b6522-d232-4d97-acff-03dec06df7ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:36.784333 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b6522-d232-4d97-acff-03dec06df7ab None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:36.804551 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-5a3b6522-d232-4d97-acff-03dec06df7ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:18:36.805746 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 272/546] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:18:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:36.811875 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552b649-77d7-4842-b197-419542d27a74 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:36.865643 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b8c3b-d144-47f4-9d9d-8f9148faad97 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:36.865929 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b8c3b-d144-47f4-9d9d-8f9148faad97 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:36.866204 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b8c3b-d144-47f4-9d9d-8f9148faad97 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:36.868356 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 273/547] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:18:36.876193 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d415896-b4e0-445d-a950-f221a0674da9 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:36.876742 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d415896-b4e0-445d-a950-f221a0674da9 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:36.877243 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d415896-b4e0-445d-a950-f221a0674da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:36.915641 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-5d415896-b4e0-445d-a950-f221a0674da9 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:36.917294 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-5d415896-b4e0-445d-a950-f221a0674da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:36.932137 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552b649-77d7-4842-b197-419542d27a74 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:36.979395 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738d428-06ec-4007-9631-1015c441bcb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:36.980302 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738d428-06ec-4007-9631-1015c441bcb5 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:36.980769 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738d428-06ec-4007-9631-1015c441bcb5 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:36.981900 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738d428-06ec-4007-9631-1015c441bcb5 None admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:36.982800 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738d428-06ec-4007-9631-1015c441bcb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:36.983260 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738d428-06ec-4007-9631-1015c441bcb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:36.984799 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738d428-06ec-4007-9631-1015c441bcb5 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:37.004885 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 275/548] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:18:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:37.011927 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738d428-06ec-4007-9631-1015c441bcb5 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:37.023744 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 274/549] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 10:18:37.067311 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d415896-b4e0-445d-a950-f221a0674da9 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:37.148927 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738d428-06ec-4007-9631-1015c441bcb5 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:37.186294 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165c9f4-58ee-4484-a7ec-8ac3cb1164c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:37.187119 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165c9f4-58ee-4484-a7ec-8ac3cb1164c4 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:37.187403 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165c9f4-58ee-4484-a7ec-8ac3cb1164c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:37.187676 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165c9f4-58ee-4484-a7ec-8ac3cb1164c4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:37.206743 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8165c9f4-58ee-4484-a7ec-8ac3cb1164c4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:37.208190 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8165c9f4-58ee-4484-a7ec-8ac3cb1164c4 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:37.239543 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d415896-b4e0-445d-a950-f221a0674da9 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:37.241811 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-8165c9f4-58ee-4484-a7ec-8ac3cb1164c4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 28 10:18:37.243373 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 276/550] 10.222.0.21 () {56 vars in 1096 bytes} [Mon Feb 28 10:18:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:37.251681 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165c9f4-58ee-4484-a7ec-8ac3cb1164c4 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:37.279127 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668191b6-e7ae-4eea-af3f-570e94e40c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:37.280754 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668191b6-e7ae-4eea-af3f-570e94e40c58 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:37.281255 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668191b6-e7ae-4eea-af3f-570e94e40c58 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:37.281767 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668191b6-e7ae-4eea-af3f-570e94e40c58 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:37.294225 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668191b6-e7ae-4eea-af3f-570e94e40c58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:18:37.301922 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-668191b6-e7ae-4eea-af3f-570e94e40c58 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 10:18:37.304065 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 275/551] 10.222.0.21 () {56 vars in 1102 bytes} [Mon Feb 28 10:18:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:18:37.310261 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668191b6-e7ae-4eea-af3f-570e94e40c58 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:37.450616 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668191b6-e7ae-4eea-af3f-570e94e40c58 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:37.491081 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152092e-255c-4a48-935e-63319584354e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:37.492374 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152092e-255c-4a48-935e-63319584354e None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:37.493062 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152092e-255c-4a48-935e-63319584354e None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:37.493541 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152092e-255c-4a48-935e-63319584354e None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:37.494496 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152092e-255c-4a48-935e-63319584354e None admin] RBAC: Adding query filter params (name=service) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:37.495034 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152092e-255c-4a48-935e-63319584354e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:37.497586 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152092e-255c-4a48-935e-63319584354e None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:37.504877 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165c9f4-58ee-4484-a7ec-8ac3cb1164c4 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:37.507903 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 276/552] 10.222.0.21 () {56 vars in 1103 bytes} [Mon Feb 28 10:18:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:37.516647 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152092e-255c-4a48-935e-63319584354e None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:37.591449 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e651f-7145-4ffd-b029-b0d83baf6123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:37.592136 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e651f-7145-4ffd-b029-b0d83baf6123 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:37.592418 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e651f-7145-4ffd-b029-b0d83baf6123 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:37.592690 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e651f-7145-4ffd-b029-b0d83baf6123 None admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:37.593529 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e651f-7145-4ffd-b029-b0d83baf6123 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:37.593833 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e651f-7145-4ffd-b029-b0d83baf6123 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:37.595371 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e651f-7145-4ffd-b029-b0d83baf6123 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:37.626255 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 277/553] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Feb 28 10:18:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:37.631621 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e651f-7145-4ffd-b029-b0d83baf6123 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:37.633298 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152092e-255c-4a48-935e-63319584354e None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:37.690429 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a466f79e-2314-4339-b246-7805fdc30f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:37.692204 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466f79e-2314-4339-b246-7805fdc30f0d None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:37.692477 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466f79e-2314-4339-b246-7805fdc30f0d None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:37.692743 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466f79e-2314-4339-b246-7805fdc30f0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:37.709271 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a466f79e-2314-4339-b246-7805fdc30f0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:37.711041 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a466f79e-2314-4339-b246-7805fdc30f0d None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:37.728332 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-a466f79e-2314-4339-b246-7805fdc30f0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:18:37.730160 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 277/554] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:18:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:37.731749 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f21e46-c636-4223-be02-c271ee3ec74c None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:37.732245 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f21e46-c636-4223-be02-c271ee3ec74c None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:37.732728 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f21e46-c636-4223-be02-c271ee3ec74c None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:37.738697 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 278/555] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:18:37.739685 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f21e46-c636-4223-be02-c271ee3ec74c None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:37.772687 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e651f-7145-4ffd-b029-b0d83baf6123 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:37.807038 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce217c3-3e6a-40d6-9068-985756d877dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:37.807819 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce217c3-3e6a-40d6-9068-985756d877dc None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:37.808192 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce217c3-3e6a-40d6-9068-985756d877dc None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:37.808575 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce217c3-3e6a-40d6-9068-985756d877dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:37.875148 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f21e46-c636-4223-be02-c271ee3ec74c None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:37.890687 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce217c3-3e6a-40d6-9068-985756d877dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:37.892595 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce217c3-3e6a-40d6-9068-985756d877dc None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:37.909525 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64cf0f-e916-46cb-a631-6bb58fe2f820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:37.910189 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64cf0f-e916-46cb-a631-6bb58fe2f820 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:37.910510 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64cf0f-e916-46cb-a631-6bb58fe2f820 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:37.910826 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64cf0f-e916-46cb-a631-6bb58fe2f820 None admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:37.911540 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64cf0f-e916-46cb-a631-6bb58fe2f820 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:37.911839 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64cf0f-e916-46cb-a631-6bb58fe2f820 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:37.913249 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64cf0f-e916-46cb-a631-6bb58fe2f820 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:37.926451 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 279/556] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:18:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:37.927781 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0975b2-6f50-4bd5-8b73-3950477798fd None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:37.928079 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0975b2-6f50-4bd5-8b73-3950477798fd None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:37.928392 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0975b2-6f50-4bd5-8b73-3950477798fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:37.945140 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-0f0975b2-6f50-4bd5-8b73-3950477798fd None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:37.946386 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-0f0975b2-6f50-4bd5-8b73-3950477798fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:37.996771 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 278/557] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:18:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Feb 28 10:18:37.998025 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce217c3-3e6a-40d6-9068-985756d877dc None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:38.034700 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 280/558] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:18:38.034700 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0975b2-6f50-4bd5-8b73-3950477798fd None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:38.131258 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce217c3-3e6a-40d6-9068-985756d877dc None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:38.145402 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0975b2-6f50-4bd5-8b73-3950477798fd None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:38.174694 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5230be1e-3568-423b-8c72-b914a667d985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:38.175763 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230be1e-3568-423b-8c72-b914a667d985 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:38.176093 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230be1e-3568-423b-8c72-b914a667d985 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:38.176394 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230be1e-3568-423b-8c72-b914a667d985 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:38.181167 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d006c-8e4a-47d0-9b9f-7f8ca4603cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:38.182234 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d006c-8e4a-47d0-9b9f-7f8ca4603cd2 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:38.182766 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d006c-8e4a-47d0-9b9f-7f8ca4603cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:38.183312 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d006c-8e4a-47d0-9b9f-7f8ca4603cd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:38.185990 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5230be1e-3568-423b-8c72-b914a667d985 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:38.187507 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5230be1e-3568-423b-8c72-b914a667d985 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:38.195969 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646d006c-8e4a-47d0-9b9f-7f8ca4603cd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:38.198002 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646d006c-8e4a-47d0-9b9f-7f8ca4603cd2 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:38.202227 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-5230be1e-3568-423b-8c72-b914a667d985 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 10:18:38.203447 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 279/559] 10.222.0.21 () {56 vars in 1093 bytes} [Mon Feb 28 10:18:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:38.204380 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5230be1e-3568-423b-8c72-b914a667d985 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:38.217818 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-646d006c-8e4a-47d0-9b9f-7f8ca4603cd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:18:38.223529 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 281/560] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:18:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:38.223529 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc08797-9d30-4f62-86eb-440778065d49 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:38.223529 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc08797-9d30-4f62-86eb-440778065d49 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:38.223529 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc08797-9d30-4f62-86eb-440778065d49 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:38.226451 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 282/561] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:18:38.227262 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc08797-9d30-4f62-86eb-440778065d49 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:38.309678 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5230be1e-3568-423b-8c72-b914a667d985 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:38.324660 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc08797-9d30-4f62-86eb-440778065d49 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:38.343565 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73af8351-c093-4b1c-b138-7d081b833c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:38.344355 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af8351-c093-4b1c-b138-7d081b833c96 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:38.344637 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af8351-c093-4b1c-b138-7d081b833c96 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:38.344911 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af8351-c093-4b1c-b138-7d081b833c96 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:38.354897 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73af8351-c093-4b1c-b138-7d081b833c96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:18:38.358062 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fdcd30-7b71-4035-b2ae-3525f23d5e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:38.358743 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fdcd30-7b71-4035-b2ae-3525f23d5e89 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:38.359022 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fdcd30-7b71-4035-b2ae-3525f23d5e89 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:38.359289 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fdcd30-7b71-4035-b2ae-3525f23d5e89 None admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:38.360105 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fdcd30-7b71-4035-b2ae-3525f23d5e89 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:38.360401 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fdcd30-7b71-4035-b2ae-3525f23d5e89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:38.361812 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fdcd30-7b71-4035-b2ae-3525f23d5e89 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:38.361919 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-73af8351-c093-4b1c-b138-7d081b833c96 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 10:18:38.367982 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 280/562] 10.222.0.21 () {56 vars in 1102 bytes} [Mon Feb 28 10:18:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:38.367982 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73af8351-c093-4b1c-b138-7d081b833c96 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:38.386176 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 283/563] 10.222.0.21 () {56 vars in 1133 bytes} [Mon Feb 28 10:18:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:38.388761 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b4a14-1346-466f-bbd1-25e4d6515d0a None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:38.389042 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b4a14-1346-466f-bbd1-25e4d6515d0a None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:38.389314 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b4a14-1346-466f-bbd1-25e4d6515d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:38.407746 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-ef4b4a14-1346-466f-bbd1-25e4d6515d0a None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:38.408917 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-ef4b4a14-1346-466f-bbd1-25e4d6515d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:38.472422 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73af8351-c093-4b1c-b138-7d081b833c96 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:38.498621 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 284/564] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:18:38.498621 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b4a14-1346-466f-bbd1-25e4d6515d0a None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:38.515736 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c6d51-6f5a-4f03-ac1e-7abcefe2b5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:38.516549 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c6d51-6f5a-4f03-ac1e-7abcefe2b5c5 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:38.516794 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c6d51-6f5a-4f03-ac1e-7abcefe2b5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:38.516997 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c6d51-6f5a-4f03-ac1e-7abcefe2b5c5 None admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:38.517870 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c6d51-6f5a-4f03-ac1e-7abcefe2b5c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:38.518058 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c6d51-6f5a-4f03-ac1e-7abcefe2b5c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:38.519540 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c6d51-6f5a-4f03-ac1e-7abcefe2b5c5 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:38.532548 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 281/565] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:18:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:38.533401 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c6d51-6f5a-4f03-ac1e-7abcefe2b5c5 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:38.602174 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b4a14-1346-466f-bbd1-25e4d6515d0a None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:38.630103 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c6d51-6f5a-4f03-ac1e-7abcefe2b5c5 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:38.634884 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e167a16-9c65-4090-9fe0-437b2de95050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:38.635540 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e167a16-9c65-4090-9fe0-437b2de95050 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:38.635815 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e167a16-9c65-4090-9fe0-437b2de95050 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:38.636079 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e167a16-9c65-4090-9fe0-437b2de95050 None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:38.636806 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e167a16-9c65-4090-9fe0-437b2de95050 None admin] RBAC: Adding query filter params (name=service) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:38.637734 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e167a16-9c65-4090-9fe0-437b2de95050 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:38.639187 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e167a16-9c65-4090-9fe0-437b2de95050 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:38.651825 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 285/566] 10.222.0.21 () {56 vars in 1103 bytes} [Mon Feb 28 10:18:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:38.651825 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e167a16-9c65-4090-9fe0-437b2de95050 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:38.670137 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5013ca3b-a91a-41df-a087-4916a8f38598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:38.671175 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013ca3b-a91a-41df-a087-4916a8f38598 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:38.671627 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013ca3b-a91a-41df-a087-4916a8f38598 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:38.672063 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013ca3b-a91a-41df-a087-4916a8f38598 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:38.681780 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5013ca3b-a91a-41df-a087-4916a8f38598 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:38.683253 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5013ca3b-a91a-41df-a087-4916a8f38598 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:38.701274 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-5013ca3b-a91a-41df-a087-4916a8f38598 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:18:38.702471 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 282/567] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:18:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:38.702471 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5013ca3b-a91a-41df-a087-4916a8f38598 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:38.750319 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e167a16-9c65-4090-9fe0-437b2de95050 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:38.784909 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b757e21-cc19-4f8f-90e8-3dbc41c62307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:38.786229 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b757e21-cc19-4f8f-90e8-3dbc41c62307 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:38.786862 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b757e21-cc19-4f8f-90e8-3dbc41c62307 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:38.787603 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b757e21-cc19-4f8f-90e8-3dbc41c62307 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:38.798612 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b757e21-cc19-4f8f-90e8-3dbc41c62307 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:18:38.801868 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5013ca3b-a91a-41df-a087-4916a8f38598 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:38.805351 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-6b757e21-cc19-4f8f-90e8-3dbc41c62307 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 10:18:38.806524 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 286/568] 10.222.0.21 () {56 vars in 1102 bytes} [Mon Feb 28 10:18:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:38.807304 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b757e21-cc19-4f8f-90e8-3dbc41c62307 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:38.835323 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6d354-6a36-4663-81fd-7c24578188e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:38.836113 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6d354-6a36-4663-81fd-7c24578188e9 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:38.836392 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6d354-6a36-4663-81fd-7c24578188e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:38.836665 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6d354-6a36-4663-81fd-7c24578188e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:38.844166 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d6d354-6a36-4663-81fd-7c24578188e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:38.845609 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d6d354-6a36-4663-81fd-7c24578188e9 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:38.860394 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-f1d6d354-6a36-4663-81fd-7c24578188e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:18:38.861522 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 283/569] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:18:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:38.862287 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6d354-6a36-4663-81fd-7c24578188e9 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:38.904298 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b757e21-cc19-4f8f-90e8-3dbc41c62307 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:38.935490 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d50d52d-fa2c-4d87-a313-6b90f73dc2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:38.936259 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50d52d-fa2c-4d87-a313-6b90f73dc2a5 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:38.936534 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50d52d-fa2c-4d87-a313-6b90f73dc2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:38.936802 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50d52d-fa2c-4d87-a313-6b90f73dc2a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:38.946936 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d50d52d-fa2c-4d87-a313-6b90f73dc2a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:38.948351 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d50d52d-fa2c-4d87-a313-6b90f73dc2a5 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:38.956017 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6d354-6a36-4663-81fd-7c24578188e9 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:38.964241 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-1d50d52d-fa2c-4d87-a313-6b90f73dc2a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:18:38.965415 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 287/570] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:18:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:38.966703 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8871f-d648-40e6-9829-20af3cee75eb None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:38.966983 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8871f-d648-40e6-9829-20af3cee75eb None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:38.967251 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8871f-d648-40e6-9829-20af3cee75eb None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:38.968886 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 288/571] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:18:38.969565 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a8871f-d648-40e6-9829-20af3cee75eb None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:38.992052 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea235b2-f366-449a-9e75-fabd2ecb7e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:38.992709 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea235b2-f366-449a-9e75-fabd2ecb7e26 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:38.992989 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea235b2-f366-449a-9e75-fabd2ecb7e26 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:38.993271 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea235b2-f366-449a-9e75-fabd2ecb7e26 None admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:38.993968 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea235b2-f366-449a-9e75-fabd2ecb7e26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:38.994270 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea235b2-f366-449a-9e75-fabd2ecb7e26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:38.995653 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea235b2-f366-449a-9e75-fabd2ecb7e26 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:39.007624 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 284/572] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:18:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:39.008404 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea235b2-f366-449a-9e75-fabd2ecb7e26 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:39.066098 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a8871f-d648-40e6-9829-20af3cee75eb None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:39.097646 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b9cb2-6b0a-4d54-b8fd-f77652561023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:39.098297 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b9cb2-6b0a-4d54-b8fd-f77652561023 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:39.098567 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b9cb2-6b0a-4d54-b8fd-f77652561023 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:39.098858 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b9cb2-6b0a-4d54-b8fd-f77652561023 None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:39.099578 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908b9cb2-6b0a-4d54-b8fd-f77652561023 None admin] RBAC: Adding query filter params (name=service) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:39.099875 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908b9cb2-6b0a-4d54-b8fd-f77652561023 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:39.100746 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea235b2-f366-449a-9e75-fabd2ecb7e26 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:39.101218 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908b9cb2-6b0a-4d54-b8fd-f77652561023 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:39.108991 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 289/573] 10.222.0.21 () {56 vars in 1103 bytes} [Mon Feb 28 10:18:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:39.109761 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b9cb2-6b0a-4d54-b8fd-f77652561023 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:39.133441 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39b743-aeed-4c14-bbc7-ca6b11194994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:39.134037 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39b743-aeed-4c14-bbc7-ca6b11194994 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:39.134303 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39b743-aeed-4c14-bbc7-ca6b11194994 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:39.134575 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39b743-aeed-4c14-bbc7-ca6b11194994 None admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:39.135385 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b39b743-aeed-4c14-bbc7-ca6b11194994 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:39.135696 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b39b743-aeed-4c14-bbc7-ca6b11194994 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:39.137711 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b39b743-aeed-4c14-bbc7-ca6b11194994 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:39.148751 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 285/574] 10.222.0.21 () {56 vars in 1148 bytes} [Mon Feb 28 10:18:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:39.149961 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f658e3-8e39-4dc9-b57f-51e69a9681cf None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:39.150244 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f658e3-8e39-4dc9-b57f-51e69a9681cf None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:39.150517 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f658e3-8e39-4dc9-b57f-51e69a9681cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:39.166503 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-31f658e3-8e39-4dc9-b57f-51e69a9681cf None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:39.167728 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-31f658e3-8e39-4dc9-b57f-51e69a9681cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:39.204138 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b9cb2-6b0a-4d54-b8fd-f77652561023 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:39.230082 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 286/575] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:18:39.231083 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f658e3-8e39-4dc9-b57f-51e69a9681cf None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:39.235755 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df5dc8-3ec1-4e64-8a1e-6084719e7869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:39.236401 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df5dc8-3ec1-4e64-8a1e-6084719e7869 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:39.236678 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df5dc8-3ec1-4e64-8a1e-6084719e7869 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:39.236946 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df5dc8-3ec1-4e64-8a1e-6084719e7869 None admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:39.237642 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df5dc8-3ec1-4e64-8a1e-6084719e7869 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:39.237937 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df5dc8-3ec1-4e64-8a1e-6084719e7869 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:39.239316 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df5dc8-3ec1-4e64-8a1e-6084719e7869 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:39.251766 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 290/576] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:39.252862 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df5dc8-3ec1-4e64-8a1e-6084719e7869 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:39.323658 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f658e3-8e39-4dc9-b57f-51e69a9681cf None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:39.345513 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df5dc8-3ec1-4e64-8a1e-6084719e7869 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:39.355360 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3809b-0a94-4f50-8bca-96172e0d7675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:39.356735 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3809b-0a94-4f50-8bca-96172e0d7675 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:39.357004 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3809b-0a94-4f50-8bca-96172e0d7675 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:39.357265 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3809b-0a94-4f50-8bca-96172e0d7675 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:39.363552 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee3809b-0a94-4f50-8bca-96172e0d7675 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:39.364969 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee3809b-0a94-4f50-8bca-96172e0d7675 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:39.378194 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace04afd-4c3f-4ec7-a8e3-0f803d0f5bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:39.378995 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace04afd-4c3f-4ec7-a8e3-0f803d0f5bbe None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:39.379125 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-aee3809b-0a94-4f50-8bca-96172e0d7675 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:18:39.379265 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace04afd-4c3f-4ec7-a8e3-0f803d0f5bbe None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:39.379529 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace04afd-4c3f-4ec7-a8e3-0f803d0f5bbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:39.380367 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 287/577] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:18:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:39.381113 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3809b-0a94-4f50-8bca-96172e0d7675 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:39.389697 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace04afd-4c3f-4ec7-a8e3-0f803d0f5bbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:39.391174 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace04afd-4c3f-4ec7-a8e3-0f803d0f5bbe None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:39.407221 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-ace04afd-4c3f-4ec7-a8e3-0f803d0f5bbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:18:39.408513 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 291/578] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:18:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:39.409201 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace04afd-4c3f-4ec7-a8e3-0f803d0f5bbe None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:39.472707 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3809b-0a94-4f50-8bca-96172e0d7675 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:39.504283 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace04afd-4c3f-4ec7-a8e3-0f803d0f5bbe None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:39.506675 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b7896-cfdf-45c3-a554-1972022834fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:39.507646 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b7896-cfdf-45c3-a554-1972022834fc None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:39.507973 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b7896-cfdf-45c3-a554-1972022834fc None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:39.508302 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b7896-cfdf-45c3-a554-1972022834fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:39.509694 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8b7896-cfdf-45c3-a554-1972022834fc None admin] RBAC: Adding query filter params (role.id=060d4a1eef7a45858664a42696ff4a19, scope.project.id=5d1d6f8141924b2d99b766f975a3d43b, user.id=8696fe8a37aa4d73a62bdc2efd35a23d) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:39.510192 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8b7896-cfdf-45c3-a554-1972022834fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:39.512706 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8b7896-cfdf-45c3-a554-1972022834fc None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:39.519831 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 288/579] 10.222.0.21 () {56 vars in 1374 bytes} [Mon Feb 28 10:18:39 2022] GET /identity/v3/role_assignments?user.id=8696fe8a37aa4d73a62bdc2efd35a23d&scope.project.id=5d1d6f8141924b2d99b766f975a3d43b&role.id=060d4a1eef7a45858664a42696ff4a19 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:39.520578 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b7896-cfdf-45c3-a554-1972022834fc None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:39.545441 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f9a52-9ae9-45f6-9982-0adb84b91a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:39.546568 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f9a52-9ae9-45f6-9982-0adb84b91a99 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:39.547084 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f9a52-9ae9-45f6-9982-0adb84b91a99 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:39.547528 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f9a52-9ae9-45f6-9982-0adb84b91a99 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:39.560398 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3f9a52-9ae9-45f6-9982-0adb84b91a99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:18:39.567698 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-fd3f9a52-9ae9-45f6-9982-0adb84b91a99 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 10:18:39.569271 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 292/580] 10.222.0.21 () {56 vars in 1102 bytes} [Mon Feb 28 10:18:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:39.570044 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f9a52-9ae9-45f6-9982-0adb84b91a99 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:39.627937 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b7896-cfdf-45c3-a554-1972022834fc None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:39.663074 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e5a1cb-10f7-42c7-bc2c-2f897ea8bc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:39.663787 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5a1cb-10f7-42c7-bc2c-2f897ea8bc77 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:39.664070 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5a1cb-10f7-42c7-bc2c-2f897ea8bc77 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:39.664345 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5a1cb-10f7-42c7-bc2c-2f897ea8bc77 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:39.673306 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e5a1cb-10f7-42c7-bc2c-2f897ea8bc77 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:39.674786 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e5a1cb-10f7-42c7-bc2c-2f897ea8bc77 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:39.676295 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f9a52-9ae9-45f6-9982-0adb84b91a99 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:39.689321 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-74e5a1cb-10f7-42c7-bc2c-2f897ea8bc77 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 28 10:18:39.690579 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 289/581] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:18:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:39.691384 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e5a1cb-10f7-42c7-bc2c-2f897ea8bc77 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:39.728349 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d9abcf-f843-426d-b741-3e63a11b7126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:39.729002 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9abcf-f843-426d-b741-3e63a11b7126 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:39.729284 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9abcf-f843-426d-b741-3e63a11b7126 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:39.729557 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9abcf-f843-426d-b741-3e63a11b7126 None admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:39.730333 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d9abcf-f843-426d-b741-3e63a11b7126 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:39.730670 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d9abcf-f843-426d-b741-3e63a11b7126 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:39.732838 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d9abcf-f843-426d-b741-3e63a11b7126 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:39.744726 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 293/582] 10.222.0.21 () {56 vars in 1148 bytes} [Mon Feb 28 10:18:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:39.745527 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d9abcf-f843-426d-b741-3e63a11b7126 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:39.793982 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e5a1cb-10f7-42c7-bc2c-2f897ea8bc77 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:39.826197 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de587b-ce7a-4fea-9f1f-1e3abb6ab2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:39.826979 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de587b-ce7a-4fea-9f1f-1e3abb6ab2a6 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:39.827260 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de587b-ce7a-4fea-9f1f-1e3abb6ab2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:39.827531 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de587b-ce7a-4fea-9f1f-1e3abb6ab2a6 None admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:39.828235 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de587b-ce7a-4fea-9f1f-1e3abb6ab2a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:39.828534 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de587b-ce7a-4fea-9f1f-1e3abb6ab2a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:39.829888 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de587b-ce7a-4fea-9f1f-1e3abb6ab2a6 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:39.841734 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 290/583] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:39.842545 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de587b-ce7a-4fea-9f1f-1e3abb6ab2a6 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:39.853686 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d9abcf-f843-426d-b741-3e63a11b7126 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:39.888153 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad2efd-0045-472a-bfac-df054b589f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:39.889199 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad2efd-0045-472a-bfac-df054b589f15 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:39.889477 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad2efd-0045-472a-bfac-df054b589f15 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:39.889745 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad2efd-0045-472a-bfac-df054b589f15 None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:39.890535 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad2efd-0045-472a-bfac-df054b589f15 None admin] RBAC: Adding query filter params (name=service) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:39.890868 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad2efd-0045-472a-bfac-df054b589f15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:39.892232 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad2efd-0045-472a-bfac-df054b589f15 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:39.905193 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 294/584] 10.222.0.21 () {56 vars in 1103 bytes} [Mon Feb 28 10:18:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:39.905193 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad2efd-0045-472a-bfac-df054b589f15 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:39.949082 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de587b-ce7a-4fea-9f1f-1e3abb6ab2a6 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:39.982282 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97136f47-0674-4a05-a7e5-7352c9dbf9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:39.982983 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97136f47-0674-4a05-a7e5-7352c9dbf9c8 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:39.983317 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97136f47-0674-4a05-a7e5-7352c9dbf9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:39.983593 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97136f47-0674-4a05-a7e5-7352c9dbf9c8 None admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:39.984404 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97136f47-0674-4a05-a7e5-7352c9dbf9c8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:39.984706 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97136f47-0674-4a05-a7e5-7352c9dbf9c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:39.986151 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97136f47-0674-4a05-a7e5-7352c9dbf9c8 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:40.003230 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 291/585] 10.222.0.21 () {56 vars in 1137 bytes} [Mon Feb 28 10:18:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:40.006087 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad2efd-0045-472a-bfac-df054b589f15 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:40.008248 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97136f47-0674-4a05-a7e5-7352c9dbf9c8 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:40.038825 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768fad8-9f94-42b7-9937-286d7cc2832e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:40.039699 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768fad8-9f94-42b7-9937-286d7cc2832e None admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:40.039970 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768fad8-9f94-42b7-9937-286d7cc2832e None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:40.040231 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768fad8-9f94-42b7-9937-286d7cc2832e None admin] PATH_INFO: `/v3/projects/5d1d6f8141924b2d99b766f975a3d43b/users/ec202a34db8e47f4a6c18285245e3f5b/roles/060d4a1eef7a45858664a42696ff4a19` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:40.054070 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768fad8-9f94-42b7-9937-286d7cc2832e None admin] RBAC: Authorizing `identity:create_grant(project_id=5d1d6f8141924b2d99b766f975a3d43b, user_id=ec202a34db8e47f4a6c18285245e3f5b, role_id=060d4a1eef7a45858664a42696ff4a19)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:40.055577 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768fad8-9f94-42b7-9937-286d7cc2832e None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:40.078633 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 295/586] 10.222.0.21 () {58 vars in 1439 bytes} [Mon Feb 28 10:18:39 2022] PUT /identity/v3/projects/5d1d6f8141924b2d99b766f975a3d43b/users/ec202a34db8e47f4a6c18285245e3f5b/roles/060d4a1eef7a45858664a42696ff4a19 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:18:40.078633 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768fad8-9f94-42b7-9937-286d7cc2832e None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:40.129037 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97136f47-0674-4a05-a7e5-7352c9dbf9c8 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:40.176110 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2eaf7-3277-4560-91d0-e49785a46461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:40.176925 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2eaf7-3277-4560-91d0-e49785a46461 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:40.177205 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2eaf7-3277-4560-91d0-e49785a46461 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:40.177477 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2eaf7-3277-4560-91d0-e49785a46461 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:40.188664 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a2eaf7-3277-4560-91d0-e49785a46461 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:40.190264 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a2eaf7-3277-4560-91d0-e49785a46461 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:40.190863 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768fad8-9f94-42b7-9937-286d7cc2832e None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:40.209674 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-d4a2eaf7-3277-4560-91d0-e49785a46461 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 28 10:18:40.211845 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 292/587] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:18:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:40.212798 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2eaf7-3277-4560-91d0-e49785a46461 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:40.233044 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef9175d-b60f-401d-80bd-0d135fea0fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:40.233925 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9175d-b60f-401d-80bd-0d135fea0fcb None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:40.234339 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9175d-b60f-401d-80bd-0d135fea0fcb None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:40.234718 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9175d-b60f-401d-80bd-0d135fea0fcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:40.248268 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef9175d-b60f-401d-80bd-0d135fea0fcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:40.250318 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef9175d-b60f-401d-80bd-0d135fea0fcb None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:40.269820 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-8ef9175d-b60f-401d-80bd-0d135fea0fcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:18:40.272001 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 296/588] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:18:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:40.272788 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef9175d-b60f-401d-80bd-0d135fea0fcb None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:40.318491 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2eaf7-3277-4560-91d0-e49785a46461 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:40.354404 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa20f246-9999-4550-b258-a04b4381ba7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:40.355242 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20f246-9999-4550-b258-a04b4381ba7e None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:40.355520 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20f246-9999-4550-b258-a04b4381ba7e None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:40.356193 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20f246-9999-4550-b258-a04b4381ba7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:40.366328 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa20f246-9999-4550-b258-a04b4381ba7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:40.367801 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa20f246-9999-4550-b258-a04b4381ba7e None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:40.379623 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef9175d-b60f-401d-80bd-0d135fea0fcb None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:40.384615 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-aa20f246-9999-4550-b258-a04b4381ba7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:18:40.386174 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 293/589] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:18:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:40.391484 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa20f246-9999-4550-b258-a04b4381ba7e None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:40.420197 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71517c7d-c562-4009-8932-ffe77d499424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:40.421190 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71517c7d-c562-4009-8932-ffe77d499424 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:40.421648 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71517c7d-c562-4009-8932-ffe77d499424 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:40.422108 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71517c7d-c562-4009-8932-ffe77d499424 None admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:40.423147 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71517c7d-c562-4009-8932-ffe77d499424 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:40.423628 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71517c7d-c562-4009-8932-ffe77d499424 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:40.425219 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71517c7d-c562-4009-8932-ffe77d499424 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:40.443937 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 297/590] 10.222.0.21 () {56 vars in 1137 bytes} [Mon Feb 28 10:18:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:40.449473 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71517c7d-c562-4009-8932-ffe77d499424 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:40.488435 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa20f246-9999-4550-b258-a04b4381ba7e None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:40.525695 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a431bc3-ad65-4b34-8cb8-73db2ed16f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:40.526362 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a431bc3-ad65-4b34-8cb8-73db2ed16f44 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:40.526727 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a431bc3-ad65-4b34-8cb8-73db2ed16f44 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:40.526916 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a431bc3-ad65-4b34-8cb8-73db2ed16f44 None admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:40.527845 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a431bc3-ad65-4b34-8cb8-73db2ed16f44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:40.528199 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a431bc3-ad65-4b34-8cb8-73db2ed16f44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:40.529863 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a431bc3-ad65-4b34-8cb8-73db2ed16f44 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:40.542469 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 294/591] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:18:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:40.543519 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a431bc3-ad65-4b34-8cb8-73db2ed16f44 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:40.569342 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71517c7d-c562-4009-8932-ffe77d499424 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:40.605099 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7073744-4029-4803-8cef-72b6e6628180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:40.606130 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7073744-4029-4803-8cef-72b6e6628180 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:40.606638 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7073744-4029-4803-8cef-72b6e6628180 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:40.607087 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7073744-4029-4803-8cef-72b6e6628180 None admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:40.607969 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7073744-4029-4803-8cef-72b6e6628180 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:40.608658 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7073744-4029-4803-8cef-72b6e6628180 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:40.610252 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7073744-4029-4803-8cef-72b6e6628180 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:40.627390 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 298/592] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:18:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:40.628533 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7073744-4029-4803-8cef-72b6e6628180 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:40.644869 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a431bc3-ad65-4b34-8cb8-73db2ed16f44 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:40.678969 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec85d2-afea-48c2-aef1-51982a58aa37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:40.679758 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec85d2-afea-48c2-aef1-51982a58aa37 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:40.680036 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec85d2-afea-48c2-aef1-51982a58aa37 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:40.680306 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec85d2-afea-48c2-aef1-51982a58aa37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:40.692227 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec85d2-afea-48c2-aef1-51982a58aa37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:40.693738 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec85d2-afea-48c2-aef1-51982a58aa37 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:40.711058 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-f8ec85d2-afea-48c2-aef1-51982a58aa37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:18:40.717323 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 295/593] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:18:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:40.717323 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec85d2-afea-48c2-aef1-51982a58aa37 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:40.741740 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7073744-4029-4803-8cef-72b6e6628180 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:40.776116 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb6e3a-c857-4d63-8a9c-106a4ee30e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:40.777225 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb6e3a-c857-4d63-8a9c-106a4ee30e4b None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:40.778265 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb6e3a-c857-4d63-8a9c-106a4ee30e4b None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:40.778748 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb6e3a-c857-4d63-8a9c-106a4ee30e4b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:40.786854 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb6e3a-c857-4d63-8a9c-106a4ee30e4b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:40.788524 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb6e3a-c857-4d63-8a9c-106a4ee30e4b None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:40.803138 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-1cbb6e3a-c857-4d63-8a9c-106a4ee30e4b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 28 10:18:40.804848 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 299/594] 10.222.0.21 () {56 vars in 1102 bytes} [Mon Feb 28 10:18:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:40.805882 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb6e3a-c857-4d63-8a9c-106a4ee30e4b None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:40.815443 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec85d2-afea-48c2-aef1-51982a58aa37 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:40.852669 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505293c8-e237-4c17-a8db-46298ebed5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:40.853345 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505293c8-e237-4c17-a8db-46298ebed5a5 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:40.853633 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505293c8-e237-4c17-a8db-46298ebed5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:40.853903 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505293c8-e237-4c17-a8db-46298ebed5a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:40.861125 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505293c8-e237-4c17-a8db-46298ebed5a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:40.862348 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505293c8-e237-4c17-a8db-46298ebed5a5 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:40.875832 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-505293c8-e237-4c17-a8db-46298ebed5a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:18:40.881722 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 296/595] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:18:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:40.881722 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505293c8-e237-4c17-a8db-46298ebed5a5 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:40.921214 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb6e3a-c857-4d63-8a9c-106a4ee30e4b None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:40.957506 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7888ee-e3cd-47ab-abc0-78fa0abbf349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:40.958216 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7888ee-e3cd-47ab-abc0-78fa0abbf349 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:40.958502 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7888ee-e3cd-47ab-abc0-78fa0abbf349 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:40.958830 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7888ee-e3cd-47ab-abc0-78fa0abbf349 None admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:40.959549 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7888ee-e3cd-47ab-abc0-78fa0abbf349 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:40.959850 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7888ee-e3cd-47ab-abc0-78fa0abbf349 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:40.961208 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7888ee-e3cd-47ab-abc0-78fa0abbf349 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:40.973970 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 300/596] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:18:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:40.974869 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7888ee-e3cd-47ab-abc0-78fa0abbf349 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:40.987899 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505293c8-e237-4c17-a8db-46298ebed5a5 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:41.022701 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39f3b8-951c-4a14-80b7-2bb61626cfdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:41.023302 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39f3b8-951c-4a14-80b7-2bb61626cfdc None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:41.023582 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39f3b8-951c-4a14-80b7-2bb61626cfdc None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:41.023853 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39f3b8-951c-4a14-80b7-2bb61626cfdc None admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:41.024674 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a39f3b8-951c-4a14-80b7-2bb61626cfdc None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:41.024978 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a39f3b8-951c-4a14-80b7-2bb61626cfdc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:41.026390 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a39f3b8-951c-4a14-80b7-2bb61626cfdc None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:41.044772 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 297/597] 10.222.0.21 () {56 vars in 1139 bytes} [Mon Feb 28 10:18:40 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:41.045701 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39f3b8-951c-4a14-80b7-2bb61626cfdc None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:41.086630 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7888ee-e3cd-47ab-abc0-78fa0abbf349 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:41.130474 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec41616-7f91-4a79-bcf3-3542b197ab72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:41.131178 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec41616-7f91-4a79-bcf3-3542b197ab72 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:41.131460 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec41616-7f91-4a79-bcf3-3542b197ab72 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:41.131792 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec41616-7f91-4a79-bcf3-3542b197ab72 None admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:41.132579 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec41616-7f91-4a79-bcf3-3542b197ab72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:41.132926 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec41616-7f91-4a79-bcf3-3542b197ab72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:41.134346 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec41616-7f91-4a79-bcf3-3542b197ab72 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:41.147331 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 301/598] 10.222.0.21 () {56 vars in 1148 bytes} [Mon Feb 28 10:18:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:41.148371 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec41616-7f91-4a79-bcf3-3542b197ab72 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:41.158853 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39f3b8-951c-4a14-80b7-2bb61626cfdc None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:41.194246 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7f2a9-6108-4a54-a4c4-d9a40cb7e66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:41.195093 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7f2a9-6108-4a54-a4c4-d9a40cb7e66a None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:41.195372 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7f2a9-6108-4a54-a4c4-d9a40cb7e66a None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:41.195641 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7f2a9-6108-4a54-a4c4-d9a40cb7e66a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:41.203083 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe7f2a9-6108-4a54-a4c4-d9a40cb7e66a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:41.204563 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe7f2a9-6108-4a54-a4c4-d9a40cb7e66a None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:41.219010 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-dfe7f2a9-6108-4a54-a4c4-d9a40cb7e66a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:18:41.224973 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 298/599] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:18:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:41.226052 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7f2a9-6108-4a54-a4c4-d9a40cb7e66a None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:41.249581 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec41616-7f91-4a79-bcf3-3542b197ab72 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:41.285595 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a76492-548f-44a5-9d59-d075d75ec637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:41.286305 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a76492-548f-44a5-9d59-d075d75ec637 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:41.286589 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a76492-548f-44a5-9d59-d075d75ec637 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:41.286907 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a76492-548f-44a5-9d59-d075d75ec637 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:41.298403 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a76492-548f-44a5-9d59-d075d75ec637 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:41.299895 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a76492-548f-44a5-9d59-d075d75ec637 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:41.316405 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-10a76492-548f-44a5-9d59-d075d75ec637 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:18:41.317961 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 302/600] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:18:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:41.318902 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a76492-548f-44a5-9d59-d075d75ec637 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:41.328821 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7f2a9-6108-4a54-a4c4-d9a40cb7e66a None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:41.363507 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a727a7f-8f0a-4302-8fc6-354f079ff837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:41.364394 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a727a7f-8f0a-4302-8fc6-354f079ff837 None admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:41.364673 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a727a7f-8f0a-4302-8fc6-354f079ff837 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:41.364944 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a727a7f-8f0a-4302-8fc6-354f079ff837 None admin] PATH_INFO: `/v3/projects/5d1d6f8141924b2d99b766f975a3d43b/users/d99b63b9b6e44219921569db1bf2e0dd/roles/060d4a1eef7a45858664a42696ff4a19` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:41.379669 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a727a7f-8f0a-4302-8fc6-354f079ff837 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d1d6f8141924b2d99b766f975a3d43b, user_id=d99b63b9b6e44219921569db1bf2e0dd, role_id=060d4a1eef7a45858664a42696ff4a19)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:41.381104 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a727a7f-8f0a-4302-8fc6-354f079ff837 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:41.398496 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 299/601] 10.222.0.21 () {58 vars in 1439 bytes} [Mon Feb 28 10:18:41 2022] PUT /identity/v3/projects/5d1d6f8141924b2d99b766f975a3d43b/users/d99b63b9b6e44219921569db1bf2e0dd/roles/060d4a1eef7a45858664a42696ff4a19 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:18:41.404303 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a727a7f-8f0a-4302-8fc6-354f079ff837 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:41.464903 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a76492-548f-44a5-9d59-d075d75ec637 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:41.544360 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03ef66-762d-4563-88c1-5525c47ef90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:41.545067 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03ef66-762d-4563-88c1-5525c47ef90d None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:41.545345 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03ef66-762d-4563-88c1-5525c47ef90d None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:41.545618 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03ef66-762d-4563-88c1-5525c47ef90d None admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:41.547477 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03ef66-762d-4563-88c1-5525c47ef90d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:41.547788 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03ef66-762d-4563-88c1-5525c47ef90d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:41.549308 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03ef66-762d-4563-88c1-5525c47ef90d None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:41.585214 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 303/602] 10.222.0.21 () {56 vars in 1148 bytes} [Mon Feb 28 10:18:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:41.588786 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03ef66-762d-4563-88c1-5525c47ef90d None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:41.641439 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a727a7f-8f0a-4302-8fc6-354f079ff837 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:41.676867 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7db6c-7243-4b09-9a72-d57104def4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:41.677533 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7db6c-7243-4b09-9a72-d57104def4eb None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:41.677810 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7db6c-7243-4b09-9a72-d57104def4eb None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:41.678085 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7db6c-7243-4b09-9a72-d57104def4eb None admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:41.678826 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a7db6c-7243-4b09-9a72-d57104def4eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:41.679128 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a7db6c-7243-4b09-9a72-d57104def4eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:41.680495 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a7db6c-7243-4b09-9a72-d57104def4eb None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:41.692758 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 300/603] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:18:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:41.698000 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7db6c-7243-4b09-9a72-d57104def4eb None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:41.712954 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03ef66-762d-4563-88c1-5525c47ef90d None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:41.747571 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5718cd-c6a0-4b3c-8a16-ee6cac403eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:41.748459 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5718cd-c6a0-4b3c-8a16-ee6cac403eb4 None admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:41.748741 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5718cd-c6a0-4b3c-8a16-ee6cac403eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:41.749015 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5718cd-c6a0-4b3c-8a16-ee6cac403eb4 None admin] PATH_INFO: `/v3/projects/5d1d6f8141924b2d99b766f975a3d43b/users/b2e92304833d47828c52ae737f6b96cc/roles/060d4a1eef7a45858664a42696ff4a19` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:41.764254 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5718cd-c6a0-4b3c-8a16-ee6cac403eb4 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d1d6f8141924b2d99b766f975a3d43b, user_id=b2e92304833d47828c52ae737f6b96cc, role_id=060d4a1eef7a45858664a42696ff4a19)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:41.765710 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5718cd-c6a0-4b3c-8a16-ee6cac403eb4 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:41.791586 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 304/604] 10.222.0.21 () {58 vars in 1439 bytes} [Mon Feb 28 10:18:41 2022] PUT /identity/v3/projects/5d1d6f8141924b2d99b766f975a3d43b/users/b2e92304833d47828c52ae737f6b96cc/roles/060d4a1eef7a45858664a42696ff4a19 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:18:41.814693 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7db6c-7243-4b09-9a72-d57104def4eb None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:41.867725 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33cf0e8-f46b-4c1c-9d1f-27ceb95907fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:41.868520 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cf0e8-f46b-4c1c-9d1f-27ceb95907fc None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:41.868799 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cf0e8-f46b-4c1c-9d1f-27ceb95907fc None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:41.869068 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cf0e8-f46b-4c1c-9d1f-27ceb95907fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:41.881840 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33cf0e8-f46b-4c1c-9d1f-27ceb95907fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:41.883439 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33cf0e8-f46b-4c1c-9d1f-27ceb95907fc None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:41.907036 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-e33cf0e8-f46b-4c1c-9d1f-27ceb95907fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:18:41.908741 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 301/605] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:18:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:18:41.915480 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5718cd-c6a0-4b3c-8a16-ee6cac403eb4 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:41.983802 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238c766-1344-458b-95b7-c182384bccb4 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:41.984153 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238c766-1344-458b-95b7-c182384bccb4 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:41.984351 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238c766-1344-458b-95b7-c182384bccb4 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:41.986391 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 302/606] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:18:41.991573 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae0e54-adb4-40ca-91bf-75f1474a1fb1 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:41.991844 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae0e54-adb4-40ca-91bf-75f1474a1fb1 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:41.992113 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae0e54-adb4-40ca-91bf-75f1474a1fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:42.019913 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-9aae0e54-adb4-40ca-91bf-75f1474a1fb1 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:42.021132 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-9aae0e54-adb4-40ca-91bf-75f1474a1fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:42.046538 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5718cd-c6a0-4b3c-8a16-ee6cac403eb4 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:42.082095 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc444f0-a596-4a02-8557-a3b36fd3c2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:42.082694 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc444f0-a596-4a02-8557-a3b36fd3c2f9 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:42.082979 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc444f0-a596-4a02-8557-a3b36fd3c2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:42.083251 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc444f0-a596-4a02-8557-a3b36fd3c2f9 None admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:42.084029 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc444f0-a596-4a02-8557-a3b36fd3c2f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:42.084335 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc444f0-a596-4a02-8557-a3b36fd3c2f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:42.085772 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc444f0-a596-4a02-8557-a3b36fd3c2f9 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:42.092748 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 303/607] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 10:18:42.100158 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 305/608] 10.222.0.21 () {56 vars in 1148 bytes} [Mon Feb 28 10:18:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:42.105618 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae0e54-adb4-40ca-91bf-75f1474a1fb1 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:42.134229 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc444f0-a596-4a02-8557-a3b36fd3c2f9 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:42.229939 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae0e54-adb4-40ca-91bf-75f1474a1fb1 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:42.249766 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc444f0-a596-4a02-8557-a3b36fd3c2f9 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:42.265169 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972c202-6bfc-4995-82b5-08ecc0a6d169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:42.266068 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972c202-6bfc-4995-82b5-08ecc0a6d169 None admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:42.266345 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972c202-6bfc-4995-82b5-08ecc0a6d169 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:42.266636 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972c202-6bfc-4995-82b5-08ecc0a6d169 None admin] PATH_INFO: `/v3/projects/5d1d6f8141924b2d99b766f975a3d43b/users/abaa12b94c834676bb17bf997dace5d1/roles/060d4a1eef7a45858664a42696ff4a19` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:42.281840 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b972c202-6bfc-4995-82b5-08ecc0a6d169 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d1d6f8141924b2d99b766f975a3d43b, user_id=abaa12b94c834676bb17bf997dace5d1, role_id=060d4a1eef7a45858664a42696ff4a19)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:42.283346 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b972c202-6bfc-4995-82b5-08ecc0a6d169 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:42.284349 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9b025-5a15-43de-9b77-75cf3b92031c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:42.285151 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9b025-5a15-43de-9b77-75cf3b92031c None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:42.285435 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9b025-5a15-43de-9b77-75cf3b92031c None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:42.285707 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9b025-5a15-43de-9b77-75cf3b92031c None admin] PATH_INFO: `/v3/roles/service` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:42.301349 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b9b025-5a15-43de-9b77-75cf3b92031c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:18:42.309399 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 304/609] 10.222.0.21 () {58 vars in 1439 bytes} [Mon Feb 28 10:18:42 2022] PUT /identity/v3/projects/5d1d6f8141924b2d99b766f975a3d43b/users/abaa12b94c834676bb17bf997dace5d1/roles/060d4a1eef7a45858664a42696ff4a19 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:18:42.312109 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-b0b9b025-5a15-43de-9b77-75cf3b92031c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 10:18:42.316791 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 306/610] 10.222.0.21 () {56 vars in 1102 bytes} [Mon Feb 28 10:18:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:18:42.319947 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972c202-6bfc-4995-82b5-08ecc0a6d169 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:42.428351 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972c202-6bfc-4995-82b5-08ecc0a6d169 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:42.466739 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27855f29-03b1-4386-a232-b910ed17328b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:42.467430 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27855f29-03b1-4386-a232-b910ed17328b None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:42.467710 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27855f29-03b1-4386-a232-b910ed17328b None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:42.467985 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27855f29-03b1-4386-a232-b910ed17328b None admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:42.468745 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27855f29-03b1-4386-a232-b910ed17328b None admin] RBAC: Adding query filter params (name=service) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:42.469048 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27855f29-03b1-4386-a232-b910ed17328b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:42.470451 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27855f29-03b1-4386-a232-b910ed17328b None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:42.484683 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 305/611] 10.222.0.21 () {56 vars in 1103 bytes} [Mon Feb 28 10:18:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:42.486080 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9b025-5a15-43de-9b77-75cf3b92031c None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:42.614667 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9b025-5a15-43de-9b77-75cf3b92031c None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:42.656715 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d3b27-b8e7-41ca-af3d-4c3ddd28bc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:42.657503 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d3b27-b8e7-41ca-af3d-4c3ddd28bc94 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:42.657784 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d3b27-b8e7-41ca-af3d-4c3ddd28bc94 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:42.658054 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d3b27-b8e7-41ca-af3d-4c3ddd28bc94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:42.675656 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d3b27-b8e7-41ca-af3d-4c3ddd28bc94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:42.677096 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d3b27-b8e7-41ca-af3d-4c3ddd28bc94 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:42.696392 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-925d3b27-b8e7-41ca-af3d-4c3ddd28bc94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:18:42.698088 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 307/612] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:18:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:42.703494 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27855f29-03b1-4386-a232-b910ed17328b None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:42.721162 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61979e6a-770b-440c-89d8-b05429a54343 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:42.721452 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61979e6a-770b-440c-89d8-b05429a54343 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:42.721701 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61979e6a-770b-440c-89d8-b05429a54343 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:42.723709 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 308/613] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:18:42.728887 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18687d-803a-4f16-8a2c-f204efca7d0c None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:42.729166 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18687d-803a-4f16-8a2c-f204efca7d0c None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:42.729436 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18687d-803a-4f16-8a2c-f204efca7d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:42.748984 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-4a18687d-803a-4f16-8a2c-f204efca7d0c None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:42.750151 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-4a18687d-803a-4f16-8a2c-f204efca7d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:42.860181 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 309/614] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 10:18:42.882636 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27855f29-03b1-4386-a232-b910ed17328b None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:42.910528 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18687d-803a-4f16-8a2c-f204efca7d0c None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:42.922625 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ec249-d7e3-4cd9-9343-e4f570707208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:42.922625 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ec249-d7e3-4cd9-9343-e4f570707208 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:42.922625 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ec249-d7e3-4cd9-9343-e4f570707208 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:42.922625 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ec249-d7e3-4cd9-9343-e4f570707208 None admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:42.923183 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ec249-d7e3-4cd9-9343-e4f570707208 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:42.923183 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ec249-d7e3-4cd9-9343-e4f570707208 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:42.924406 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ec249-d7e3-4cd9-9343-e4f570707208 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:42.948288 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 306/615] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:18:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:42.953364 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ec249-d7e3-4cd9-9343-e4f570707208 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:43.027113 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18687d-803a-4f16-8a2c-f204efca7d0c None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:43.067034 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e3668c-b3d4-40de-88f6-5a767edc06a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:43.068122 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3668c-b3d4-40de-88f6-5a767edc06a9 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:43.068499 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3668c-b3d4-40de-88f6-5a767edc06a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:43.068863 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3668c-b3d4-40de-88f6-5a767edc06a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:43.080878 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e3668c-b3d4-40de-88f6-5a767edc06a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:18:43.088845 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-a1e3668c-b3d4-40de-88f6-5a767edc06a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 10:18:43.091517 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 310/616] 10.222.0.21 () {56 vars in 1102 bytes} [Mon Feb 28 10:18:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:18:43.096918 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e3668c-b3d4-40de-88f6-5a767edc06a9 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:43.143656 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ec249-d7e3-4cd9-9343-e4f570707208 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:43.189373 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158bc53-e74a-41e5-bb79-e4325137e807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:43.190163 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158bc53-e74a-41e5-bb79-e4325137e807 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:43.190461 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158bc53-e74a-41e5-bb79-e4325137e807 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:43.194621 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158bc53-e74a-41e5-bb79-e4325137e807 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:43.198270 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9158bc53-e74a-41e5-bb79-e4325137e807 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:43.199907 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9158bc53-e74a-41e5-bb79-e4325137e807 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:43.213571 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-9158bc53-e74a-41e5-bb79-e4325137e807 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 28 10:18:43.215127 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 307/617] 10.222.0.21 () {56 vars in 1096 bytes} [Mon Feb 28 10:18:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:18:43.220625 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158bc53-e74a-41e5-bb79-e4325137e807 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:43.281482 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e3668c-b3d4-40de-88f6-5a767edc06a9 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:43.318051 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158bc53-e74a-41e5-bb79-e4325137e807 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:43.351312 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6cdaaf-8d34-4673-be68-8c8fd6b71547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:43.351994 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6cdaaf-8d34-4673-be68-8c8fd6b71547 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:43.352276 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6cdaaf-8d34-4673-be68-8c8fd6b71547 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:43.352557 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6cdaaf-8d34-4673-be68-8c8fd6b71547 None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:43.353354 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6cdaaf-8d34-4673-be68-8c8fd6b71547 None admin] RBAC: Adding query filter params (name=service) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:43.353706 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6cdaaf-8d34-4673-be68-8c8fd6b71547 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:43.354485 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5236309-a692-40e2-8648-ad70c5e927aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:43.355109 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6cdaaf-8d34-4673-be68-8c8fd6b71547 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:43.355637 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5236309-a692-40e2-8648-ad70c5e927aa None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:43.356748 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5236309-a692-40e2-8648-ad70c5e927aa None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:43.357304 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5236309-a692-40e2-8648-ad70c5e927aa None admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:43.358327 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5236309-a692-40e2-8648-ad70c5e927aa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:43.358918 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5236309-a692-40e2-8648-ad70c5e927aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:43.360539 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5236309-a692-40e2-8648-ad70c5e927aa None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:43.373279 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 311/618] 10.222.0.21 () {56 vars in 1103 bytes} [Mon Feb 28 10:18:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:18:43.376020 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6cdaaf-8d34-4673-be68-8c8fd6b71547 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:43.379775 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 308/619] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Feb 28 10:18:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:18:43.388494 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5236309-a692-40e2-8648-ad70c5e927aa None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:43.489898 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5236309-a692-40e2-8648-ad70c5e927aa None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:43.533558 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc573c-f7a9-4a2f-a573-cefe3bfb097b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:43.534783 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc573c-f7a9-4a2f-a573-cefe3bfb097b None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:43.535265 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc573c-f7a9-4a2f-a573-cefe3bfb097b None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:43.535754 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc573c-f7a9-4a2f-a573-cefe3bfb097b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:43.538587 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6cdaaf-8d34-4673-be68-8c8fd6b71547 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:43.546761 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc573c-f7a9-4a2f-a573-cefe3bfb097b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:43.548498 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc573c-f7a9-4a2f-a573-cefe3bfb097b None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:43.566300 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-afbc573c-f7a9-4a2f-a573-cefe3bfb097b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:18:43.568115 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 309/620] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:18:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:18:43.573744 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc573c-f7a9-4a2f-a573-cefe3bfb097b None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:43.622477 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759dddf-3f1a-4adf-8530-2781544ca497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:43.623306 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759dddf-3f1a-4adf-8530-2781544ca497 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:43.623588 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759dddf-3f1a-4adf-8530-2781544ca497 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:43.623863 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759dddf-3f1a-4adf-8530-2781544ca497 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:43.655495 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8759dddf-3f1a-4adf-8530-2781544ca497 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:43.656973 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8759dddf-3f1a-4adf-8530-2781544ca497 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:43.680777 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc573c-f7a9-4a2f-a573-cefe3bfb097b None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:43.698821 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-8759dddf-3f1a-4adf-8530-2781544ca497 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:18:43.700604 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 312/621] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:18:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:43.705984 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759dddf-3f1a-4adf-8530-2781544ca497 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:43.717010 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8547577-e332-4bcb-b67f-c33802f1c80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:43.718434 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8547577-e332-4bcb-b67f-c33802f1c80f None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:43.718954 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8547577-e332-4bcb-b67f-c33802f1c80f None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:43.719449 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8547577-e332-4bcb-b67f-c33802f1c80f None admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:43.720407 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8547577-e332-4bcb-b67f-c33802f1c80f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:43.720922 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8547577-e332-4bcb-b67f-c33802f1c80f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:43.722502 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8547577-e332-4bcb-b67f-c33802f1c80f None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:43.735327 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 310/622] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:18:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:18:43.741254 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8547577-e332-4bcb-b67f-c33802f1c80f None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:43.841480 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8547577-e332-4bcb-b67f-c33802f1c80f None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:43.869468 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759dddf-3f1a-4adf-8530-2781544ca497 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:43.876535 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d4fd0-6b99-462d-8d67-ecbed8b6b2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:43.877544 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d4fd0-6b99-462d-8d67-ecbed8b6b2cf None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:43.877977 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d4fd0-6b99-462d-8d67-ecbed8b6b2cf None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:43.878390 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d4fd0-6b99-462d-8d67-ecbed8b6b2cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:43.893046 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d4fd0-6b99-462d-8d67-ecbed8b6b2cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:43.894707 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d4fd0-6b99-462d-8d67-ecbed8b6b2cf None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:43.908608 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-fd6d4fd0-6b99-462d-8d67-ecbed8b6b2cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:18:43.910208 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 311/623] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:18:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:18:43.915698 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d4fd0-6b99-462d-8d67-ecbed8b6b2cf None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:43.916286 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4682e-e1f3-461b-870c-e9ac7d940d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:43.916958 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4682e-e1f3-461b-870c-e9ac7d940d18 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:43.917240 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4682e-e1f3-461b-870c-e9ac7d940d18 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:43.917512 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4682e-e1f3-461b-870c-e9ac7d940d18 None admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:43.918793 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4682e-e1f3-461b-870c-e9ac7d940d18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:43.919455 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4682e-e1f3-461b-870c-e9ac7d940d18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:43.921078 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4682e-e1f3-461b-870c-e9ac7d940d18 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:43.935105 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 313/624] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:18:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:18:43.939806 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4682e-e1f3-461b-870c-e9ac7d940d18 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:44.015496 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d4fd0-6b99-462d-8d67-ecbed8b6b2cf None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:44.040013 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4682e-e1f3-461b-870c-e9ac7d940d18 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:44.049311 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93251a96-3b23-4687-97bb-0871691a8f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:44.050200 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93251a96-3b23-4687-97bb-0871691a8f7a None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:44.050651 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93251a96-3b23-4687-97bb-0871691a8f7a None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:44.051069 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93251a96-3b23-4687-97bb-0871691a8f7a None admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:44.052047 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93251a96-3b23-4687-97bb-0871691a8f7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:44.052551 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93251a96-3b23-4687-97bb-0871691a8f7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:44.054195 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93251a96-3b23-4687-97bb-0871691a8f7a None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:44.066375 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 312/625] 10.222.0.21 () {56 vars in 1148 bytes} [Mon Feb 28 10:18:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:18:44.072592 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93251a96-3b23-4687-97bb-0871691a8f7a None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:44.076989 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a6b17-e616-4106-8014-ae4c941b0e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:44.078009 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a6b17-e616-4106-8014-ae4c941b0e1b None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:44.078473 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a6b17-e616-4106-8014-ae4c941b0e1b None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:44.078913 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a6b17-e616-4106-8014-ae4c941b0e1b None admin] PATH_INFO: `/v3/users/nova` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:44.086699 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a6b17-e616-4106-8014-ae4c941b0e1b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:44.088345 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a6b17-e616-4106-8014-ae4c941b0e1b None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:44.102935 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-2b5a6b17-e616-4106-8014-ae4c941b0e1b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 10:18:44.104754 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 314/626] 10.222.0.21 () {56 vars in 1093 bytes} [Mon Feb 28 10:18:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:44.111537 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a6b17-e616-4106-8014-ae4c941b0e1b None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:44.181493 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93251a96-3b23-4687-97bb-0871691a8f7a None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:44.217614 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db56ed30-ac75-4de2-9896-8c858eb15807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:44.218706 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56ed30-ac75-4de2-9896-8c858eb15807 None admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:44.219068 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56ed30-ac75-4de2-9896-8c858eb15807 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:44.219412 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56ed30-ac75-4de2-9896-8c858eb15807 None admin] PATH_INFO: `/v3/projects/5d1d6f8141924b2d99b766f975a3d43b/users/8696fe8a37aa4d73a62bdc2efd35a23d/roles/060d4a1eef7a45858664a42696ff4a19` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:44.227101 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a6b17-e616-4106-8014-ae4c941b0e1b None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:44.242635 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db56ed30-ac75-4de2-9896-8c858eb15807 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d1d6f8141924b2d99b766f975a3d43b, user_id=8696fe8a37aa4d73a62bdc2efd35a23d, role_id=060d4a1eef7a45858664a42696ff4a19)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:44.242635 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db56ed30-ac75-4de2-9896-8c858eb15807 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:44.261752 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 313/627] 10.222.0.21 () {58 vars in 1439 bytes} [Mon Feb 28 10:18:44 2022] PUT /identity/v3/projects/5d1d6f8141924b2d99b766f975a3d43b/users/8696fe8a37aa4d73a62bdc2efd35a23d/roles/060d4a1eef7a45858664a42696ff4a19 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:18:44.295557 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2b4c0-8d43-44e4-b5ef-4f6f9222be11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:44.296256 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2b4c0-8d43-44e4-b5ef-4f6f9222be11 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:44.296535 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2b4c0-8d43-44e4-b5ef-4f6f9222be11 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:44.296827 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2b4c0-8d43-44e4-b5ef-4f6f9222be11 None admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:44.297663 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2b4c0-8d43-44e4-b5ef-4f6f9222be11 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:44.297969 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2b4c0-8d43-44e4-b5ef-4f6f9222be11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:44.299474 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2b4c0-8d43-44e4-b5ef-4f6f9222be11 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:44.319284 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 315/628] 10.222.0.21 () {56 vars in 1133 bytes} [Mon Feb 28 10:18:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:44.325330 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db56ed30-ac75-4de2-9896-8c858eb15807 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:44.464938 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db56ed30-ac75-4de2-9896-8c858eb15807 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:44.519695 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec068e5-fbfd-4eea-b43d-fe74d0985490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:44.520385 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec068e5-fbfd-4eea-b43d-fe74d0985490 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:44.520656 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec068e5-fbfd-4eea-b43d-fe74d0985490 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:44.520981 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec068e5-fbfd-4eea-b43d-fe74d0985490 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:44.613135 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec068e5-fbfd-4eea-b43d-fe74d0985490 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:44.614509 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec068e5-fbfd-4eea-b43d-fe74d0985490 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:44.701576 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e164a317-a6ad-4b11-bb6a-f90087b04f6f None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:44.702097 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e164a317-a6ad-4b11-bb6a-f90087b04f6f None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:44.702097 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e164a317-a6ad-4b11-bb6a-f90087b04f6f None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:44.703926 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 316/629] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:18:44.710637 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1acd76-1bee-454f-91db-43cabe13d6c4 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:44.710898 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1acd76-1bee-454f-91db-43cabe13d6c4 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:44.711175 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1acd76-1bee-454f-91db-43cabe13d6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:44.731723 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-5c1acd76-1bee-454f-91db-43cabe13d6c4 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:44.732868 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 314/630] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:18:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:18:44.733300 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-5c1acd76-1bee-454f-91db-43cabe13d6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:44.737964 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec068e5-fbfd-4eea-b43d-fe74d0985490 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:44.824197 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 317/631] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 10:18:44.872708 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec068e5-fbfd-4eea-b43d-fe74d0985490 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:44.885364 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1acd76-1bee-454f-91db-43cabe13d6c4 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:44.912832 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb93e7d-a229-4650-8429-76f99ac43b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:44.913782 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb93e7d-a229-4650-8429-76f99ac43b9d None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:44.914064 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb93e7d-a229-4650-8429-76f99ac43b9d None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:44.914334 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb93e7d-a229-4650-8429-76f99ac43b9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:44.925406 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb93e7d-a229-4650-8429-76f99ac43b9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:44.927096 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb93e7d-a229-4650-8429-76f99ac43b9d None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:44.945984 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-1cb93e7d-a229-4650-8429-76f99ac43b9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:18:44.948132 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 315/632] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:18:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:44.955173 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb93e7d-a229-4650-8429-76f99ac43b9d None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:45.054632 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1acd76-1bee-454f-91db-43cabe13d6c4 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:45.079721 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb93e7d-a229-4650-8429-76f99ac43b9d None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:45.091083 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab7e02-2b59-4445-a77a-790bc6825367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:45.091863 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab7e02-2b59-4445-a77a-790bc6825367 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:45.092140 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab7e02-2b59-4445-a77a-790bc6825367 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:45.092407 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab7e02-2b59-4445-a77a-790bc6825367 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:45.101904 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab7e02-2b59-4445-a77a-790bc6825367 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:18:45.109252 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-10ab7e02-2b59-4445-a77a-790bc6825367 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 10:18:45.110651 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 318/633] 10.222.0.21 () {56 vars in 1102 bytes} [Mon Feb 28 10:18:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:18:45.111842 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f13b5a-ae5b-446d-b95f-d479ac3dfd05 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:45.112120 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f13b5a-ae5b-446d-b95f-d479ac3dfd05 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:45.112388 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f13b5a-ae5b-446d-b95f-d479ac3dfd05 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:45.114223 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 319/634] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:18:45.118643 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86163d-6d86-4ae9-a26f-d1d0d2217f08 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:45.118643 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86163d-6d86-4ae9-a26f-d1d0d2217f08 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:45.118643 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86163d-6d86-4ae9-a26f-d1d0d2217f08 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:45.118643 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 320/635] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:18:45.118643 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b86163d-6d86-4ae9-a26f-d1d0d2217f08 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:45.122865 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd54dcb-df5d-49d7-b76b-5ceff45cd427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:45.123553 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd54dcb-df5d-49d7-b76b-5ceff45cd427 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:45.123906 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd54dcb-df5d-49d7-b76b-5ceff45cd427 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:45.124251 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd54dcb-df5d-49d7-b76b-5ceff45cd427 None admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:45.125053 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd54dcb-df5d-49d7-b76b-5ceff45cd427 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:45.125425 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd54dcb-df5d-49d7-b76b-5ceff45cd427 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:45.126886 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd54dcb-df5d-49d7-b76b-5ceff45cd427 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:45.138562 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 316/636] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:45.142950 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634ce49-bacb-4a40-9916-d68e31d05254 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:45.142950 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634ce49-bacb-4a40-9916-d68e31d05254 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:45.142950 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634ce49-bacb-4a40-9916-d68e31d05254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:45.157060 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-5634ce49-bacb-4a40-9916-d68e31d05254 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:45.158357 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-5634ce49-bacb-4a40-9916-d68e31d05254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:45.220913 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b86163d-6d86-4ae9-a26f-d1d0d2217f08 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:45.226778 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 317/637] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:18:45.226778 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d502296-eb87-450f-a6aa-cbcf73b1ee0a None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:45.226778 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d502296-eb87-450f-a6aa-cbcf73b1ee0a None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:45.226778 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d502296-eb87-450f-a6aa-cbcf73b1ee0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:45.249751 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-2d502296-eb87-450f-a6aa-cbcf73b1ee0a None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:45.250926 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-2d502296-eb87-450f-a6aa-cbcf73b1ee0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:45.265970 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6383e5-ca2b-4004-9be0-ed8b43c68562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:45.266654 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6383e5-ca2b-4004-9be0-ed8b43c68562 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:45.266940 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6383e5-ca2b-4004-9be0-ed8b43c68562 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:45.267210 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6383e5-ca2b-4004-9be0-ed8b43c68562 None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:45.267940 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6383e5-ca2b-4004-9be0-ed8b43c68562 None admin] RBAC: Adding query filter params (name=service) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:45.268241 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6383e5-ca2b-4004-9be0-ed8b43c68562 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:45.269607 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6383e5-ca2b-4004-9be0-ed8b43c68562 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:45.277270 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 321/638] 10.222.0.21 () {56 vars in 1103 bytes} [Mon Feb 28 10:18:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:45.279530 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6383e5-ca2b-4004-9be0-ed8b43c68562 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:45.316983 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 318/639] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:18:45.318242 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d502296-eb87-450f-a6aa-cbcf73b1ee0a None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:45.377850 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6383e5-ca2b-4004-9be0-ed8b43c68562 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:45.411082 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0abb70-484f-4e3c-9325-703bfd4542b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:45.411861 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0abb70-484f-4e3c-9325-703bfd4542b3 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:45.412137 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0abb70-484f-4e3c-9325-703bfd4542b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:45.412406 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0abb70-484f-4e3c-9325-703bfd4542b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:45.419170 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0abb70-484f-4e3c-9325-703bfd4542b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:45.420608 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0abb70-484f-4e3c-9325-703bfd4542b3 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:45.423404 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d502296-eb87-450f-a6aa-cbcf73b1ee0a None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:45.433546 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-0c0abb70-484f-4e3c-9325-703bfd4542b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:18:45.434783 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 322/640] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:18:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:45.435545 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0abb70-484f-4e3c-9325-703bfd4542b3 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:45.463381 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437e01e-1f38-42fd-bf23-dc561f67b5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:45.464515 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437e01e-1f38-42fd-bf23-dc561f67b5e7 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:45.465025 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437e01e-1f38-42fd-bf23-dc561f67b5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:45.465716 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437e01e-1f38-42fd-bf23-dc561f67b5e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:45.475902 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f437e01e-1f38-42fd-bf23-dc561f67b5e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:18:45.483730 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-f437e01e-1f38-42fd-bf23-dc561f67b5e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 10:18:45.485474 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 319/641] 10.222.0.21 () {56 vars in 1102 bytes} [Mon Feb 28 10:18:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:45.486486 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437e01e-1f38-42fd-bf23-dc561f67b5e7 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:45.533609 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0abb70-484f-4e3c-9325-703bfd4542b3 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:45.567236 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109230a-6f7e-40d3-bb00-5eb2253a8113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:45.567997 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109230a-6f7e-40d3-bb00-5eb2253a8113 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:45.568281 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109230a-6f7e-40d3-bb00-5eb2253a8113 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:45.568555 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109230a-6f7e-40d3-bb00-5eb2253a8113 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:45.578635 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109230a-6f7e-40d3-bb00-5eb2253a8113 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:45.580054 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109230a-6f7e-40d3-bb00-5eb2253a8113 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:45.588676 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437e01e-1f38-42fd-bf23-dc561f67b5e7 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:45.596070 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-3109230a-6f7e-40d3-bb00-5eb2253a8113 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:18:45.597236 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 323/642] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:18:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:45.597993 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109230a-6f7e-40d3-bb00-5eb2253a8113 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:45.627191 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc2252-310a-44a1-893a-f65dbfeb3a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:45.628329 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc2252-310a-44a1-893a-f65dbfeb3a98 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:45.628541 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc2252-310a-44a1-893a-f65dbfeb3a98 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:45.628917 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc2252-310a-44a1-893a-f65dbfeb3a98 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:45.638979 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fc2252-310a-44a1-893a-f65dbfeb3a98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:18:45.645714 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-38fc2252-310a-44a1-893a-f65dbfeb3a98 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 10:18:45.651451 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 320/643] 10.222.0.21 () {56 vars in 1102 bytes} [Mon Feb 28 10:18:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:45.652074 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc2252-310a-44a1-893a-f65dbfeb3a98 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:45.695997 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109230a-6f7e-40d3-bb00-5eb2253a8113 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:45.729962 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1321e7-c570-4f4e-bf6e-f1b48cd883f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:45.730753 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1321e7-c570-4f4e-bf6e-f1b48cd883f0 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:45.731065 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1321e7-c570-4f4e-bf6e-f1b48cd883f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:45.731369 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1321e7-c570-4f4e-bf6e-f1b48cd883f0 None admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:45.732121 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1321e7-c570-4f4e-bf6e-f1b48cd883f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:45.732428 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1321e7-c570-4f4e-bf6e-f1b48cd883f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:45.733854 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1321e7-c570-4f4e-bf6e-f1b48cd883f0 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:45.746919 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 324/644] 10.222.0.21 () {56 vars in 1148 bytes} [Mon Feb 28 10:18:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:45.747839 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1321e7-c570-4f4e-bf6e-f1b48cd883f0 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:45.753430 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc2252-310a-44a1-893a-f65dbfeb3a98 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:45.787715 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b64824-97bc-4ef6-8228-b5f00af83106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:45.788385 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b64824-97bc-4ef6-8228-b5f00af83106 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:45.788665 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b64824-97bc-4ef6-8228-b5f00af83106 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:45.788936 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b64824-97bc-4ef6-8228-b5f00af83106 None admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:45.789680 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b64824-97bc-4ef6-8228-b5f00af83106 None admin] RBAC: Adding query filter params (name=service) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:45.789981 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b64824-97bc-4ef6-8228-b5f00af83106 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:45.791406 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b64824-97bc-4ef6-8228-b5f00af83106 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:45.799717 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 321/645] 10.222.0.21 () {56 vars in 1103 bytes} [Mon Feb 28 10:18:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:45.800343 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b64824-97bc-4ef6-8228-b5f00af83106 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:45.861744 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1321e7-c570-4f4e-bf6e-f1b48cd883f0 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:45.895369 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c4b288-b223-41c0-9831-1b7d5fe32726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:45.895948 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4b288-b223-41c0-9831-1b7d5fe32726 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:45.896226 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4b288-b223-41c0-9831-1b7d5fe32726 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:45.896498 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4b288-b223-41c0-9831-1b7d5fe32726 None admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:45.897199 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c4b288-b223-41c0-9831-1b7d5fe32726 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:45.897542 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c4b288-b223-41c0-9831-1b7d5fe32726 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:45.898950 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c4b288-b223-41c0-9831-1b7d5fe32726 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:45.900456 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b64824-97bc-4ef6-8228-b5f00af83106 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:45.915875 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 325/646] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:45.915875 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c4b288-b223-41c0-9831-1b7d5fe32726 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:45.938462 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38511f1e-b236-42c5-90fd-09f0ebb09638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:45.939171 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38511f1e-b236-42c5-90fd-09f0ebb09638 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:45.939693 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38511f1e-b236-42c5-90fd-09f0ebb09638 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:45.939693 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38511f1e-b236-42c5-90fd-09f0ebb09638 None admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:45.940431 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38511f1e-b236-42c5-90fd-09f0ebb09638 None admin] RBAC: Adding query filter params (name=service) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:45.940727 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38511f1e-b236-42c5-90fd-09f0ebb09638 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:45.942062 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38511f1e-b236-42c5-90fd-09f0ebb09638 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:45.954557 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 322/647] 10.222.0.21 () {56 vars in 1103 bytes} [Mon Feb 28 10:18:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:45.954557 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38511f1e-b236-42c5-90fd-09f0ebb09638 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:46.011765 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c4b288-b223-41c0-9831-1b7d5fe32726 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:46.045595 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46dc9e-de2c-4de4-be5d-adbda1825b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:46.046554 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46dc9e-de2c-4de4-be5d-adbda1825b9f None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:46.047178 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46dc9e-de2c-4de4-be5d-adbda1825b9f None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:46.047298 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38511f1e-b236-42c5-90fd-09f0ebb09638 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:46.047773 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46dc9e-de2c-4de4-be5d-adbda1825b9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:46.048789 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc46dc9e-de2c-4de4-be5d-adbda1825b9f None admin] RBAC: Adding query filter params (role.id=060d4a1eef7a45858664a42696ff4a19, scope.project.id=5d1d6f8141924b2d99b766f975a3d43b, user.id=ec202a34db8e47f4a6c18285245e3f5b) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:46.049324 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc46dc9e-de2c-4de4-be5d-adbda1825b9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:46.050856 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc46dc9e-de2c-4de4-be5d-adbda1825b9f None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:46.066627 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 326/648] 10.222.0.21 () {56 vars in 1374 bytes} [Mon Feb 28 10:18:45 2022] GET /identity/v3/role_assignments?user.id=ec202a34db8e47f4a6c18285245e3f5b&scope.project.id=5d1d6f8141924b2d99b766f975a3d43b&role.id=060d4a1eef7a45858664a42696ff4a19 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:46.066627 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46dc9e-de2c-4de4-be5d-adbda1825b9f None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:46.094210 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a306bcf-287f-47ab-8e1e-21cf1ea4ecec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:46.095051 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a306bcf-287f-47ab-8e1e-21cf1ea4ecec None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:46.095332 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a306bcf-287f-47ab-8e1e-21cf1ea4ecec None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:46.095610 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a306bcf-287f-47ab-8e1e-21cf1ea4ecec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:46.107640 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a306bcf-287f-47ab-8e1e-21cf1ea4ecec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:46.109227 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a306bcf-287f-47ab-8e1e-21cf1ea4ecec None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:46.127119 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-7a306bcf-287f-47ab-8e1e-21cf1ea4ecec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:18:46.128761 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 323/649] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:18:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:46.129569 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a306bcf-287f-47ab-8e1e-21cf1ea4ecec None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:46.191542 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46dc9e-de2c-4de4-be5d-adbda1825b9f None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:46.235084 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67765c7e-0780-4aa7-881c-c76ccd62f422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:46.236562 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67765c7e-0780-4aa7-881c-c76ccd62f422 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:46.236843 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67765c7e-0780-4aa7-881c-c76ccd62f422 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:46.237115 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67765c7e-0780-4aa7-881c-c76ccd62f422 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:46.244895 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a306bcf-287f-47ab-8e1e-21cf1ea4ecec None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:46.247737 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67765c7e-0780-4aa7-881c-c76ccd62f422 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:46.250188 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67765c7e-0780-4aa7-881c-c76ccd62f422 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:46.269602 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-67765c7e-0780-4aa7-881c-c76ccd62f422 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 28 10:18:46.271719 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 327/650] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:18:46 2022] GET /identity/v3/users/glance => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:46.272506 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67765c7e-0780-4aa7-881c-c76ccd62f422 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:46.286823 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4abe9-9a4d-49b2-86b4-f930450606e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:46.287362 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4abe9-9a4d-49b2-86b4-f930450606e2 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:46.288791 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4abe9-9a4d-49b2-86b4-f930450606e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:46.288791 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4abe9-9a4d-49b2-86b4-f930450606e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:46.300399 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c4abe9-9a4d-49b2-86b4-f930450606e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:46.301851 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c4abe9-9a4d-49b2-86b4-f930450606e2 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:46.324824 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-f6c4abe9-9a4d-49b2-86b4-f930450606e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:18:46.326185 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 324/651] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:18:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:46.326830 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4abe9-9a4d-49b2-86b4-f930450606e2 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:46.376501 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67765c7e-0780-4aa7-881c-c76ccd62f422 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:46.411614 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546664f-75ca-450d-a27e-51940018de94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:46.412273 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546664f-75ca-450d-a27e-51940018de94 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:46.412549 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546664f-75ca-450d-a27e-51940018de94 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:46.412822 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546664f-75ca-450d-a27e-51940018de94 None admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:46.413534 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9546664f-75ca-450d-a27e-51940018de94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:46.413839 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9546664f-75ca-450d-a27e-51940018de94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:46.415240 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9546664f-75ca-450d-a27e-51940018de94 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:46.427004 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 328/652] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:18:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:46.427663 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546664f-75ca-450d-a27e-51940018de94 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:46.437261 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4abe9-9a4d-49b2-86b4-f930450606e2 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:46.473101 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a66632-bec9-465b-9fb2-1315ce9c281b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:46.474046 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a66632-bec9-465b-9fb2-1315ce9c281b None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:46.474495 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a66632-bec9-465b-9fb2-1315ce9c281b None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:46.475001 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a66632-bec9-465b-9fb2-1315ce9c281b None admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:46.476036 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a66632-bec9-465b-9fb2-1315ce9c281b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:46.476510 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a66632-bec9-465b-9fb2-1315ce9c281b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:46.478126 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a66632-bec9-465b-9fb2-1315ce9c281b None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:46.498156 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 325/653] 10.222.0.21 () {56 vars in 1137 bytes} [Mon Feb 28 10:18:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:46.499382 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a66632-bec9-465b-9fb2-1315ce9c281b None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:46.532211 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546664f-75ca-450d-a27e-51940018de94 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:46.566666 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7976a5-4ab7-4f42-b234-b66dead3d8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:46.567631 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7976a5-4ab7-4f42-b234-b66dead3d8ea None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:46.567982 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7976a5-4ab7-4f42-b234-b66dead3d8ea None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:46.568324 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7976a5-4ab7-4f42-b234-b66dead3d8ea None admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:46.569109 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7976a5-4ab7-4f42-b234-b66dead3d8ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:46.569467 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7976a5-4ab7-4f42-b234-b66dead3d8ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:46.570912 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7976a5-4ab7-4f42-b234-b66dead3d8ea None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:46.584375 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 329/654] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:18:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:46.585441 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7976a5-4ab7-4f42-b234-b66dead3d8ea None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:46.608472 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a66632-bec9-465b-9fb2-1315ce9c281b None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:46.644472 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd53ce9-f5f4-4efe-af1c-dedb11b470e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:46.645345 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd53ce9-f5f4-4efe-af1c-dedb11b470e9 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:46.645626 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd53ce9-f5f4-4efe-af1c-dedb11b470e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:46.645955 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd53ce9-f5f4-4efe-af1c-dedb11b470e9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:46.654289 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd53ce9-f5f4-4efe-af1c-dedb11b470e9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:46.655783 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd53ce9-f5f4-4efe-af1c-dedb11b470e9 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:46.671204 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-cdd53ce9-f5f4-4efe-af1c-dedb11b470e9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 28 10:18:46.672826 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 326/655] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:18:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:46.673732 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd53ce9-f5f4-4efe-af1c-dedb11b470e9 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:46.689909 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7976a5-4ab7-4f42-b234-b66dead3d8ea None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:46.724464 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77a1c5-909c-47d7-a731-badafd8b2459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:46.725528 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77a1c5-909c-47d7-a731-badafd8b2459 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:46.726056 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77a1c5-909c-47d7-a731-badafd8b2459 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:46.726519 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77a1c5-909c-47d7-a731-badafd8b2459 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:46.782615 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd53ce9-f5f4-4efe-af1c-dedb11b470e9 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:46.793873 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b77a1c5-909c-47d7-a731-badafd8b2459 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:46.795979 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b77a1c5-909c-47d7-a731-badafd8b2459 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:46.817841 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e9875-913e-44ad-a2f0-8b6e9606fc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:46.818643 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e9875-913e-44ad-a2f0-8b6e9606fc28 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:46.819002 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e9875-913e-44ad-a2f0-8b6e9606fc28 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:46.819194 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e9875-913e-44ad-a2f0-8b6e9606fc28 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:46.827337 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e9875-913e-44ad-a2f0-8b6e9606fc28 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:46.828749 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e9875-913e-44ad-a2f0-8b6e9606fc28 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:46.842436 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-a80e9875-913e-44ad-a2f0-8b6e9606fc28 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 28 10:18:46.843927 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 327/656] 10.222.0.21 () {56 vars in 1102 bytes} [Mon Feb 28 10:18:46 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:46.844716 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e9875-913e-44ad-a2f0-8b6e9606fc28 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:46.896770 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 330/657] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:18:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:18:46.898114 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77a1c5-909c-47d7-a731-badafd8b2459 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:46.953812 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e9875-913e-44ad-a2f0-8b6e9606fc28 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:46.991024 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a90e7-dacb-4070-9c30-33318a6bf1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:46.991645 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a90e7-dacb-4070-9c30-33318a6bf1fb None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:46.991887 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a90e7-dacb-4070-9c30-33318a6bf1fb None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:46.992160 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a90e7-dacb-4070-9c30-33318a6bf1fb None admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:46.993092 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a90e7-dacb-4070-9c30-33318a6bf1fb None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:46.993267 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a90e7-dacb-4070-9c30-33318a6bf1fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:46.994709 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a90e7-dacb-4070-9c30-33318a6bf1fb None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:46.999409 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77a1c5-909c-47d7-a731-badafd8b2459 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:47.017155 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 328/658] 10.222.0.21 () {56 vars in 1137 bytes} [Mon Feb 28 10:18:46 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:47.017155 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a90e7-dacb-4070-9c30-33318a6bf1fb None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:47.039442 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4264c2-0709-4c82-9ad4-1a5779466182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:47.041073 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4264c2-0709-4c82-9ad4-1a5779466182 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:47.041352 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4264c2-0709-4c82-9ad4-1a5779466182 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:47.041621 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4264c2-0709-4c82-9ad4-1a5779466182 None admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:47.042444 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4264c2-0709-4c82-9ad4-1a5779466182 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:47.042784 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4264c2-0709-4c82-9ad4-1a5779466182 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:47.044775 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4264c2-0709-4c82-9ad4-1a5779466182 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:47.062120 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 331/659] 10.222.0.21 () {56 vars in 1139 bytes} [Mon Feb 28 10:18:46 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:47.066689 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4264c2-0709-4c82-9ad4-1a5779466182 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:47.124484 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a90e7-dacb-4070-9c30-33318a6bf1fb None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:47.157581 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c47407-7568-4aad-b0c0-4e30fe3596a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:47.158481 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c47407-7568-4aad-b0c0-4e30fe3596a9 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:47.158797 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c47407-7568-4aad-b0c0-4e30fe3596a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:47.159065 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c47407-7568-4aad-b0c0-4e30fe3596a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:47.162720 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4264c2-0709-4c82-9ad4-1a5779466182 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:47.169356 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c47407-7568-4aad-b0c0-4e30fe3596a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:47.170813 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c47407-7568-4aad-b0c0-4e30fe3596a9 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:47.187778 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-82c47407-7568-4aad-b0c0-4e30fe3596a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:18:47.189113 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 329/660] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:18:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:47.192454 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e8911-69ea-4084-b707-389d95d8e943 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:47.193238 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e8911-69ea-4084-b707-389d95d8e943 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:47.193772 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e8911-69ea-4084-b707-389d95d8e943 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:47.196124 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 330/661] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:18:47.197203 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501e93c-3c6b-4567-99a6-78fc67bb7d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:47.197839 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501e93c-3c6b-4567-99a6-78fc67bb7d73 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:47.198114 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501e93c-3c6b-4567-99a6-78fc67bb7d73 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:47.198381 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501e93c-3c6b-4567-99a6-78fc67bb7d73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:47.198851 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e8911-69ea-4084-b707-389d95d8e943 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:47.265109 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3501e93c-3c6b-4567-99a6-78fc67bb7d73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:47.266668 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3501e93c-3c6b-4567-99a6-78fc67bb7d73 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:47.297165 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e8911-69ea-4084-b707-389d95d8e943 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:47.329952 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829d797-271a-433e-aea7-f2d7f37371bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:47.330612 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829d797-271a-433e-aea7-f2d7f37371bc None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:47.330900 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829d797-271a-433e-aea7-f2d7f37371bc None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:47.331171 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829d797-271a-433e-aea7-f2d7f37371bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:47.365983 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 332/662] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:18:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:18:47.365983 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501e93c-3c6b-4567-99a6-78fc67bb7d73 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:47.402029 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0829d797-271a-433e-aea7-f2d7f37371bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:47.404058 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0829d797-271a-433e-aea7-f2d7f37371bc None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:47.458000 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501e93c-3c6b-4567-99a6-78fc67bb7d73 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:47.491080 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4cfeff-3525-4373-a4c5-bce53ef6667c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:47.491726 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4cfeff-3525-4373-a4c5-bce53ef6667c None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:47.492004 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4cfeff-3525-4373-a4c5-bce53ef6667c None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:47.492274 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4cfeff-3525-4373-a4c5-bce53ef6667c None admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:47.492980 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4cfeff-3525-4373-a4c5-bce53ef6667c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:47.493284 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4cfeff-3525-4373-a4c5-bce53ef6667c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:47.494672 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4cfeff-3525-4373-a4c5-bce53ef6667c None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:47.510111 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 331/663] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:18:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:18:47.510277 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 333/664] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:18:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:47.510277 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4cfeff-3525-4373-a4c5-bce53ef6667c None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:47.511614 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c0dd1-0f5d-4b23-a9f6-b32f7b75b56f None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:47.511906 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c0dd1-0f5d-4b23-a9f6-b32f7b75b56f None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:47.513422 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c0dd1-0f5d-4b23-a9f6-b32f7b75b56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:47.529466 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-c44c0dd1-0f5d-4b23-a9f6-b32f7b75b56f None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:47.530587 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-c44c0dd1-0f5d-4b23-a9f6-b32f7b75b56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:47.606620 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 332/665] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:18:47.606620 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c0dd1-0f5d-4b23-a9f6-b32f7b75b56f None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:47.607768 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4cfeff-3525-4373-a4c5-bce53ef6667c None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:47.640822 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd7928-241c-49ce-8eba-fad1de8bcbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:47.641595 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd7928-241c-49ce-8eba-fad1de8bcbb7 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:47.641872 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd7928-241c-49ce-8eba-fad1de8bcbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:47.642145 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd7928-241c-49ce-8eba-fad1de8bcbb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:47.652235 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd7928-241c-49ce-8eba-fad1de8bcbb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:47.653740 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd7928-241c-49ce-8eba-fad1de8bcbb7 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:47.669892 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-82fd7928-241c-49ce-8eba-fad1de8bcbb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:18:47.675577 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 334/666] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:18:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:47.675577 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd7928-241c-49ce-8eba-fad1de8bcbb7 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:47.713270 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c0dd1-0f5d-4b23-a9f6-b32f7b75b56f None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:47.748042 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a503b-f5ab-4803-8272-b4d2e3e36d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:47.748571 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a503b-f5ab-4803-8272-b4d2e3e36d25 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:47.748850 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a503b-f5ab-4803-8272-b4d2e3e36d25 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:47.749119 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a503b-f5ab-4803-8272-b4d2e3e36d25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:47.758593 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a503b-f5ab-4803-8272-b4d2e3e36d25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:47.760045 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a503b-f5ab-4803-8272-b4d2e3e36d25 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:47.771306 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd7928-241c-49ce-8eba-fad1de8bcbb7 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:47.777649 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-0a5a503b-f5ab-4803-8272-b4d2e3e36d25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:18:47.779085 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 333/667] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:18:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:47.780065 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a503b-f5ab-4803-8272-b4d2e3e36d25 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:47.805252 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f08102-f21e-4ac3-8a7c-623de5254d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:47.806031 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f08102-f21e-4ac3-8a7c-623de5254d67 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:47.806308 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f08102-f21e-4ac3-8a7c-623de5254d67 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:47.806575 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f08102-f21e-4ac3-8a7c-623de5254d67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:47.814235 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f08102-f21e-4ac3-8a7c-623de5254d67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:47.815688 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f08102-f21e-4ac3-8a7c-623de5254d67 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:47.829545 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-c0f08102-f21e-4ac3-8a7c-623de5254d67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:18:47.830746 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 335/668] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:18:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:47.831500 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f08102-f21e-4ac3-8a7c-623de5254d67 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:47.886445 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a503b-f5ab-4803-8272-b4d2e3e36d25 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:47.920537 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd760f7-ac7e-4240-9d97-ca690d85e88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:47.921349 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd760f7-ac7e-4240-9d97-ca690d85e88e None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:47.921596 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd760f7-ac7e-4240-9d97-ca690d85e88e None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:47.921861 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd760f7-ac7e-4240-9d97-ca690d85e88e None admin] PATH_INFO: `/v3/roles/service` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:47.931721 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd760f7-ac7e-4240-9d97-ca690d85e88e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:18:47.935412 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f08102-f21e-4ac3-8a7c-623de5254d67 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:47.938721 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-8bd760f7-ac7e-4240-9d97-ca690d85e88e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 10:18:47.944757 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 334/669] 10.222.0.21 () {56 vars in 1102 bytes} [Mon Feb 28 10:18:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:47.944757 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd760f7-ac7e-4240-9d97-ca690d85e88e None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:47.971756 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d71ca-08f5-43fd-81a6-0d371b840edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:47.972408 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d71ca-08f5-43fd-81a6-0d371b840edc None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:47.972694 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d71ca-08f5-43fd-81a6-0d371b840edc None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:47.972962 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d71ca-08f5-43fd-81a6-0d371b840edc None admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:47.973666 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d71ca-08f5-43fd-81a6-0d371b840edc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:47.973966 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d71ca-08f5-43fd-81a6-0d371b840edc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:47.975351 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d71ca-08f5-43fd-81a6-0d371b840edc None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:47.986810 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 336/670] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:18:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:47.987974 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d71ca-08f5-43fd-81a6-0d371b840edc None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:48.046002 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd760f7-ac7e-4240-9d97-ca690d85e88e None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:48.080510 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da40b8c9-e360-4a22-9ed3-39babd64fdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:48.081162 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40b8c9-e360-4a22-9ed3-39babd64fdc1 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:48.081439 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40b8c9-e360-4a22-9ed3-39babd64fdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:48.081707 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40b8c9-e360-4a22-9ed3-39babd64fdc1 None admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:48.082399 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da40b8c9-e360-4a22-9ed3-39babd64fdc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:48.082724 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da40b8c9-e360-4a22-9ed3-39babd64fdc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:48.084088 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da40b8c9-e360-4a22-9ed3-39babd64fdc1 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:48.086380 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d71ca-08f5-43fd-81a6-0d371b840edc None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:48.095592 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 335/671] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:18:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:48.096232 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da40b8c9-e360-4a22-9ed3-39babd64fdc1 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:48.127724 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f622ffef-779f-4b03-a75a-f850aecc2107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:48.128364 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622ffef-779f-4b03-a75a-f850aecc2107 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:48.128637 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622ffef-779f-4b03-a75a-f850aecc2107 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:48.128906 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622ffef-779f-4b03-a75a-f850aecc2107 None admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:48.129668 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f622ffef-779f-4b03-a75a-f850aecc2107 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:48.129968 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f622ffef-779f-4b03-a75a-f850aecc2107 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:48.131403 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f622ffef-779f-4b03-a75a-f850aecc2107 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:48.143022 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 337/672] 10.222.0.21 () {56 vars in 1148 bytes} [Mon Feb 28 10:18:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:48.143818 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f622ffef-779f-4b03-a75a-f850aecc2107 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:48.204340 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da40b8c9-e360-4a22-9ed3-39babd64fdc1 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:48.242928 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17981e8b-4983-47e6-900c-55e2995ad230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:48.243163 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f622ffef-779f-4b03-a75a-f850aecc2107 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:48.243591 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17981e8b-4983-47e6-900c-55e2995ad230 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:48.243865 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17981e8b-4983-47e6-900c-55e2995ad230 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:48.244130 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17981e8b-4983-47e6-900c-55e2995ad230 None admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:48.244864 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17981e8b-4983-47e6-900c-55e2995ad230 None admin] RBAC: Adding query filter params (name=service) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:48.245166 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17981e8b-4983-47e6-900c-55e2995ad230 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:48.247107 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17981e8b-4983-47e6-900c-55e2995ad230 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:48.259446 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 336/673] 10.222.0.21 () {56 vars in 1103 bytes} [Mon Feb 28 10:18:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:48.259446 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17981e8b-4983-47e6-900c-55e2995ad230 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:48.282493 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d7538-aa65-4155-bfcd-4cd2d71452d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:48.283297 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d7538-aa65-4155-bfcd-4cd2d71452d2 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:48.283590 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d7538-aa65-4155-bfcd-4cd2d71452d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:48.283860 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d7538-aa65-4155-bfcd-4cd2d71452d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:48.290469 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865d7538-aa65-4155-bfcd-4cd2d71452d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:48.291929 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865d7538-aa65-4155-bfcd-4cd2d71452d2 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:48.304897 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-865d7538-aa65-4155-bfcd-4cd2d71452d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:18:48.310769 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 338/674] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:18:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:48.310769 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d7538-aa65-4155-bfcd-4cd2d71452d2 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:48.361601 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17981e8b-4983-47e6-900c-55e2995ad230 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:48.393691 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31899e5-1fb1-4e92-9c34-32e57e8f8e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:48.394476 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31899e5-1fb1-4e92-9c34-32e57e8f8e4f None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:48.394789 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31899e5-1fb1-4e92-9c34-32e57e8f8e4f None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:48.395064 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31899e5-1fb1-4e92-9c34-32e57e8f8e4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:48.401592 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31899e5-1fb1-4e92-9c34-32e57e8f8e4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:48.403607 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31899e5-1fb1-4e92-9c34-32e57e8f8e4f None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:48.409592 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d7538-aa65-4155-bfcd-4cd2d71452d2 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:48.416878 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-d31899e5-1fb1-4e92-9c34-32e57e8f8e4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:18:48.422767 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 337/675] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:18:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:48.422767 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31899e5-1fb1-4e92-9c34-32e57e8f8e4f None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:48.442050 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660b80b-233a-4ce8-8578-6fd88732f2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:48.442738 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660b80b-233a-4ce8-8578-6fd88732f2cd None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:48.443027 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660b80b-233a-4ce8-8578-6fd88732f2cd None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:48.443306 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660b80b-233a-4ce8-8578-6fd88732f2cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:48.444123 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d660b80b-233a-4ce8-8578-6fd88732f2cd None admin] RBAC: Adding query filter params (role.id=060d4a1eef7a45858664a42696ff4a19, scope.project.id=5d1d6f8141924b2d99b766f975a3d43b, user.id=d99b63b9b6e44219921569db1bf2e0dd) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:48.444431 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d660b80b-233a-4ce8-8578-6fd88732f2cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:48.445871 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d660b80b-233a-4ce8-8578-6fd88732f2cd None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:48.452443 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 339/676] 10.222.0.21 () {56 vars in 1374 bytes} [Mon Feb 28 10:18:48 2022] GET /identity/v3/role_assignments?user.id=d99b63b9b6e44219921569db1bf2e0dd&scope.project.id=5d1d6f8141924b2d99b766f975a3d43b&role.id=060d4a1eef7a45858664a42696ff4a19 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:48.453222 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660b80b-233a-4ce8-8578-6fd88732f2cd None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:48.542437 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31899e5-1fb1-4e92-9c34-32e57e8f8e4f None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:48.559777 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660b80b-233a-4ce8-8578-6fd88732f2cd None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:48.580593 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c993f0d9-9f38-410d-94fb-a81b3e6df752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:48.581726 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993f0d9-9f38-410d-94fb-a81b3e6df752 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:48.582188 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993f0d9-9f38-410d-94fb-a81b3e6df752 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:48.582706 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993f0d9-9f38-410d-94fb-a81b3e6df752 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:48.594829 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c993f0d9-9f38-410d-94fb-a81b3e6df752 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:48.596775 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c993f0d9-9f38-410d-94fb-a81b3e6df752 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:48.597181 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb8605-132e-40f0-858c-eaa4cf4b6aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:48.597847 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb8605-132e-40f0-858c-eaa4cf4b6aa5 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:48.598133 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb8605-132e-40f0-858c-eaa4cf4b6aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:48.598408 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb8605-132e-40f0-858c-eaa4cf4b6aa5 None admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:48.599229 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eb8605-132e-40f0-858c-eaa4cf4b6aa5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:48.599532 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eb8605-132e-40f0-858c-eaa4cf4b6aa5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:48.600981 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eb8605-132e-40f0-858c-eaa4cf4b6aa5 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:48.613959 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 340/677] 10.222.0.21 () {56 vars in 1148 bytes} [Mon Feb 28 10:18:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:48.614976 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb8605-132e-40f0-858c-eaa4cf4b6aa5 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:48.616654 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-c993f0d9-9f38-410d-94fb-a81b3e6df752 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:18:48.618419 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 338/678] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:18:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:48.620005 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8a636-6c1d-4359-a28c-bf681c4a8723 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:48.620511 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8a636-6c1d-4359-a28c-bf681c4a8723 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:48.620970 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8a636-6c1d-4359-a28c-bf681c4a8723 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:48.623547 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 339/679] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:18:48.624588 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e8a636-6c1d-4359-a28c-bf681c4a8723 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:48.721005 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb8605-132e-40f0-858c-eaa4cf4b6aa5 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:48.737013 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e8a636-6c1d-4359-a28c-bf681c4a8723 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:48.754928 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f370e63-0165-4c9f-9487-22733ea62da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:48.755586 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f370e63-0165-4c9f-9487-22733ea62da5 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:48.755865 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f370e63-0165-4c9f-9487-22733ea62da5 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:48.756135 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f370e63-0165-4c9f-9487-22733ea62da5 None admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:48.756905 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f370e63-0165-4c9f-9487-22733ea62da5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:48.757208 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f370e63-0165-4c9f-9487-22733ea62da5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:48.758752 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f370e63-0165-4c9f-9487-22733ea62da5 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:48.774866 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f065da3-6def-48b6-ad4d-504ca0a8d629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:48.775058 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 341/680] 10.222.0.21 () {56 vars in 1148 bytes} [Mon Feb 28 10:18:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:48.775174 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f065da3-6def-48b6-ad4d-504ca0a8d629 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:48.775283 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f370e63-0165-4c9f-9487-22733ea62da5 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:48.775369 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f065da3-6def-48b6-ad4d-504ca0a8d629 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:48.775369 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f065da3-6def-48b6-ad4d-504ca0a8d629 None admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:48.775369 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f065da3-6def-48b6-ad4d-504ca0a8d629 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:48.775369 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f065da3-6def-48b6-ad4d-504ca0a8d629 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:48.775369 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f065da3-6def-48b6-ad4d-504ca0a8d629 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:48.790732 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 340/681] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:18:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:48.790732 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4f32f-aa9a-47bb-9f4e-a84538e51352 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:48.790732 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4f32f-aa9a-47bb-9f4e-a84538e51352 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:48.790732 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4f32f-aa9a-47bb-9f4e-a84538e51352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:48.806163 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-04d4f32f-aa9a-47bb-9f4e-a84538e51352 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:48.807595 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-04d4f32f-aa9a-47bb-9f4e-a84538e51352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:48.867091 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f370e63-0165-4c9f-9487-22733ea62da5 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:48.886440 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 341/682] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:18:48.887975 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4f32f-aa9a-47bb-9f4e-a84538e51352 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:48.904575 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886000d-51d7-4ca6-b5a4-a80ed0a96b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:48.905220 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886000d-51d7-4ca6-b5a4-a80ed0a96b61 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:48.905496 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886000d-51d7-4ca6-b5a4-a80ed0a96b61 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:48.905765 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886000d-51d7-4ca6-b5a4-a80ed0a96b61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:48.906646 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9886000d-51d7-4ca6-b5a4-a80ed0a96b61 None admin] RBAC: Adding query filter params (role.id=060d4a1eef7a45858664a42696ff4a19, scope.project.id=5d1d6f8141924b2d99b766f975a3d43b, user.id=b2e92304833d47828c52ae737f6b96cc) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:48.906958 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9886000d-51d7-4ca6-b5a4-a80ed0a96b61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:48.908442 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9886000d-51d7-4ca6-b5a4-a80ed0a96b61 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:48.914700 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 342/683] 10.222.0.21 () {56 vars in 1374 bytes} [Mon Feb 28 10:18:48 2022] GET /identity/v3/role_assignments?user.id=b2e92304833d47828c52ae737f6b96cc&scope.project.id=5d1d6f8141924b2d99b766f975a3d43b&role.id=060d4a1eef7a45858664a42696ff4a19 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:48.915474 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886000d-51d7-4ca6-b5a4-a80ed0a96b61 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:49.014558 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4f32f-aa9a-47bb-9f4e-a84538e51352 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:49.028999 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886000d-51d7-4ca6-b5a4-a80ed0a96b61 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:49.050668 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5aeba9-867d-49b0-a125-54731927dd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:49.051332 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5aeba9-867d-49b0-a125-54731927dd7e None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:49.051609 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5aeba9-867d-49b0-a125-54731927dd7e None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:49.051876 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5aeba9-867d-49b0-a125-54731927dd7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:49.052705 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5aeba9-867d-49b0-a125-54731927dd7e None admin] RBAC: Adding query filter params (role.id=060d4a1eef7a45858664a42696ff4a19, scope.project.id=5d1d6f8141924b2d99b766f975a3d43b, user.id=abaa12b94c834676bb17bf997dace5d1) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:49.053045 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5aeba9-867d-49b0-a125-54731927dd7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:49.054503 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5aeba9-867d-49b0-a125-54731927dd7e None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:49.062206 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 342/684] 10.222.0.21 () {56 vars in 1374 bytes} [Mon Feb 28 10:18:48 2022] GET /identity/v3/role_assignments?user.id=abaa12b94c834676bb17bf997dace5d1&scope.project.id=5d1d6f8141924b2d99b766f975a3d43b&role.id=060d4a1eef7a45858664a42696ff4a19 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:49.063159 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5aeba9-867d-49b0-a125-54731927dd7e None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:49.069783 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a206b-c2b5-459b-9e43-ba3fddee1de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:49.071024 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a206b-c2b5-459b-9e43-ba3fddee1de5 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:49.071566 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a206b-c2b5-459b-9e43-ba3fddee1de5 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:49.072303 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a206b-c2b5-459b-9e43-ba3fddee1de5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:49.082934 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456a206b-c2b5-459b-9e43-ba3fddee1de5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:49.084761 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456a206b-c2b5-459b-9e43-ba3fddee1de5 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:49.101629 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-456a206b-c2b5-459b-9e43-ba3fddee1de5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 28 10:18:49.103574 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 343/685] 10.222.0.21 () {56 vars in 1096 bytes} [Mon Feb 28 10:18:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:49.112244 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a206b-c2b5-459b-9e43-ba3fddee1de5 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:49.193871 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5aeba9-867d-49b0-a125-54731927dd7e None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:49.232372 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985de943-cfb5-4926-8afc-537ec91f172f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:49.233590 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985de943-cfb5-4926-8afc-537ec91f172f None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:49.234940 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985de943-cfb5-4926-8afc-537ec91f172f None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:49.235059 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985de943-cfb5-4926-8afc-537ec91f172f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:49.236396 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a206b-c2b5-459b-9e43-ba3fddee1de5 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:49.263457 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985de943-cfb5-4926-8afc-537ec91f172f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:18:49.271874 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-985de943-cfb5-4926-8afc-537ec91f172f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:18:49.273538 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 343/686] 10.222.0.21 () {56 vars in 1096 bytes} [Mon Feb 28 10:18:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:49.278452 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a99dd7-21f3-4b92-b707-05c5a09a4994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:49.279813 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a99dd7-21f3-4b92-b707-05c5a09a4994 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:49.280298 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a99dd7-21f3-4b92-b707-05c5a09a4994 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:49.280707 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985de943-cfb5-4926-8afc-537ec91f172f None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:49.281013 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a99dd7-21f3-4b92-b707-05c5a09a4994 None admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:49.282047 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a99dd7-21f3-4b92-b707-05c5a09a4994 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:49.282567 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a99dd7-21f3-4b92-b707-05c5a09a4994 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:49.284217 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a99dd7-21f3-4b92-b707-05c5a09a4994 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:49.306378 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 344/687] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Feb 28 10:18:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:49.313367 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a99dd7-21f3-4b92-b707-05c5a09a4994 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:49.402416 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985de943-cfb5-4926-8afc-537ec91f172f None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:49.417568 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a99dd7-21f3-4b92-b707-05c5a09a4994 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:49.441696 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa61bb7-a4bc-4865-bcf1-55fadd205cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:49.442454 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa61bb7-a4bc-4865-bcf1-55fadd205cc1 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:49.442822 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa61bb7-a4bc-4865-bcf1-55fadd205cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:49.443159 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa61bb7-a4bc-4865-bcf1-55fadd205cc1 None admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:49.443956 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa61bb7-a4bc-4865-bcf1-55fadd205cc1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:49.444322 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa61bb7-a4bc-4865-bcf1-55fadd205cc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:49.445742 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa61bb7-a4bc-4865-bcf1-55fadd205cc1 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:49.453995 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf41b16-8ecc-4a90-94e8-fc87640ce4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:49.454825 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf41b16-8ecc-4a90-94e8-fc87640ce4e2 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:49.455111 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf41b16-8ecc-4a90-94e8-fc87640ce4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:49.455381 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf41b16-8ecc-4a90-94e8-fc87640ce4e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:49.458117 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 344/688] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:18:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:49.467855 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa61bb7-a4bc-4865-bcf1-55fadd205cc1 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:49.523824 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf41b16-8ecc-4a90-94e8-fc87640ce4e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:49.525272 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf41b16-8ecc-4a90-94e8-fc87640ce4e2 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:49.597357 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa61bb7-a4bc-4865-bcf1-55fadd205cc1 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:49.624309 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 345/689] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:18:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:18:49.633953 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf41b16-8ecc-4a90-94e8-fc87640ce4e2 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:49.687948 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090adf90-2b18-4f05-b2a4-4d1ce53b37b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:49.688672 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090adf90-2b18-4f05-b2a4-4d1ce53b37b4 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:49.688953 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090adf90-2b18-4f05-b2a4-4d1ce53b37b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:49.689227 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090adf90-2b18-4f05-b2a4-4d1ce53b37b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:49.712680 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090adf90-2b18-4f05-b2a4-4d1ce53b37b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:49.714141 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090adf90-2b18-4f05-b2a4-4d1ce53b37b4 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:49.738237 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf41b16-8ecc-4a90-94e8-fc87640ce4e2 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:49.746032 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-090adf90-2b18-4f05-b2a4-4d1ce53b37b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:18:49.755201 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 345/690] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:18:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:18:49.760211 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090adf90-2b18-4f05-b2a4-4d1ce53b37b4 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:49.803835 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b3a72-bdd9-48e1-a097-0b99aa4f67b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:49.804622 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b3a72-bdd9-48e1-a097-0b99aa4f67b4 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:49.804904 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b3a72-bdd9-48e1-a097-0b99aa4f67b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:49.805174 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b3a72-bdd9-48e1-a097-0b99aa4f67b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:49.828702 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077b3a72-bdd9-48e1-a097-0b99aa4f67b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:49.830164 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077b3a72-bdd9-48e1-a097-0b99aa4f67b4 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:49.867068 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090adf90-2b18-4f05-b2a4-4d1ce53b37b4 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:49.869782 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-077b3a72-bdd9-48e1-a097-0b99aa4f67b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:18:49.872490 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 346/691] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:18:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:18:49.879548 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b3a72-bdd9-48e1-a097-0b99aa4f67b4 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:49.908473 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783ae34-9c14-4d8c-8672-d1e4f14c350a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:49.909093 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783ae34-9c14-4d8c-8672-d1e4f14c350a None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:49.909373 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783ae34-9c14-4d8c-8672-d1e4f14c350a None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:49.909641 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783ae34-9c14-4d8c-8672-d1e4f14c350a None admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:49.910381 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3783ae34-9c14-4d8c-8672-d1e4f14c350a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:49.910705 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3783ae34-9c14-4d8c-8672-d1e4f14c350a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:49.912054 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3783ae34-9c14-4d8c-8672-d1e4f14c350a None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:49.936305 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 346/692] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:18:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:18:49.941575 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783ae34-9c14-4d8c-8672-d1e4f14c350a None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:50.028570 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b3a72-bdd9-48e1-a097-0b99aa4f67b4 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:50.070112 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ca50a-ddf3-42d8-a843-e341423cb0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:50.070789 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ca50a-ddf3-42d8-a843-e341423cb0cb None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:50.071064 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ca50a-ddf3-42d8-a843-e341423cb0cb None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:50.071330 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ca50a-ddf3-42d8-a843-e341423cb0cb None admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:50.072296 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8ca50a-ddf3-42d8-a843-e341423cb0cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:50.072592 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8ca50a-ddf3-42d8-a843-e341423cb0cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:50.073954 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8ca50a-ddf3-42d8-a843-e341423cb0cb None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:50.094065 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 347/693] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:18:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:50.099695 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ca50a-ddf3-42d8-a843-e341423cb0cb None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:50.141105 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783ae34-9c14-4d8c-8672-d1e4f14c350a None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:50.196260 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c57898-8c56-4cd2-9835-d8faf2ac1859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:50.197285 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c57898-8c56-4cd2-9835-d8faf2ac1859 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:50.197566 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c57898-8c56-4cd2-9835-d8faf2ac1859 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:50.197837 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c57898-8c56-4cd2-9835-d8faf2ac1859 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:50.207552 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c57898-8c56-4cd2-9835-d8faf2ac1859 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:50.208983 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c57898-8c56-4cd2-9835-d8faf2ac1859 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:50.232499 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-75c57898-8c56-4cd2-9835-d8faf2ac1859 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 10:18:50.234080 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 347/694] 10.222.0.21 () {56 vars in 1093 bytes} [Mon Feb 28 10:18:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:50.239504 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c57898-8c56-4cd2-9835-d8faf2ac1859 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:50.283304 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ca50a-ddf3-42d8-a843-e341423cb0cb None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:50.346266 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804ee44-309a-47ba-9218-641bccf00c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:50.347136 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804ee44-309a-47ba-9218-641bccf00c6e None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:50.347417 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804ee44-309a-47ba-9218-641bccf00c6e None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:50.347690 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804ee44-309a-47ba-9218-641bccf00c6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:50.362021 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804ee44-309a-47ba-9218-641bccf00c6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:50.363687 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804ee44-309a-47ba-9218-641bccf00c6e None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:50.387482 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-2804ee44-309a-47ba-9218-641bccf00c6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:18:50.389732 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 348/695] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:18:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:50.394739 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804ee44-309a-47ba-9218-641bccf00c6e None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:50.401765 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c57898-8c56-4cd2-9835-d8faf2ac1859 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:50.471527 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788980b-c7f5-4f00-bd0e-f9310131e4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:50.472116 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788980b-c7f5-4f00-bd0e-f9310131e4d1 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:50.472395 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788980b-c7f5-4f00-bd0e-f9310131e4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:50.472663 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788980b-c7f5-4f00-bd0e-f9310131e4d1 None admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:50.473489 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8788980b-c7f5-4f00-bd0e-f9310131e4d1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:50.473791 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8788980b-c7f5-4f00-bd0e-f9310131e4d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:50.475234 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8788980b-c7f5-4f00-bd0e-f9310131e4d1 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:50.497208 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 348/696] 10.222.0.21 () {56 vars in 1133 bytes} [Mon Feb 28 10:18:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:50.502665 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788980b-c7f5-4f00-bd0e-f9310131e4d1 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:50.594650 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804ee44-309a-47ba-9218-641bccf00c6e None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:50.616611 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788980b-c7f5-4f00-bd0e-f9310131e4d1 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:50.651336 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f67187-99b9-43ea-881c-c8a3b51f9ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:50.651989 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f67187-99b9-43ea-881c-c8a3b51f9ba0 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:50.652269 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f67187-99b9-43ea-881c-c8a3b51f9ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:50.653061 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f67187-99b9-43ea-881c-c8a3b51f9ba0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:50.670468 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea88a0f5-0851-44fb-8acb-c349c5cb0aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:50.671482 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea88a0f5-0851-44fb-8acb-c349c5cb0aae None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:50.671991 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea88a0f5-0851-44fb-8acb-c349c5cb0aae None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:50.672466 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea88a0f5-0851-44fb-8acb-c349c5cb0aae None admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:50.673463 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea88a0f5-0851-44fb-8acb-c349c5cb0aae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:50.673990 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea88a0f5-0851-44fb-8acb-c349c5cb0aae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:50.675658 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea88a0f5-0851-44fb-8acb-c349c5cb0aae None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:50.709245 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 349/697] 10.222.0.21 () {56 vars in 1148 bytes} [Mon Feb 28 10:18:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:50.714682 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea88a0f5-0851-44fb-8acb-c349c5cb0aae None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:50.731234 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f67187-99b9-43ea-881c-c8a3b51f9ba0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:50.731234 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f67187-99b9-43ea-881c-c8a3b51f9ba0 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:50.837336 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 349/698] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:18:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Feb 28 10:18:50.845579 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f67187-99b9-43ea-881c-c8a3b51f9ba0 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:50.956249 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f67187-99b9-43ea-881c-c8a3b51f9ba0 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:50.964712 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea88a0f5-0851-44fb-8acb-c349c5cb0aae None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:51.001797 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d09e62-bb41-4a98-b9c7-12e296cbfe8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:51.002526 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d09e62-bb41-4a98-b9c7-12e296cbfe8a None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:51.002829 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d09e62-bb41-4a98-b9c7-12e296cbfe8a None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:51.003103 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d09e62-bb41-4a98-b9c7-12e296cbfe8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:51.022625 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d09e62-bb41-4a98-b9c7-12e296cbfe8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:51.024076 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d09e62-bb41-4a98-b9c7-12e296cbfe8a None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:51.039841 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e4c5e0-5523-48fe-8483-9b829f3bf20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:51.040552 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4c5e0-5523-48fe-8483-9b829f3bf20c None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:51.040835 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4c5e0-5523-48fe-8483-9b829f3bf20c None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:51.041108 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4c5e0-5523-48fe-8483-9b829f3bf20c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:51.041930 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e4c5e0-5523-48fe-8483-9b829f3bf20c None admin] RBAC: Adding query filter params (role.id=060d4a1eef7a45858664a42696ff4a19, scope.project.id=5d1d6f8141924b2d99b766f975a3d43b, user.id=8696fe8a37aa4d73a62bdc2efd35a23d) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:51.042236 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e4c5e0-5523-48fe-8483-9b829f3bf20c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:51.044311 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e4c5e0-5523-48fe-8483-9b829f3bf20c None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:51.047071 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-e9d09e62-bb41-4a98-b9c7-12e296cbfe8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:18:51.048566 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 350/699] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:18:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:51.053800 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d09e62-bb41-4a98-b9c7-12e296cbfe8a None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:51.059721 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 350/700] 10.222.0.21 () {56 vars in 1374 bytes} [Mon Feb 28 10:18:50 2022] GET /identity/v3/role_assignments?user.id=8696fe8a37aa4d73a62bdc2efd35a23d&scope.project.id=5d1d6f8141924b2d99b766f975a3d43b&role.id=060d4a1eef7a45858664a42696ff4a19 => generated 608 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:51.061046 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d9873-de00-47f5-a6cd-81754e9894db None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:51.061491 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d9873-de00-47f5-a6cd-81754e9894db None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:51.061769 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d9873-de00-47f5-a6cd-81754e9894db None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:51.063700 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 351/701] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:18:51.069008 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a040ae-4394-41ef-b424-0e6bc685c65d None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:51.069292 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a040ae-4394-41ef-b424-0e6bc685c65d None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:51.069618 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a040ae-4394-41ef-b424-0e6bc685c65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:51.107790 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-e2a040ae-4394-41ef-b424-0e6bc685c65d None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:51.108988 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-e2a040ae-4394-41ef-b424-0e6bc685c65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:51.171739 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d09e62-bb41-4a98-b9c7-12e296cbfe8a None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:51.222063 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e87da68-3267-4e5b-bd8a-78562fd9f306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:51.222715 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87da68-3267-4e5b-bd8a-78562fd9f306 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:51.222997 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87da68-3267-4e5b-bd8a-78562fd9f306 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:51.223271 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87da68-3267-4e5b-bd8a-78562fd9f306 None admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:51.224098 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e87da68-3267-4e5b-bd8a-78562fd9f306 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:51.224294 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e87da68-3267-4e5b-bd8a-78562fd9f306 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:51.225941 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e87da68-3267-4e5b-bd8a-78562fd9f306 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:51.238102 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 352/702] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:18:51.252746 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 351/703] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:18:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:51.258225 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a040ae-4394-41ef-b424-0e6bc685c65d None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:51.269251 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e87da68-3267-4e5b-bd8a-78562fd9f306 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:51.379934 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a040ae-4394-41ef-b424-0e6bc685c65d None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:51.390359 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e87da68-3267-4e5b-bd8a-78562fd9f306 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:51.429577 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa54e6-08ce-40d6-8b35-0d42814baf0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:51.430893 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa54e6-08ce-40d6-8b35-0d42814baf0e None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:51.431506 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa54e6-08ce-40d6-8b35-0d42814baf0e None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:51.431989 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa54e6-08ce-40d6-8b35-0d42814baf0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:51.432095 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e5a11-a421-4697-8465-e84e552b09db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:51.432921 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e5a11-a421-4697-8465-e84e552b09db None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:51.433235 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e5a11-a421-4697-8465-e84e552b09db None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:51.433544 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e5a11-a421-4697-8465-e84e552b09db None admin] PATH_INFO: `/v3/projects/service` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:51.444003 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82e5a11-a421-4697-8465-e84e552b09db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:51.445532 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82e5a11-a421-4697-8465-e84e552b09db None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:51.450825 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa54e6-08ce-40d6-8b35-0d42814baf0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:51.453236 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa54e6-08ce-40d6-8b35-0d42814baf0e None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:51.462309 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-d82e5a11-a421-4697-8465-e84e552b09db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:18:51.464108 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 353/704] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:18:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:51.471858 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e5a11-a421-4697-8465-e84e552b09db None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:51.474619 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-06aa54e6-08ce-40d6-8b35-0d42814baf0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:18:51.476473 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 352/705] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:18:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:51.483207 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa54e6-08ce-40d6-8b35-0d42814baf0e None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:51.589448 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e5a11-a421-4697-8465-e84e552b09db None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:51.604854 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa54e6-08ce-40d6-8b35-0d42814baf0e None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:51.641064 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e93abe1-9bc7-4ba0-a16a-de3d9eb14ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:51.641977 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93abe1-9bc7-4ba0-a16a-de3d9eb14ec3 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:51.642437 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93abe1-9bc7-4ba0-a16a-de3d9eb14ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:51.642882 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93abe1-9bc7-4ba0-a16a-de3d9eb14ec3 None admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:51.643809 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e93abe1-9bc7-4ba0-a16a-de3d9eb14ec3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:51.645434 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e93abe1-9bc7-4ba0-a16a-de3d9eb14ec3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:51.648775 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e93abe1-9bc7-4ba0-a16a-de3d9eb14ec3 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:51.660152 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b942e-31b2-4e76-b793-bbaf6ef071f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:51.661040 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b942e-31b2-4e76-b793-bbaf6ef071f5 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:51.661520 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b942e-31b2-4e76-b793-bbaf6ef071f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:51.661940 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b942e-31b2-4e76-b793-bbaf6ef071f5 None admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:51.662852 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b942e-31b2-4e76-b793-bbaf6ef071f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:51.663308 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b942e-31b2-4e76-b793-bbaf6ef071f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:51.666569 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b942e-31b2-4e76-b793-bbaf6ef071f5 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:51.673037 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 354/706] 10.222.0.21 () {56 vars in 1148 bytes} [Mon Feb 28 10:18:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:51.678911 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e93abe1-9bc7-4ba0-a16a-de3d9eb14ec3 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:51.690805 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 353/707] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:18:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:51.696844 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b942e-31b2-4e76-b793-bbaf6ef071f5 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:51.800002 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b942e-31b2-4e76-b793-bbaf6ef071f5 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:51.841193 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255a35f-e2a1-4a1e-97ae-f67c9d598a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:51.842108 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255a35f-e2a1-4a1e-97ae-f67c9d598a34 None admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:51.853085 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255a35f-e2a1-4a1e-97ae-f67c9d598a34 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:51.853539 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255a35f-e2a1-4a1e-97ae-f67c9d598a34 None admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:51.854456 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255a35f-e2a1-4a1e-97ae-f67c9d598a34 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:51.857401 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255a35f-e2a1-4a1e-97ae-f67c9d598a34 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:51.891916 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 354/708] 10.222.0.21 () {60 vars in 1132 bytes} [Mon Feb 28 10:18:51 2022] POST /identity/v3/users => generated 254 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:18:51.897495 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e93abe1-9bc7-4ba0-a16a-de3d9eb14ec3 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:51.914029 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3544b-0d0a-440c-9715-a740f5708f35 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:51.914643 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3544b-0d0a-440c-9715-a740f5708f35 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:51.915158 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3544b-0d0a-440c-9715-a740f5708f35 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:51.917354 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 355/709] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:18:51.923865 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920635b9-a26f-4f45-9ac5-aba1850b789d None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:51.924485 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920635b9-a26f-4f45-9ac5-aba1850b789d None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:51.924918 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920635b9-a26f-4f45-9ac5-aba1850b789d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:51.954216 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-920635b9-a26f-4f45-9ac5-aba1850b789d None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:51.956079 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-920635b9-a26f-4f45-9ac5-aba1850b789d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:51.984421 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e54f79-1a69-449e-adfe-7da3b4d7eaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:51.985770 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e54f79-1a69-449e-adfe-7da3b4d7eaa2 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:51.987443 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e54f79-1a69-449e-adfe-7da3b4d7eaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:51.987880 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e54f79-1a69-449e-adfe-7da3b4d7eaa2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:51.988873 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e54f79-1a69-449e-adfe-7da3b4d7eaa2 None admin] RBAC: Adding query filter params (role.id=48e4608a7b3f4b87a20b10c4d1b45aa9, scope.project.id=5d1d6f8141924b2d99b766f975a3d43b, user.id=ec202a34db8e47f4a6c18285245e3f5b) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:51.991486 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e54f79-1a69-449e-adfe-7da3b4d7eaa2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:51.994197 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e54f79-1a69-449e-adfe-7da3b4d7eaa2 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:52.001275 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 355/710] 10.222.0.21 () {56 vars in 1374 bytes} [Mon Feb 28 10:18:51 2022] GET /identity/v3/role_assignments?user.id=ec202a34db8e47f4a6c18285245e3f5b&scope.project.id=5d1d6f8141924b2d99b766f975a3d43b&role.id=48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 259 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:52.059310 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 356/711] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 10:18:52.095928 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e54f79-1a69-449e-adfe-7da3b4d7eaa2 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:52.140022 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38569033-765d-4d55-a1d2-8cef37bd0daa None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:52.140661 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38569033-765d-4d55-a1d2-8cef37bd0daa None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:52.141141 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38569033-765d-4d55-a1d2-8cef37bd0daa None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:52.143461 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 357/712] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:18:52.150432 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5691f8-4f63-47d7-83cd-84212d250161 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:52.151088 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5691f8-4f63-47d7-83cd-84212d250161 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:52.151568 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5691f8-4f63-47d7-83cd-84212d250161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:52.175685 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-8a5691f8-4f63-47d7-83cd-84212d250161 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:52.177246 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-8a5691f8-4f63-47d7-83cd-84212d250161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:52.208368 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e54f79-1a69-449e-adfe-7da3b4d7eaa2 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:52.243862 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2463f1d-8e1f-481b-b257-94073ea0d641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:52.244823 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2463f1d-8e1f-481b-b257-94073ea0d641 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:52.244936 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2463f1d-8e1f-481b-b257-94073ea0d641 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:52.245202 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2463f1d-8e1f-481b-b257-94073ea0d641 None admin] PATH_INFO: `/v3/services/network` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:52.245847 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2463f1d-8e1f-481b-b257-94073ea0d641 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:52.248158 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2463f1d-8e1f-481b-b257-94073ea0d641 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:52.253920 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 358/713] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 10:18:52.261162 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-d2463f1d-8e1f-481b-b257-94073ea0d641 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 28 10:18:52.266953 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 356/714] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:18:52 2022] GET /identity/v3/services/network => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:52.268714 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5691f8-4f63-47d7-83cd-84212d250161 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:52.279264 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2463f1d-8e1f-481b-b257-94073ea0d641 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:52.386373 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5691f8-4f63-47d7-83cd-84212d250161 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:52.410174 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2463f1d-8e1f-481b-b257-94073ea0d641 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:52.426110 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1c42d-a03b-4f67-9699-d635b27ad145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:52.427141 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1c42d-a03b-4f67-9699-d635b27ad145 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:52.427630 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1c42d-a03b-4f67-9699-d635b27ad145 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:52.428085 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1c42d-a03b-4f67-9699-d635b27ad145 None admin] PATH_INFO: `/v3/services` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:52.428967 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f1c42d-a03b-4f67-9699-d635b27ad145 None admin] RBAC: Adding query filter params (name=network) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:52.429532 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f1c42d-a03b-4f67-9699-d635b27ad145 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:52.431111 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f1c42d-a03b-4f67-9699-d635b27ad145 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:52.436912 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 359/715] 10.222.0.21 () {56 vars in 1112 bytes} [Mon Feb 28 10:18:52 2022] GET /identity/v3/services?name=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:52.451354 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1c42d-a03b-4f67-9699-d635b27ad145 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:52.459333 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578b60a-c314-4ce0-9e58-d61ab9838898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:52.460399 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578b60a-c314-4ce0-9e58-d61ab9838898 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:52.460898 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578b60a-c314-4ce0-9e58-d61ab9838898 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:52.463866 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578b60a-c314-4ce0-9e58-d61ab9838898 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:52.464756 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f578b60a-c314-4ce0-9e58-d61ab9838898 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:52.468420 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f578b60a-c314-4ce0-9e58-d61ab9838898 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:52.493969 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-f578b60a-c314-4ce0-9e58-d61ab9838898 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 28 10:18:52.496904 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 357/716] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 10:18:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:18:52.503249 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578b60a-c314-4ce0-9e58-d61ab9838898 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:52.590928 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1c42d-a03b-4f67-9699-d635b27ad145 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:52.636123 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6649086f-f38b-4d01-98af-7a8dcda726bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:52.637518 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6649086f-f38b-4d01-98af-7a8dcda726bf None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:52.638016 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6649086f-f38b-4d01-98af-7a8dcda726bf None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:52.638754 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6649086f-f38b-4d01-98af-7a8dcda726bf None admin] PATH_INFO: `/v3/services` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:52.639666 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6649086f-f38b-4d01-98af-7a8dcda726bf None admin] RBAC: Adding query filter params (type=network) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:52.640174 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6649086f-f38b-4d01-98af-7a8dcda726bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:52.641850 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6649086f-f38b-4d01-98af-7a8dcda726bf None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:52.648373 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 360/717] 10.222.0.21 () {56 vars in 1112 bytes} [Mon Feb 28 10:18:52 2022] GET /identity/v3/services?type=network => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:52.661573 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578b60a-c314-4ce0-9e58-d61ab9838898 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:52.719307 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33eeb0-5133-4f91-93a0-969f252b2781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:52.719979 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33eeb0-5133-4f91-93a0-969f252b2781 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:52.720254 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33eeb0-5133-4f91-93a0-969f252b2781 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:52.720589 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33eeb0-5133-4f91-93a0-969f252b2781 None admin] PATH_INFO: `/v3/services` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:52.721224 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33eeb0-5133-4f91-93a0-969f252b2781 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:52.721521 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33eeb0-5133-4f91-93a0-969f252b2781 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:52.722912 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33eeb0-5133-4f91-93a0-969f252b2781 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:52.728067 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 358/718] 10.222.0.21 () {56 vars in 1124 bytes} [Mon Feb 28 10:18:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:52.733787 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6649086f-f38b-4d01-98af-7a8dcda726bf None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:52.903956 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6649086f-f38b-4d01-98af-7a8dcda726bf None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:52.940032 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e030ef9-f0f6-490d-81dc-589f92d84634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:52.940692 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e030ef9-f0f6-490d-81dc-589f92d84634 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:52.940973 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e030ef9-f0f6-490d-81dc-589f92d84634 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:52.941246 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e030ef9-f0f6-490d-81dc-589f92d84634 None admin] PATH_INFO: `/v3/services` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:52.941942 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e030ef9-f0f6-490d-81dc-589f92d84634 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:52.942242 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e030ef9-f0f6-490d-81dc-589f92d84634 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:52.943709 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e030ef9-f0f6-490d-81dc-589f92d84634 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:52.948857 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 361/719] 10.222.0.21 () {56 vars in 1124 bytes} [Mon Feb 28 10:18:52 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:54.107570 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d89494-be21-441f-b722-2473245bef78 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:54.108134 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d89494-be21-441f-b722-2473245bef78 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:54.108421 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d89494-be21-441f-b722-2473245bef78 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:54.110406 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 359/720] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:18:54.116062 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a42040-a802-4ffd-915d-578159087426 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:54.116935 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a42040-a802-4ffd-915d-578159087426 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:54.117406 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a42040-a802-4ffd-915d-578159087426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:54.140232 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-82a42040-a802-4ffd-915d-578159087426 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:54.141743 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-82a42040-a802-4ffd-915d-578159087426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:54.227273 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 362/721] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 10:18:54.264184 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d89494-be21-441f-b722-2473245bef78 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:54.379476 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d89494-be21-441f-b722-2473245bef78 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:54.417541 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a19f7-37a3-4aa8-8a9d-34a4edcfebd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:54.419334 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a19f7-37a3-4aa8-8a9d-34a4edcfebd9 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:54.419912 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a19f7-37a3-4aa8-8a9d-34a4edcfebd9 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:54.420376 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a19f7-37a3-4aa8-8a9d-34a4edcfebd9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:54.436925 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3a19f7-37a3-4aa8-8a9d-34a4edcfebd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:18:54.443844 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-aa3a19f7-37a3-4aa8-8a9d-34a4edcfebd9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:18:54.445512 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 360/722] 10.222.0.21 () {56 vars in 1096 bytes} [Mon Feb 28 10:18:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:54.451949 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a42040-a802-4ffd-915d-578159087426 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:54.580473 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a42040-a802-4ffd-915d-578159087426 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:54.629981 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe377da-ae7f-4cfc-be5f-15a6b4cf2e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:54.631007 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe377da-ae7f-4cfc-be5f-15a6b4cf2e2a None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:54.631504 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe377da-ae7f-4cfc-be5f-15a6b4cf2e2a None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:54.631981 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe377da-ae7f-4cfc-be5f-15a6b4cf2e2a None admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:54.632910 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe377da-ae7f-4cfc-be5f-15a6b4cf2e2a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:54.633404 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe377da-ae7f-4cfc-be5f-15a6b4cf2e2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:54.635018 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe377da-ae7f-4cfc-be5f-15a6b4cf2e2a None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:54.646036 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 363/723] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:18:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:18:54.651653 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a19f7-37a3-4aa8-8a9d-34a4edcfebd9 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:54.760109 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a19f7-37a3-4aa8-8a9d-34a4edcfebd9 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:54.797588 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fdef4d-d4b4-4c11-b771-d84165309496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:54.798741 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fdef4d-d4b4-4c11-b771-d84165309496 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:54.799221 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fdef4d-d4b4-4c11-b771-d84165309496 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:54.799705 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fdef4d-d4b4-4c11-b771-d84165309496 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:54.817735 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fdef4d-d4b4-4c11-b771-d84165309496 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:54.819529 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fdef4d-d4b4-4c11-b771-d84165309496 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:54.839221 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-66fdef4d-d4b4-4c11-b771-d84165309496 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:18:54.841405 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 361/724] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:18:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:54.855307 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe377da-ae7f-4cfc-be5f-15a6b4cf2e2a None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:54.945361 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c68f9b-9406-4382-8190-7f62dcef59d9 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:54.945723 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c68f9b-9406-4382-8190-7f62dcef59d9 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:54.946093 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c68f9b-9406-4382-8190-7f62dcef59d9 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:54.948289 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 362/725] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:18:54.962355 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4c08c-9286-4fa0-8bb8-9c6e495a7356 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:54.962668 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4c08c-9286-4fa0-8bb8-9c6e495a7356 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:54.962951 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4c08c-9286-4fa0-8bb8-9c6e495a7356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:54.988583 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-c1a4c08c-9286-4fa0-8bb8-9c6e495a7356 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:54.989778 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-c1a4c08c-9286-4fa0-8bb8-9c6e495a7356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:55.007418 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe377da-ae7f-4cfc-be5f-15a6b4cf2e2a None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:55.053923 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660ae38-8125-43de-9c8f-647ccbffe9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:55.054584 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660ae38-8125-43de-9c8f-647ccbffe9d3 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:55.055317 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660ae38-8125-43de-9c8f-647ccbffe9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:55.055601 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660ae38-8125-43de-9c8f-647ccbffe9d3 None admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:55.056320 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660ae38-8125-43de-9c8f-647ccbffe9d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:55.056625 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660ae38-8125-43de-9c8f-647ccbffe9d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:55.058708 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660ae38-8125-43de-9c8f-647ccbffe9d3 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:55.075284 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 364/726] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:18:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:55.076883 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962628a-5474-4fb7-8245-692f1530e777 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:55.077365 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962628a-5474-4fb7-8245-692f1530e777 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:55.077789 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962628a-5474-4fb7-8245-692f1530e777 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:55.079996 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 365/727] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:18:55.080993 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1962628a-5474-4fb7-8245-692f1530e777 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:55.091583 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 363/728] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 10:18:55.092907 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c35407-b354-49c7-8aa0-79c2d8b16a6e None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:55.093422 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c35407-b354-49c7-8aa0-79c2d8b16a6e None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:55.093910 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c35407-b354-49c7-8aa0-79c2d8b16a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:55.111203 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-46c35407-b354-49c7-8aa0-79c2d8b16a6e None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:55.113173 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-46c35407-b354-49c7-8aa0-79c2d8b16a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:55.185370 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 364/729] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:18:55.191934 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c35407-b354-49c7-8aa0-79c2d8b16a6e None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:55.201255 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1962628a-5474-4fb7-8245-692f1530e777 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:55.239107 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab323e-ca5a-4e6a-a522-b73d8c37db54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:55.240132 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab323e-ca5a-4e6a-a522-b73d8c37db54 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:55.240574 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab323e-ca5a-4e6a-a522-b73d8c37db54 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:55.240995 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab323e-ca5a-4e6a-a522-b73d8c37db54 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:55.248828 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab323e-ca5a-4e6a-a522-b73d8c37db54 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:55.250446 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab323e-ca5a-4e6a-a522-b73d8c37db54 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:55.265229 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-3eab323e-ca5a-4e6a-a522-b73d8c37db54 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 28 10:18:55.266997 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 366/730] 10.222.0.21 () {56 vars in 1096 bytes} [Mon Feb 28 10:18:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:55.267916 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab323e-ca5a-4e6a-a522-b73d8c37db54 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:55.321930 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c35407-b354-49c7-8aa0-79c2d8b16a6e None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:55.358282 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42adecea-e664-453c-83ac-1490c343e710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:55.359559 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42adecea-e664-453c-83ac-1490c343e710 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:55.360019 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42adecea-e664-453c-83ac-1490c343e710 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:55.360472 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42adecea-e664-453c-83ac-1490c343e710 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:55.371106 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42adecea-e664-453c-83ac-1490c343e710 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:18:55.372416 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab323e-ca5a-4e6a-a522-b73d8c37db54 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:55.378545 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-42adecea-e664-453c-83ac-1490c343e710 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:18:55.380292 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 365/731] 10.222.0.21 () {56 vars in 1096 bytes} [Mon Feb 28 10:18:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:55.381320 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42adecea-e664-453c-83ac-1490c343e710 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:55.407495 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd2132-4765-4821-bc7b-3093be009594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:55.408606 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd2132-4765-4821-bc7b-3093be009594 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:55.408720 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd2132-4765-4821-bc7b-3093be009594 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:55.408910 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd2132-4765-4821-bc7b-3093be009594 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:55.419642 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd2132-4765-4821-bc7b-3093be009594 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:18:55.426589 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-58fd2132-4765-4821-bc7b-3093be009594 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 10:18:55.432883 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 367/732] 10.222.0.21 () {56 vars in 1102 bytes} [Mon Feb 28 10:18:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:55.432883 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd2132-4765-4821-bc7b-3093be009594 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:55.501864 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42adecea-e664-453c-83ac-1490c343e710 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:55.551382 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34bf2ab-0aa0-4de7-a4be-288adbd54c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:55.552060 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34bf2ab-0aa0-4de7-a4be-288adbd54c75 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:55.552363 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34bf2ab-0aa0-4de7-a4be-288adbd54c75 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:55.552639 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34bf2ab-0aa0-4de7-a4be-288adbd54c75 None admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:55.553474 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34bf2ab-0aa0-4de7-a4be-288adbd54c75 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:55.553768 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34bf2ab-0aa0-4de7-a4be-288adbd54c75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:55.555244 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34bf2ab-0aa0-4de7-a4be-288adbd54c75 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:55.556796 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd2132-4765-4821-bc7b-3093be009594 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:55.579602 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 366/733] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Feb 28 10:18:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:55.580275 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34bf2ab-0aa0-4de7-a4be-288adbd54c75 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:55.595914 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f880e-f5da-4e1b-83b3-00b8c00c30db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:55.596666 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f880e-f5da-4e1b-83b3-00b8c00c30db None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:55.596955 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f880e-f5da-4e1b-83b3-00b8c00c30db None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:55.597235 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f880e-f5da-4e1b-83b3-00b8c00c30db None admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:55.597966 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744f880e-f5da-4e1b-83b3-00b8c00c30db None admin] RBAC: Adding query filter params (name=admin) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:55.598283 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744f880e-f5da-4e1b-83b3-00b8c00c30db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:55.599693 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744f880e-f5da-4e1b-83b3-00b8c00c30db None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:55.607851 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 368/734] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:18:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:55.609271 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc724a54-84a9-43e1-9999-5634d402b7f7 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:55.609622 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc724a54-84a9-43e1-9999-5634d402b7f7 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:55.609972 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc724a54-84a9-43e1-9999-5634d402b7f7 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:55.612083 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 369/735] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:18:55.612861 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc724a54-84a9-43e1-9999-5634d402b7f7 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:55.680171 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34bf2ab-0aa0-4de7-a4be-288adbd54c75 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:55.713005 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc724a54-84a9-43e1-9999-5634d402b7f7 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:55.714093 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e08e3-3676-4c2d-9aa7-0610294b7ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:55.715502 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e08e3-3676-4c2d-9aa7-0610294b7ad3 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:55.715984 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e08e3-3676-4c2d-9aa7-0610294b7ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:55.716333 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e08e3-3676-4c2d-9aa7-0610294b7ad3 None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:55.717081 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e08e3-3676-4c2d-9aa7-0610294b7ad3 None admin] RBAC: Adding query filter params (name=service) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:55.717387 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e08e3-3676-4c2d-9aa7-0610294b7ad3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:55.718773 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e08e3-3676-4c2d-9aa7-0610294b7ad3 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:55.731621 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 367/736] 10.222.0.21 () {56 vars in 1103 bytes} [Mon Feb 28 10:18:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:55.732876 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab8f0c-8a95-420d-ab16-ca236fa06c23 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:55.733170 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab8f0c-8a95-420d-ab16-ca236fa06c23 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:55.733445 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab8f0c-8a95-420d-ab16-ca236fa06c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:55.747981 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e55e8-4ac4-4ab7-b37c-a3cc79e5b115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:55.748625 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e55e8-4ac4-4ab7-b37c-a3cc79e5b115 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:55.748908 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e55e8-4ac4-4ab7-b37c-a3cc79e5b115 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:55.749181 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e55e8-4ac4-4ab7-b37c-a3cc79e5b115 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:55.751297 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-26ab8f0c-8a95-420d-ab16-ca236fa06c23 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:55.752528 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-26ab8f0c-8a95-420d-ab16-ca236fa06c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:55.816536 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e55e8-4ac4-4ab7-b37c-a3cc79e5b115 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:55.817979 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e55e8-4ac4-4ab7-b37c-a3cc79e5b115 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:55.826751 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 368/737] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:18:55.826751 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab8f0c-8a95-420d-ab16-ca236fa06c23 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:55.926310 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab8f0c-8a95-420d-ab16-ca236fa06c23 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:55.931223 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 370/738] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:18:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 10:18:55.932055 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e55e8-4ac4-4ab7-b37c-a3cc79e5b115 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:55.959944 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77980a70-c954-4792-a22a-8563b2d49b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:55.960720 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77980a70-c954-4792-a22a-8563b2d49b23 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:55.961007 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77980a70-c954-4792-a22a-8563b2d49b23 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:55.961280 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77980a70-c954-4792-a22a-8563b2d49b23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:55.971071 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77980a70-c954-4792-a22a-8563b2d49b23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:55.972503 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77980a70-c954-4792-a22a-8563b2d49b23 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:55.989112 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-77980a70-c954-4792-a22a-8563b2d49b23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:18:55.990424 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 369/739] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:18:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:55.991042 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77980a70-c954-4792-a22a-8563b2d49b23 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:56.026584 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e55e8-4ac4-4ab7-b37c-a3cc79e5b115 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:56.060884 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8750743-0895-498b-87c9-f94cbdb71f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:56.061661 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8750743-0895-498b-87c9-f94cbdb71f0c None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:56.061935 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8750743-0895-498b-87c9-f94cbdb71f0c None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:56.062197 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8750743-0895-498b-87c9-f94cbdb71f0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:56.071760 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8750743-0895-498b-87c9-f94cbdb71f0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:56.073442 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8750743-0895-498b-87c9-f94cbdb71f0c None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:56.086434 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77980a70-c954-4792-a22a-8563b2d49b23 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:56.089901 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-c8750743-0895-498b-87c9-f94cbdb71f0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:18:56.091568 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 371/740] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:18:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:56.092784 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da03cf1-3987-4447-bb38-74bbbb38440f None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:56.093060 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da03cf1-3987-4447-bb38-74bbbb38440f None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:56.093891 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da03cf1-3987-4447-bb38-74bbbb38440f None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:56.096016 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 372/741] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:18:56.097055 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da03cf1-3987-4447-bb38-74bbbb38440f None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:56.119685 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1229e-3d90-48d9-a802-38c7a744d91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:56.120337 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1229e-3d90-48d9-a802-38c7a744d91d None admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:56.120613 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1229e-3d90-48d9-a802-38c7a744d91d None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:56.120885 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1229e-3d90-48d9-a802-38c7a744d91d None admin] PATH_INFO: `/v3/services` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:56.122242 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe1229e-3d90-48d9-a802-38c7a744d91d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:56.123624 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe1229e-3d90-48d9-a802-38c7a744d91d None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:56.150629 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 370/742] 10.222.0.21 () {60 vars in 1141 bytes} [Mon Feb 28 10:18:55 2022] POST /identity/v3/services => generated 240 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:18:56.150629 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1229e-3d90-48d9-a802-38c7a744d91d None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:56.215972 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da03cf1-3987-4447-bb38-74bbbb38440f None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:56.248608 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1229e-3d90-48d9-a802-38c7a744d91d None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:56.251516 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34956f73-93a7-4499-966b-05ee2bf36e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:56.252452 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34956f73-93a7-4499-966b-05ee2bf36e16 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:56.252738 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34956f73-93a7-4499-966b-05ee2bf36e16 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:56.253015 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34956f73-93a7-4499-966b-05ee2bf36e16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:56.264782 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34956f73-93a7-4499-966b-05ee2bf36e16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:56.266246 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34956f73-93a7-4499-966b-05ee2bf36e16 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:56.284325 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-34956f73-93a7-4499-966b-05ee2bf36e16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:18:56.284503 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79500964-019b-41f8-985c-e8d4c82ba3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:56.284964 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79500964-019b-41f8-985c-e8d4c82ba3f4 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:56.285243 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79500964-019b-41f8-985c-e8d4c82ba3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:56.290237 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79500964-019b-41f8-985c-e8d4c82ba3f4 None admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:56.290417 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 373/743] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:18:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:56.290497 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79500964-019b-41f8-985c-e8d4c82ba3f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:56.290497 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79500964-019b-41f8-985c-e8d4c82ba3f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:56.290654 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34956f73-93a7-4499-966b-05ee2bf36e16 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:56.290765 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79500964-019b-41f8-985c-e8d4c82ba3f4 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:56.306765 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 371/744] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:56.306765 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d7b7f-ec6b-46f7-859b-860b76dee8fa None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:56.306765 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d7b7f-ec6b-46f7-859b-860b76dee8fa None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:56.306765 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d7b7f-ec6b-46f7-859b-860b76dee8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:56.320851 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-294d7b7f-ec6b-46f7-859b-860b76dee8fa None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:56.322044 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-294d7b7f-ec6b-46f7-859b-860b76dee8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:56.392508 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 372/745] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:56 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 10:18:56.393659 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d7b7f-ec6b-46f7-859b-860b76dee8fa None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:56.398800 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34956f73-93a7-4499-966b-05ee2bf36e16 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:56.433204 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3bfbde-a515-47e1-8794-9e6af1132431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:56.434622 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bfbde-a515-47e1-8794-9e6af1132431 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:56.434819 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bfbde-a515-47e1-8794-9e6af1132431 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:56.435062 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bfbde-a515-47e1-8794-9e6af1132431 None admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:56.435765 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3bfbde-a515-47e1-8794-9e6af1132431 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:56.436070 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3bfbde-a515-47e1-8794-9e6af1132431 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:56.437432 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3bfbde-a515-47e1-8794-9e6af1132431 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:56.449252 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 374/746] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:56.450172 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3bfbde-a515-47e1-8794-9e6af1132431 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:56.507762 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d7b7f-ec6b-46f7-859b-860b76dee8fa None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:56.541571 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197c258-7f6a-462d-abe7-858df63decf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:56.542235 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197c258-7f6a-462d-abe7-858df63decf5 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:56.542513 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197c258-7f6a-462d-abe7-858df63decf5 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:56.542815 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197c258-7f6a-462d-abe7-858df63decf5 None admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:56.543775 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d197c258-7f6a-462d-abe7-858df63decf5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:56.544079 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d197c258-7f6a-462d-abe7-858df63decf5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:56.545448 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d197c258-7f6a-462d-abe7-858df63decf5 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:56.556023 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3bfbde-a515-47e1-8794-9e6af1132431 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:56.556811 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 373/747] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:56.557579 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197c258-7f6a-462d-abe7-858df63decf5 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:56.602154 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21db935-3ffb-45c9-9284-96c2f1775915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:56.603637 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21db935-3ffb-45c9-9284-96c2f1775915 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:56.604115 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21db935-3ffb-45c9-9284-96c2f1775915 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:56.604834 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21db935-3ffb-45c9-9284-96c2f1775915 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:56.613768 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21db935-3ffb-45c9-9284-96c2f1775915 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:56.615983 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21db935-3ffb-45c9-9284-96c2f1775915 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:56.629832 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-f21db935-3ffb-45c9-9284-96c2f1775915 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 10:18:56.631364 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 375/748] 10.222.0.21 () {56 vars in 1093 bytes} [Mon Feb 28 10:18:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:56.632148 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21db935-3ffb-45c9-9284-96c2f1775915 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:56.660502 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197c258-7f6a-462d-abe7-858df63decf5 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:56.692644 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d22458-762d-47be-bce2-89df7da5f244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:56.693535 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d22458-762d-47be-bce2-89df7da5f244 None admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:56.693813 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d22458-762d-47be-bce2-89df7da5f244 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:56.694083 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d22458-762d-47be-bce2-89df7da5f244 None admin] PATH_INFO: `/v3/services` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:56.694816 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d22458-762d-47be-bce2-89df7da5f244 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:56.696196 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d22458-762d-47be-bce2-89df7da5f244 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:56.718632 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 374/749] 10.222.0.21 () {60 vars in 1141 bytes} [Mon Feb 28 10:18:56 2022] POST /identity/v3/services => generated 251 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:18:56.718632 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d22458-762d-47be-bce2-89df7da5f244 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:56.752598 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21db935-3ffb-45c9-9284-96c2f1775915 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:56.805148 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56fb402-26bc-402b-9a9e-dac5588a8ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:56.805880 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fb402-26bc-402b-9a9e-dac5588a8ed8 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:56.806154 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fb402-26bc-402b-9a9e-dac5588a8ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:56.806420 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fb402-26bc-402b-9a9e-dac5588a8ed8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:56.815663 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56fb402-26bc-402b-9a9e-dac5588a8ed8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:56.817151 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56fb402-26bc-402b-9a9e-dac5588a8ed8 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:56.833600 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-d56fb402-26bc-402b-9a9e-dac5588a8ed8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 28 10:18:56.835221 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 376/750] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Feb 28 10:18:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:56.836011 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56fb402-26bc-402b-9a9e-dac5588a8ed8 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:56.842500 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d22458-762d-47be-bce2-89df7da5f244 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:56.879800 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95518cc-d86d-4445-97b0-d65e55e89c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:56.880598 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95518cc-d86d-4445-97b0-d65e55e89c9a None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:56.880936 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95518cc-d86d-4445-97b0-d65e55e89c9a None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:56.881213 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95518cc-d86d-4445-97b0-d65e55e89c9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:56.889758 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95518cc-d86d-4445-97b0-d65e55e89c9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:56.891306 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95518cc-d86d-4445-97b0-d65e55e89c9a None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:56.906123 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-f95518cc-d86d-4445-97b0-d65e55e89c9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:18:56.907689 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 375/751] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:18:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:56.908472 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95518cc-d86d-4445-97b0-d65e55e89c9a None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:56.943038 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56fb402-26bc-402b-9a9e-dac5588a8ed8 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:56.985523 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6c414-0673-48e9-b20a-ac4636318bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:56.986183 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6c414-0673-48e9-b20a-ac4636318bea None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:56.986513 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6c414-0673-48e9-b20a-ac4636318bea None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:56.986900 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6c414-0673-48e9-b20a-ac4636318bea None admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:56.987689 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d6c414-0673-48e9-b20a-ac4636318bea None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:56.987988 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d6c414-0673-48e9-b20a-ac4636318bea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:56.989494 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d6c414-0673-48e9-b20a-ac4636318bea None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:57.008698 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 377/752] 10.222.0.21 () {56 vars in 1133 bytes} [Mon Feb 28 10:18:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:57.009531 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6c414-0673-48e9-b20a-ac4636318bea None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:57.036048 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95518cc-d86d-4445-97b0-d65e55e89c9a None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:57.082797 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c0cce-cd55-44ce-a4e4-ba0df17881db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:57.083717 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c0cce-cd55-44ce-a4e4-ba0df17881db None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:57.084148 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c0cce-cd55-44ce-a4e4-ba0df17881db None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:57.084570 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c0cce-cd55-44ce-a4e4-ba0df17881db None admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:57.085546 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c0cce-cd55-44ce-a4e4-ba0df17881db None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:57.086012 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c0cce-cd55-44ce-a4e4-ba0df17881db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:57.088068 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c0cce-cd55-44ce-a4e4-ba0df17881db None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:57.112088 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6c414-0673-48e9-b20a-ac4636318bea None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:57.112793 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 376/753] 10.222.0.21 () {56 vars in 1149 bytes} [Mon Feb 28 10:18:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:57.114010 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c0cce-cd55-44ce-a4e4-ba0df17881db None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:57.148252 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79756ffa-f5f6-4fd2-91a6-88f3142e6262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:57.149070 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79756ffa-f5f6-4fd2-91a6-88f3142e6262 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:57.149463 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79756ffa-f5f6-4fd2-91a6-88f3142e6262 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:57.150093 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79756ffa-f5f6-4fd2-91a6-88f3142e6262 None admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:57.151621 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79756ffa-f5f6-4fd2-91a6-88f3142e6262 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:57.151621 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79756ffa-f5f6-4fd2-91a6-88f3142e6262 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:57.154417 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79756ffa-f5f6-4fd2-91a6-88f3142e6262 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:57.167265 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 378/754] 10.222.0.21 () {56 vars in 1148 bytes} [Mon Feb 28 10:18:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:57.168358 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79756ffa-f5f6-4fd2-91a6-88f3142e6262 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:57.218212 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c0cce-cd55-44ce-a4e4-ba0df17881db None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:57.253362 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d91e8e-f561-4a56-8f90-9b44e987b484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:57.254388 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d91e8e-f561-4a56-8f90-9b44e987b484 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:57.254870 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d91e8e-f561-4a56-8f90-9b44e987b484 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:57.255293 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d91e8e-f561-4a56-8f90-9b44e987b484 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:57.266236 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d91e8e-f561-4a56-8f90-9b44e987b484 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:57.267936 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d91e8e-f561-4a56-8f90-9b44e987b484 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:57.275386 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79756ffa-f5f6-4fd2-91a6-88f3142e6262 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:57.286301 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-99d91e8e-f561-4a56-8f90-9b44e987b484 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:18:57.288093 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 377/755] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:18:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:57.289188 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d91e8e-f561-4a56-8f90-9b44e987b484 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:57.312089 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d228b5-be6e-430d-a504-6bbf5a6cae94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:57.312760 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d228b5-be6e-430d-a504-6bbf5a6cae94 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:57.313037 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d228b5-be6e-430d-a504-6bbf5a6cae94 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:57.313440 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d228b5-be6e-430d-a504-6bbf5a6cae94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:57.383658 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d228b5-be6e-430d-a504-6bbf5a6cae94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:57.385065 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d228b5-be6e-430d-a504-6bbf5a6cae94 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:57.397005 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d91e8e-f561-4a56-8f90-9b44e987b484 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:57.431325 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5545d9-1306-4c17-b6b3-c1efd23f985d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:57.432342 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5545d9-1306-4c17-b6b3-c1efd23f985d None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:57.432831 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5545d9-1306-4c17-b6b3-c1efd23f985d None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:57.433328 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5545d9-1306-4c17-b6b3-c1efd23f985d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:57.434561 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5545d9-1306-4c17-b6b3-c1efd23f985d None admin] RBAC: Adding query filter params (role.id=48e4608a7b3f4b87a20b10c4d1b45aa9, scope.project.id=5d1d6f8141924b2d99b766f975a3d43b, user.id=8696fe8a37aa4d73a62bdc2efd35a23d) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:57.435102 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5545d9-1306-4c17-b6b3-c1efd23f985d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:57.436733 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5545d9-1306-4c17-b6b3-c1efd23f985d None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:57.442802 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 378/756] 10.222.0.21 () {56 vars in 1374 bytes} [Mon Feb 28 10:18:57 2022] GET /identity/v3/role_assignments?user.id=8696fe8a37aa4d73a62bdc2efd35a23d&scope.project.id=5d1d6f8141924b2d99b766f975a3d43b&role.id=48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:57.443906 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5545d9-1306-4c17-b6b3-c1efd23f985d None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:57.490152 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 379/757] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:18:57 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 10:18:57.499736 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d228b5-be6e-430d-a504-6bbf5a6cae94 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:57.553677 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5545d9-1306-4c17-b6b3-c1efd23f985d None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:57.594300 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db64c67-eaf7-411c-8aa0-873523380a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:57.595395 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db64c67-eaf7-411c-8aa0-873523380a57 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:57.595882 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db64c67-eaf7-411c-8aa0-873523380a57 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:57.596364 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db64c67-eaf7-411c-8aa0-873523380a57 None admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:57.597303 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db64c67-eaf7-411c-8aa0-873523380a57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:57.597819 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db64c67-eaf7-411c-8aa0-873523380a57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:57.599497 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db64c67-eaf7-411c-8aa0-873523380a57 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:57.614214 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 379/758] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:18:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:57.624172 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db64c67-eaf7-411c-8aa0-873523380a57 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:57.674761 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d228b5-be6e-430d-a504-6bbf5a6cae94 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:57.709730 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d15eec-1ede-4c9d-a189-8bc1f0025f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:57.710563 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d15eec-1ede-4c9d-a189-8bc1f0025f32 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:57.710868 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d15eec-1ede-4c9d-a189-8bc1f0025f32 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:57.711137 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d15eec-1ede-4c9d-a189-8bc1f0025f32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:57.722861 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d15eec-1ede-4c9d-a189-8bc1f0025f32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:57.726151 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d15eec-1ede-4c9d-a189-8bc1f0025f32 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:57.754180 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db64c67-eaf7-411c-8aa0-873523380a57 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:57.755349 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-e4d15eec-1ede-4c9d-a189-8bc1f0025f32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:18:57.766766 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 380/759] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:18:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:57.768129 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d15eec-1ede-4c9d-a189-8bc1f0025f32 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:57.792361 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340877c1-3cbf-4005-8f69-0623cd805bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:57.793698 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340877c1-3cbf-4005-8f69-0623cd805bb9 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:57.794188 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340877c1-3cbf-4005-8f69-0623cd805bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:57.794690 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340877c1-3cbf-4005-8f69-0623cd805bb9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:57.801853 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340877c1-3cbf-4005-8f69-0623cd805bb9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:57.803595 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340877c1-3cbf-4005-8f69-0623cd805bb9 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:57.817864 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-340877c1-3cbf-4005-8f69-0623cd805bb9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:18:57.819695 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 380/760] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:18:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:57.827483 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340877c1-3cbf-4005-8f69-0623cd805bb9 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:57.922764 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d15eec-1ede-4c9d-a189-8bc1f0025f32 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:57.984462 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875be892-1344-4b27-92a0-43c547fe2ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:57.985049 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875be892-1344-4b27-92a0-43c547fe2ef1 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:57.985327 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875be892-1344-4b27-92a0-43c547fe2ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:57.985595 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875be892-1344-4b27-92a0-43c547fe2ef1 None admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:57.986315 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875be892-1344-4b27-92a0-43c547fe2ef1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:57.986627 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875be892-1344-4b27-92a0-43c547fe2ef1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:57.988000 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875be892-1344-4b27-92a0-43c547fe2ef1 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:58.005953 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340877c1-3cbf-4005-8f69-0623cd805bb9 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:58.014838 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 381/761] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:18:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:18:58.021108 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875be892-1344-4b27-92a0-43c547fe2ef1 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:58.092675 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4bac99-8209-4300-83e6-552841f6fcf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:58.093339 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4bac99-8209-4300-83e6-552841f6fcf3 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:58.093617 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4bac99-8209-4300-83e6-552841f6fcf3 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:58.093886 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4bac99-8209-4300-83e6-552841f6fcf3 None admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:58.094690 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4bac99-8209-4300-83e6-552841f6fcf3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:58.094991 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4bac99-8209-4300-83e6-552841f6fcf3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:58.096431 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4bac99-8209-4300-83e6-552841f6fcf3 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:58.126418 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875be892-1344-4b27-92a0-43c547fe2ef1 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:58.129103 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 381/762] 10.222.0.21 () {56 vars in 1148 bytes} [Mon Feb 28 10:18:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:58.134733 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4bac99-8209-4300-83e6-552841f6fcf3 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:58.161107 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959d104-5a3b-4c79-84ee-864111920502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:58.161893 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959d104-5a3b-4c79-84ee-864111920502 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:58.162171 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959d104-5a3b-4c79-84ee-864111920502 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:58.162437 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959d104-5a3b-4c79-84ee-864111920502 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:58.170581 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a959d104-5a3b-4c79-84ee-864111920502 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:58.172086 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a959d104-5a3b-4c79-84ee-864111920502 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:58.187856 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-a959d104-5a3b-4c79-84ee-864111920502 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:18:58.189453 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 382/763] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:18:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:18:58.200426 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959d104-5a3b-4c79-84ee-864111920502 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:58.280920 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4bac99-8209-4300-83e6-552841f6fcf3 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:58.317883 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042e870-0a89-499f-b798-16adea90bd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:58.318986 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042e870-0a89-499f-b798-16adea90bd24 None admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:58.319274 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042e870-0a89-499f-b798-16adea90bd24 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:58.319552 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042e870-0a89-499f-b798-16adea90bd24 None admin] PATH_INFO: `/v3/projects/5d1d6f8141924b2d99b766f975a3d43b/users/ec202a34db8e47f4a6c18285245e3f5b/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:58.321696 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042e870-0a89-499f-b798-16adea90bd24 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d1d6f8141924b2d99b766f975a3d43b, user_id=ec202a34db8e47f4a6c18285245e3f5b, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:58.323841 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042e870-0a89-499f-b798-16adea90bd24 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:58.340644 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 382/764] 10.222.0.21 () {58 vars in 1439 bytes} [Mon Feb 28 10:18:58 2022] PUT /identity/v3/projects/5d1d6f8141924b2d99b766f975a3d43b/users/ec202a34db8e47f4a6c18285245e3f5b/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:18:58.422844 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959d104-5a3b-4c79-84ee-864111920502 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:58.479351 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d472f-f2b2-4185-8c49-aff37dd40bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:58.480032 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d472f-f2b2-4185-8c49-aff37dd40bb3 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:58.480308 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d472f-f2b2-4185-8c49-aff37dd40bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:58.480611 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d472f-f2b2-4185-8c49-aff37dd40bb3 None admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:58.481472 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d472f-f2b2-4185-8c49-aff37dd40bb3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:58.481777 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d472f-f2b2-4185-8c49-aff37dd40bb3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:58.483285 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d472f-f2b2-4185-8c49-aff37dd40bb3 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:58.497035 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 383/765] 10.222.0.21 () {56 vars in 1148 bytes} [Mon Feb 28 10:18:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:58.502592 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042e870-0a89-499f-b798-16adea90bd24 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:58.606386 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb2dc9-c839-465e-9e30-0a023c7fe19d None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:58.606770 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb2dc9-c839-465e-9e30-0a023c7fe19d None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:58.607024 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb2dc9-c839-465e-9e30-0a023c7fe19d None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:58.609806 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 384/766] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:18:58.614304 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a801e6-011a-4011-806c-f9071824bf2b None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:58.614586 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a801e6-011a-4011-806c-f9071824bf2b None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:58.614883 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a801e6-011a-4011-806c-f9071824bf2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:58.622819 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042e870-0a89-499f-b798-16adea90bd24 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:58.638367 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-23a801e6-011a-4011-806c-f9071824bf2b None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:58.639780 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-23a801e6-011a-4011-806c-f9071824bf2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:58.668919 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e3ce0-a294-4ced-8227-2f5e1962613f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:58.669621 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e3ce0-a294-4ced-8227-2f5e1962613f None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:58.669898 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e3ce0-a294-4ced-8227-2f5e1962613f None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:58.670170 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e3ce0-a294-4ced-8227-2f5e1962613f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:58.671014 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e3ce0-a294-4ced-8227-2f5e1962613f None admin] RBAC: Adding query filter params (role.id=060d4a1eef7a45858664a42696ff4a19, scope.project.id=5d1d6f8141924b2d99b766f975a3d43b, user.id=1c1284bfe6cc43848731ed2b3d9e914b) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:58.671326 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e3ce0-a294-4ced-8227-2f5e1962613f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:58.672740 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e3ce0-a294-4ced-8227-2f5e1962613f None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:58.680610 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 383/767] 10.222.0.21 () {56 vars in 1374 bytes} [Mon Feb 28 10:18:58 2022] GET /identity/v3/role_assignments?user.id=1c1284bfe6cc43848731ed2b3d9e914b&scope.project.id=5d1d6f8141924b2d99b766f975a3d43b&role.id=060d4a1eef7a45858664a42696ff4a19 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:58.737389 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 385/768] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 10:18:58.784725 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e3ce0-a294-4ced-8227-2f5e1962613f None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:58.912892 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e3ce0-a294-4ced-8227-2f5e1962613f None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:58.946954 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e3367-24c5-4c67-9b53-37aec4ed536e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:58.948014 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e3367-24c5-4c67-9b53-37aec4ed536e None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:58.948294 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e3367-24c5-4c67-9b53-37aec4ed536e None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:58.948567 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e3367-24c5-4c67-9b53-37aec4ed536e None admin] PATH_INFO: `/v3/services/network` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:58.949208 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e3367-24c5-4c67-9b53-37aec4ed536e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:58.951394 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e3367-24c5-4c67-9b53-37aec4ed536e None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:58.962799 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-e18e3367-24c5-4c67-9b53-37aec4ed536e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 28 10:18:58.964315 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 384/769] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:18:58 2022] GET /identity/v3/services/network => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:18:58.970211 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a801e6-011a-4011-806c-f9071824bf2b None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:59.103560 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a801e6-011a-4011-806c-f9071824bf2b None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:59.142053 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa13314-2a22-48de-9eb5-bfb540d7cb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:59.142754 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa13314-2a22-48de-9eb5-bfb540d7cb2c None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:59.143036 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa13314-2a22-48de-9eb5-bfb540d7cb2c None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:59.143304 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa13314-2a22-48de-9eb5-bfb540d7cb2c None admin] PATH_INFO: `/v3/services` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:59.144001 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa13314-2a22-48de-9eb5-bfb540d7cb2c None admin] RBAC: Adding query filter params (name=network) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:59.144300 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa13314-2a22-48de-9eb5-bfb540d7cb2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:59.145788 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa13314-2a22-48de-9eb5-bfb540d7cb2c None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:59.150844 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 386/770] 10.222.0.21 () {56 vars in 1112 bytes} [Mon Feb 28 10:18:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:59.156558 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e3367-24c5-4c67-9b53-37aec4ed536e None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:59.305855 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e3367-24c5-4c67-9b53-37aec4ed536e None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:59.341145 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb54cb-4569-4c67-815a-c58c636120e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:59.341813 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb54cb-4569-4c67-815a-c58c636120e4 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:59.342093 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb54cb-4569-4c67-815a-c58c636120e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:59.342371 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb54cb-4569-4c67-815a-c58c636120e4 None admin] PATH_INFO: `/v3/services` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:59.343130 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fb54cb-4569-4c67-815a-c58c636120e4 None admin] RBAC: Adding query filter params (type=network) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:59.343433 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fb54cb-4569-4c67-815a-c58c636120e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:59.344807 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fb54cb-4569-4c67-815a-c58c636120e4 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:59.351357 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 385/771] 10.222.0.21 () {56 vars in 1112 bytes} [Mon Feb 28 10:18:59 2022] GET /identity/v3/services?type=network => generated 350 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:59.358014 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa13314-2a22-48de-9eb5-bfb540d7cb2c None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:59.474726 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa13314-2a22-48de-9eb5-bfb540d7cb2c None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:59.514707 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab0d9f-ed7b-497b-8d0e-d7826d8f294e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:59.515371 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab0d9f-ed7b-497b-8d0e-d7826d8f294e None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:59.515646 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab0d9f-ed7b-497b-8d0e-d7826d8f294e None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:59.515917 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab0d9f-ed7b-497b-8d0e-d7826d8f294e None admin] PATH_INFO: `/v3/endpoints` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:59.516700 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab0d9f-ed7b-497b-8d0e-d7826d8f294e None admin] RBAC: Adding query filter params (interface=public, service_id=67f90be185f1478fb41413a068103b74, region_id=RegionOne) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:18:59.517004 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab0d9f-ed7b-497b-8d0e-d7826d8f294e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:59.518354 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab0d9f-ed7b-497b-8d0e-d7826d8f294e None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:59.526309 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 387/772] 10.222.0.21 () {56 vars in 1251 bytes} [Mon Feb 28 10:18:59 2022] GET /identity/v3/endpoints?service_id=67f90be185f1478fb41413a068103b74&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:59.532803 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb54cb-4569-4c67-815a-c58c636120e4 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:18:59.669847 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb54cb-4569-4c67-815a-c58c636120e4 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:18:59.704656 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16edd8-ba3a-45c9-8ac8-87a73dfa4ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:18:59.705325 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16edd8-ba3a-45c9-8ac8-87a73dfa4ce8 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:59.705606 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16edd8-ba3a-45c9-8ac8-87a73dfa4ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:59.705878 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16edd8-ba3a-45c9-8ac8-87a73dfa4ce8 None admin] PATH_INFO: `/v3/services` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:59.706557 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb16edd8-ba3a-45c9-8ac8-87a73dfa4ce8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:18:59.708052 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb16edd8-ba3a-45c9-8ac8-87a73dfa4ce8 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:18:59.713594 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 386/773] 10.222.0.21 () {56 vars in 1087 bytes} [Mon Feb 28 10:18:59 2022] GET /identity/v3/services => generated 772 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:18:59.777554 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b09baa-57e0-4829-a97f-8b3a534485f9 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:59.778586 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b09baa-57e0-4829-a97f-8b3a534485f9 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:59.778895 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b09baa-57e0-4829-a97f-8b3a534485f9 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:59.781093 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 388/774] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:18:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:18:59.787106 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c0f90-5f9e-47ee-8efc-78d8fad3aa3f None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:18:59.787425 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c0f90-5f9e-47ee-8efc-78d8fad3aa3f None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:18:59.787666 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c0f90-5f9e-47ee-8efc-78d8fad3aa3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:18:59.807416 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-963c0f90-5f9e-47ee-8efc-78d8fad3aa3f None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:18:59.808719 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-963c0f90-5f9e-47ee-8efc-78d8fad3aa3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:18:59.885309 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 387/775] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:18:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:18:59.922036 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b09baa-57e0-4829-a97f-8b3a534485f9 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:00.040255 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b09baa-57e0-4829-a97f-8b3a534485f9 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:00.075230 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83a941-8779-4573-8a4a-c927e4684899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:00.076223 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83a941-8779-4573-8a4a-c927e4684899 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:00.076512 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83a941-8779-4573-8a4a-c927e4684899 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:00.076787 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83a941-8779-4573-8a4a-c927e4684899 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:00.077437 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a83a941-8779-4573-8a4a-c927e4684899 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:00.078890 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a83a941-8779-4573-8a4a-c927e4684899 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:00.092698 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-2a83a941-8779-4573-8a4a-c927e4684899 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 28 10:19:00.094186 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 389/776] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 10:18:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:00.099819 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c0f90-5f9e-47ee-8efc-78d8fad3aa3f None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:00.200172 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c0f90-5f9e-47ee-8efc-78d8fad3aa3f None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:00.234917 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4497aab-8313-4df8-bc14-5593ffbdf101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:00.235581 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4497aab-8313-4df8-bc14-5593ffbdf101 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:00.235858 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4497aab-8313-4df8-bc14-5593ffbdf101 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:00.236130 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4497aab-8313-4df8-bc14-5593ffbdf101 None admin] PATH_INFO: `/v3/services` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:00.236828 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4497aab-8313-4df8-bc14-5593ffbdf101 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:00.237130 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4497aab-8313-4df8-bc14-5593ffbdf101 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:00.238855 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4497aab-8313-4df8-bc14-5593ffbdf101 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:00.239997 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76f2fb-3c31-4d9d-be20-5b699cda5a7b None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:00.240446 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76f2fb-3c31-4d9d-be20-5b699cda5a7b None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:00.240726 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76f2fb-3c31-4d9d-be20-5b699cda5a7b None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:00.243458 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 390/777] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:19:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:19:00.244565 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 388/778] 10.222.0.21 () {56 vars in 1124 bytes} [Mon Feb 28 10:19:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:00.249449 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa820ce-915d-4543-a921-ab5f1d8504ea None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:00.249739 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa820ce-915d-4543-a921-ab5f1d8504ea None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:00.250017 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa820ce-915d-4543-a921-ab5f1d8504ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:00.253404 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4497aab-8313-4df8-bc14-5593ffbdf101 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:00.270522 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-dfa820ce-915d-4543-a921-ab5f1d8504ea None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:19:00.272096 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-dfa820ce-915d-4543-a921-ab5f1d8504ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:19:00.349833 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 391/779] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:19:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 10:19:00.376357 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa820ce-915d-4543-a921-ab5f1d8504ea None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:00.450951 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4497aab-8313-4df8-bc14-5593ffbdf101 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:00.484201 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa820ce-915d-4543-a921-ab5f1d8504ea None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:00.518421 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef0ecc-df3e-42f2-be15-bed0ec6b104c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:00.519295 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef0ecc-df3e-42f2-be15-bed0ec6b104c None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:00.519581 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef0ecc-df3e-42f2-be15-bed0ec6b104c None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:00.519961 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef0ecc-df3e-42f2-be15-bed0ec6b104c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:00.528422 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4053aad-6d9a-489c-871b-663d74dcb09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:00.529095 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4053aad-6d9a-489c-871b-663d74dcb09d None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:00.529378 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4053aad-6d9a-489c-871b-663d74dcb09d None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:00.529647 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4053aad-6d9a-489c-871b-663d74dcb09d None admin] PATH_INFO: `/v3/services` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:00.530354 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4053aad-6d9a-489c-871b-663d74dcb09d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:00.530683 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4053aad-6d9a-489c-871b-663d74dcb09d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:00.530776 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaef0ecc-df3e-42f2-be15-bed0ec6b104c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:19:00.532051 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4053aad-6d9a-489c-871b-663d74dcb09d None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:00.537663 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-eaef0ecc-df3e-42f2-be15-bed0ec6b104c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:19:00.539205 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 392/780] 10.222.0.21 () {56 vars in 1096 bytes} [Mon Feb 28 10:19:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:19:00.545633 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef0ecc-df3e-42f2-be15-bed0ec6b104c None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:00.546742 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 389/781] 10.222.0.21 () {56 vars in 1124 bytes} [Mon Feb 28 10:19:00 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:19:00.552068 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4053aad-6d9a-489c-871b-663d74dcb09d None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:00.653874 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef0ecc-df3e-42f2-be15-bed0ec6b104c None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:00.677147 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4053aad-6d9a-489c-871b-663d74dcb09d None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:00.689160 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ddf93-638f-4d71-9519-485c5802d9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:00.689835 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ddf93-638f-4d71-9519-485c5802d9a0 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:00.690114 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ddf93-638f-4d71-9519-485c5802d9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:00.690391 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ddf93-638f-4d71-9519-485c5802d9a0 None admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:00.691161 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ddf93-638f-4d71-9519-485c5802d9a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:00.691467 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ddf93-638f-4d71-9519-485c5802d9a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:00.692843 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ddf93-638f-4d71-9519-485c5802d9a0 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:00.701812 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 393/782] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:19:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:00.707271 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ddf93-638f-4d71-9519-485c5802d9a0 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:00.711422 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad45c7-fe13-4447-be44-2b4e95507348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:00.712084 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad45c7-fe13-4447-be44-2b4e95507348 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:00.712367 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad45c7-fe13-4447-be44-2b4e95507348 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:00.712642 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad45c7-fe13-4447-be44-2b4e95507348 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:00.713427 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad45c7-fe13-4447-be44-2b4e95507348 None admin] RBAC: Adding query filter params (interface=public, service_id=934b210c2d85489eb32876c55d74f73d, region_id=RegionOne) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:00.713735 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad45c7-fe13-4447-be44-2b4e95507348 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:00.715814 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad45c7-fe13-4447-be44-2b4e95507348 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:00.723656 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 390/783] 10.222.0.21 () {56 vars in 1251 bytes} [Mon Feb 28 10:19:00 2022] GET /identity/v3/endpoints?service_id=934b210c2d85489eb32876c55d74f73d&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:19:00.732024 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad45c7-fe13-4447-be44-2b4e95507348 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:00.810498 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ddf93-638f-4d71-9519-485c5802d9a0 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:00.845373 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959872cf-3246-4696-a744-cf22e1e77122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:00.845792 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959872cf-3246-4696-a744-cf22e1e77122 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:00.849358 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959872cf-3246-4696-a744-cf22e1e77122 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:00.849358 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959872cf-3246-4696-a744-cf22e1e77122 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:00.858538 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959872cf-3246-4696-a744-cf22e1e77122 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:00.860007 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959872cf-3246-4696-a744-cf22e1e77122 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:00.866080 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad45c7-fe13-4447-be44-2b4e95507348 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:00.877092 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-959872cf-3246-4696-a744-cf22e1e77122 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:19:00.878867 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 394/784] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:19:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:00.886661 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959872cf-3246-4696-a744-cf22e1e77122 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:00.915651 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ccd886-20de-41e8-84a4-f36aab33690a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:00.916572 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccd886-20de-41e8-84a4-f36aab33690a None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:00.916991 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccd886-20de-41e8-84a4-f36aab33690a None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:00.917400 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccd886-20de-41e8-84a4-f36aab33690a None admin] PATH_INFO: `/v3/services` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:00.919390 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ccd886-20de-41e8-84a4-f36aab33690a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:00.921645 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ccd886-20de-41e8-84a4-f36aab33690a None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:00.932265 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 391/785] 10.222.0.21 () {56 vars in 1087 bytes} [Mon Feb 28 10:19:00 2022] GET /identity/v3/services => generated 772 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:01.052047 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959872cf-3246-4696-a744-cf22e1e77122 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:01.103808 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52900cf3-92cd-45eb-b6fe-e5062debe43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:01.104768 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52900cf3-92cd-45eb-b6fe-e5062debe43f None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:01.105193 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52900cf3-92cd-45eb-b6fe-e5062debe43f None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:01.106178 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52900cf3-92cd-45eb-b6fe-e5062debe43f None admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:01.107786 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52900cf3-92cd-45eb-b6fe-e5062debe43f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:01.108241 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52900cf3-92cd-45eb-b6fe-e5062debe43f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:01.109776 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52900cf3-92cd-45eb-b6fe-e5062debe43f None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:01.124359 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 395/786] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:19:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:01.129462 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ccd886-20de-41e8-84a4-f36aab33690a None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:01.238253 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ccd886-20de-41e8-84a4-f36aab33690a None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:01.281037 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a3a65-af04-438f-b1ff-a8d36685ce6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:01.281855 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a3a65-af04-438f-b1ff-a8d36685ce6e None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:01.282136 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a3a65-af04-438f-b1ff-a8d36685ce6e None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:01.282406 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a3a65-af04-438f-b1ff-a8d36685ce6e None admin] PATH_INFO: `/v3/users/swift` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:01.290930 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a3a65-af04-438f-b1ff-a8d36685ce6e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:01.292384 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a3a65-af04-438f-b1ff-a8d36685ce6e None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:01.312764 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-ff5a3a65-af04-438f-b1ff-a8d36685ce6e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 28 10:19:01.313911 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 392/787] 10.222.0.21 () {56 vars in 1096 bytes} [Mon Feb 28 10:19:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:19:01.319558 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52900cf3-92cd-45eb-b6fe-e5062debe43f None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:01.348827 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c8bd1-8692-4898-a414-3f243c266e91 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:01.349132 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c8bd1-8692-4898-a414-3f243c266e91 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:01.349451 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c8bd1-8692-4898-a414-3f243c266e91 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:01.352473 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 393/788] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:19:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:19:01.357189 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae044e4f-38e7-4986-8303-1b8a0f866434 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:01.357471 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae044e4f-38e7-4986-8303-1b8a0f866434 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:01.357743 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae044e4f-38e7-4986-8303-1b8a0f866434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:01.376393 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-ae044e4f-38e7-4986-8303-1b8a0f866434 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:19:01.377588 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-ae044e4f-38e7-4986-8303-1b8a0f866434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:19:01.450286 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52900cf3-92cd-45eb-b6fe-e5062debe43f None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:01.513913 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee8259-ca9e-4af3-a160-3ae7bb72d772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:01.515426 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee8259-ca9e-4af3-a160-3ae7bb72d772 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:01.515932 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee8259-ca9e-4af3-a160-3ae7bb72d772 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:01.516402 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee8259-ca9e-4af3-a160-3ae7bb72d772 None admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:01.517426 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ee8259-ca9e-4af3-a160-3ae7bb72d772 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:01.517943 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ee8259-ca9e-4af3-a160-3ae7bb72d772 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:01.519611 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ee8259-ca9e-4af3-a160-3ae7bb72d772 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:01.538712 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 394/789] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:19:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 10:19:01.552690 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 396/790] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Feb 28 10:19:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:01.557773 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae044e4f-38e7-4986-8303-1b8a0f866434 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:01.597407 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee8259-ca9e-4af3-a160-3ae7bb72d772 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:01.724676 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee8259-ca9e-4af3-a160-3ae7bb72d772 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:01.736052 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae044e4f-38e7-4986-8303-1b8a0f866434 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:01.780928 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852e191-40d6-493b-b843-89f4897560f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:01.782083 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852e191-40d6-493b-b843-89f4897560f4 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:01.782584 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852e191-40d6-493b-b843-89f4897560f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:01.783074 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852e191-40d6-493b-b843-89f4897560f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:01.800386 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852e191-40d6-493b-b843-89f4897560f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:19:01.802079 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139ba77-997e-4f9b-8493-8ea1453e15ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:01.803139 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139ba77-997e-4f9b-8493-8ea1453e15ac None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:01.803618 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139ba77-997e-4f9b-8493-8ea1453e15ac None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:01.805019 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139ba77-997e-4f9b-8493-8ea1453e15ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:01.818900 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-4852e191-40d6-493b-b843-89f4897560f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:19:01.822095 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 397/791] 10.222.0.21 () {56 vars in 1096 bytes} [Mon Feb 28 10:19:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:19:01.825508 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e139ba77-997e-4f9b-8493-8ea1453e15ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:01.827257 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e139ba77-997e-4f9b-8493-8ea1453e15ac None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:01.828712 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852e191-40d6-493b-b843-89f4897560f4 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:01.859200 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-e139ba77-997e-4f9b-8493-8ea1453e15ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:19:01.861510 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 395/792] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:19:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:01.871888 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139ba77-997e-4f9b-8493-8ea1453e15ac None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:01.963113 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852e191-40d6-493b-b843-89f4897560f4 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:02.021897 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f39c63a-51a8-43f7-bd65-69436266e95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:02.022569 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39c63a-51a8-43f7-bd65-69436266e95a None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:02.022881 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39c63a-51a8-43f7-bd65-69436266e95a None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:02.023158 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39c63a-51a8-43f7-bd65-69436266e95a None admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:02.023902 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f39c63a-51a8-43f7-bd65-69436266e95a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:02.024206 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f39c63a-51a8-43f7-bd65-69436266e95a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:02.025579 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f39c63a-51a8-43f7-bd65-69436266e95a None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:02.034681 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 398/793] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:19:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:19:02.035999 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107abac9-b11b-418c-b680-b0d0e7f2348d None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:02.036287 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107abac9-b11b-418c-b680-b0d0e7f2348d None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:02.036563 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107abac9-b11b-418c-b680-b0d0e7f2348d None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:02.038533 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 399/794] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:19:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:19:02.041154 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107abac9-b11b-418c-b680-b0d0e7f2348d None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:02.052962 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139ba77-997e-4f9b-8493-8ea1453e15ac None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:02.096628 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbcbebf-9a83-4f85-a950-ca3d81dd9c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:02.097303 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcbebf-9a83-4f85-a950-ca3d81dd9c60 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:02.097631 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcbebf-9a83-4f85-a950-ca3d81dd9c60 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:02.097901 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcbebf-9a83-4f85-a950-ca3d81dd9c60 None admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:02.098680 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbcbebf-9a83-4f85-a950-ca3d81dd9c60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:02.098983 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbcbebf-9a83-4f85-a950-ca3d81dd9c60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:02.100338 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbcbebf-9a83-4f85-a950-ca3d81dd9c60 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:02.112544 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 396/795] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:19:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:02.113787 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ba924-6b23-41e6-a150-be1156c3da2e None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:02.114069 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ba924-6b23-41e6-a150-be1156c3da2e None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:02.114380 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ba924-6b23-41e6-a150-be1156c3da2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:02.133162 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-0c7ba924-6b23-41e6-a150-be1156c3da2e None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:19:02.134385 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-0c7ba924-6b23-41e6-a150-be1156c3da2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:19:02.158942 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107abac9-b11b-418c-b680-b0d0e7f2348d None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:02.198896 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997f3ed-0371-491c-aabe-2f7a3cac5b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:02.199774 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997f3ed-0371-491c-aabe-2f7a3cac5b50 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:02.200064 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997f3ed-0371-491c-aabe-2f7a3cac5b50 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:02.200396 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997f3ed-0371-491c-aabe-2f7a3cac5b50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:02.213266 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 397/796] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:19:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:19:02.213783 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7997f3ed-0371-491c-aabe-2f7a3cac5b50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:02.214668 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ba924-6b23-41e6-a150-be1156c3da2e None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:02.216015 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7997f3ed-0371-491c-aabe-2f7a3cac5b50 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:02.236868 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-7997f3ed-0371-491c-aabe-2f7a3cac5b50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:19:02.242670 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 400/797] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:19:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:02.244498 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997f3ed-0371-491c-aabe-2f7a3cac5b50 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:02.338482 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ba924-6b23-41e6-a150-be1156c3da2e None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:02.368861 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997f3ed-0371-491c-aabe-2f7a3cac5b50 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:02.374557 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497a0b2-cfbb-4426-93a8-5e8e75184511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:02.375771 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497a0b2-cfbb-4426-93a8-5e8e75184511 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:02.376261 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497a0b2-cfbb-4426-93a8-5e8e75184511 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:02.376734 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497a0b2-cfbb-4426-93a8-5e8e75184511 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:02.383915 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497a0b2-cfbb-4426-93a8-5e8e75184511 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:02.385612 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497a0b2-cfbb-4426-93a8-5e8e75184511 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:02.399477 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-e497a0b2-cfbb-4426-93a8-5e8e75184511 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:19:02.401441 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 398/798] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:19:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:02.403084 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497a0b2-cfbb-4426-93a8-5e8e75184511 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:02.404904 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba10d53-3929-4ef5-8d64-41e1dbf91f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:02.405757 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba10d53-3929-4ef5-8d64-41e1dbf91f46 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:02.406181 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba10d53-3929-4ef5-8d64-41e1dbf91f46 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:02.406632 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba10d53-3929-4ef5-8d64-41e1dbf91f46 None admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:02.407483 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba10d53-3929-4ef5-8d64-41e1dbf91f46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:02.408012 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba10d53-3929-4ef5-8d64-41e1dbf91f46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:02.409607 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba10d53-3929-4ef5-8d64-41e1dbf91f46 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:02.422966 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 401/799] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:19:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:02.424007 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba10d53-3929-4ef5-8d64-41e1dbf91f46 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:02.525224 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497a0b2-cfbb-4426-93a8-5e8e75184511 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:02.550141 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba10d53-3929-4ef5-8d64-41e1dbf91f46 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:02.567982 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df221f49-0d9b-4a59-97bd-b4baaa8a6f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:02.569386 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df221f49-0d9b-4a59-97bd-b4baaa8a6f04 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:02.569983 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df221f49-0d9b-4a59-97bd-b4baaa8a6f04 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:02.570396 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df221f49-0d9b-4a59-97bd-b4baaa8a6f04 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:02.584974 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df221f49-0d9b-4a59-97bd-b4baaa8a6f04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:19:02.592056 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-df221f49-0d9b-4a59-97bd-b4baaa8a6f04 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 10:19:02.593227 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0adfb47-d864-474f-bd3b-2f34230e742f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:02.594032 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0adfb47-d864-474f-bd3b-2f34230e742f None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:02.594437 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0adfb47-d864-474f-bd3b-2f34230e742f None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:02.595126 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0adfb47-d864-474f-bd3b-2f34230e742f None admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:02.596581 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0adfb47-d864-474f-bd3b-2f34230e742f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:02.597262 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0adfb47-d864-474f-bd3b-2f34230e742f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:02.598305 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 399/800] 10.222.0.21 () {56 vars in 1102 bytes} [Mon Feb 28 10:19:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:02.599272 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df221f49-0d9b-4a59-97bd-b4baaa8a6f04 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:02.599683 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0adfb47-d864-474f-bd3b-2f34230e742f None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:02.615789 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 402/801] 10.222.0.21 () {56 vars in 1148 bytes} [Mon Feb 28 10:19:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:02.617222 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0adfb47-d864-474f-bd3b-2f34230e742f None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:02.708296 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df221f49-0d9b-4a59-97bd-b4baaa8a6f04 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:02.723461 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0adfb47-d864-474f-bd3b-2f34230e742f None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:02.742360 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c26f3b-f7ac-4e09-9728-c0a3160989e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:02.743160 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c26f3b-f7ac-4e09-9728-c0a3160989e7 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:02.743439 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c26f3b-f7ac-4e09-9728-c0a3160989e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:02.743711 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c26f3b-f7ac-4e09-9728-c0a3160989e7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:02.752244 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c26f3b-f7ac-4e09-9728-c0a3160989e7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:02.753814 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c26f3b-f7ac-4e09-9728-c0a3160989e7 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:02.758538 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a62e2-9cae-4b71-ac3c-4387cfc5d6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:02.759405 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a62e2-9cae-4b71-ac3c-4387cfc5d6f0 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:02.759834 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a62e2-9cae-4b71-ac3c-4387cfc5d6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:02.760253 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a62e2-9cae-4b71-ac3c-4387cfc5d6f0 None admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:02.761164 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a62e2-9cae-4b71-ac3c-4387cfc5d6f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:02.761613 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a62e2-9cae-4b71-ac3c-4387cfc5d6f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:02.763360 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a62e2-9cae-4b71-ac3c-4387cfc5d6f0 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:02.766982 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-46c26f3b-f7ac-4e09-9728-c0a3160989e7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 10:19:02.768183 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 400/802] 10.222.0.21 () {56 vars in 1093 bytes} [Mon Feb 28 10:19:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:02.768924 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c26f3b-f7ac-4e09-9728-c0a3160989e7 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:02.776284 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 403/803] 10.222.0.21 () {56 vars in 1103 bytes} [Mon Feb 28 10:19:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:02.778364 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a40a58-b1f1-45a7-818a-2777bac7ef43 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:02.778834 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a40a58-b1f1-45a7-818a-2777bac7ef43 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:02.779245 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a40a58-b1f1-45a7-818a-2777bac7ef43 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:02.781841 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 404/804] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:19:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:19:02.783088 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a40a58-b1f1-45a7-818a-2777bac7ef43 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:02.869597 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c26f3b-f7ac-4e09-9728-c0a3160989e7 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:02.899143 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a40a58-b1f1-45a7-818a-2777bac7ef43 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:02.903421 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd169464-b954-49c4-bb0f-8350fafdd311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:02.904305 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd169464-b954-49c4-bb0f-8350fafdd311 None admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:02.904586 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd169464-b954-49c4-bb0f-8350fafdd311 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:02.904861 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd169464-b954-49c4-bb0f-8350fafdd311 None admin] PATH_INFO: `/v3/projects/5d1d6f8141924b2d99b766f975a3d43b/users/8696fe8a37aa4d73a62bdc2efd35a23d/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:02.906873 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd169464-b954-49c4-bb0f-8350fafdd311 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d1d6f8141924b2d99b766f975a3d43b, user_id=8696fe8a37aa4d73a62bdc2efd35a23d, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:02.908316 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd169464-b954-49c4-bb0f-8350fafdd311 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:02.921312 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 401/805] 10.222.0.21 () {58 vars in 1439 bytes} [Mon Feb 28 10:19:02 2022] PUT /identity/v3/projects/5d1d6f8141924b2d99b766f975a3d43b/users/8696fe8a37aa4d73a62bdc2efd35a23d/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:19:02.922232 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd169464-b954-49c4-bb0f-8350fafdd311 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:02.945641 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73287f-e5fd-4761-9169-a46fbae4eab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:02.947233 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73287f-e5fd-4761-9169-a46fbae4eab5 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:02.948015 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73287f-e5fd-4761-9169-a46fbae4eab5 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:02.948478 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73287f-e5fd-4761-9169-a46fbae4eab5 None admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:02.949696 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d73287f-e5fd-4761-9169-a46fbae4eab5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:02.950210 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d73287f-e5fd-4761-9169-a46fbae4eab5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:02.952967 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d73287f-e5fd-4761-9169-a46fbae4eab5 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:02.978340 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 405/806] 10.222.0.21 () {56 vars in 1133 bytes} [Mon Feb 28 10:19:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:02.980035 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd609185-a7b0-46af-8617-70dca32b5234 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:02.980574 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd609185-a7b0-46af-8617-70dca32b5234 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:02.981680 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd609185-a7b0-46af-8617-70dca32b5234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:03.004966 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-cd609185-a7b0-46af-8617-70dca32b5234 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:19:03.007113 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-cd609185-a7b0-46af-8617-70dca32b5234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:19:03.045444 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd169464-b954-49c4-bb0f-8350fafdd311 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:03.084609 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f8d9f0-c6f7-4dc9-9739-05d3aadaa97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:03.085478 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8d9f0-c6f7-4dc9-9739-05d3aadaa97f None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:03.085737 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8d9f0-c6f7-4dc9-9739-05d3aadaa97f None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:03.086011 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8d9f0-c6f7-4dc9-9739-05d3aadaa97f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:03.098157 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f8d9f0-c6f7-4dc9-9739-05d3aadaa97f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:03.099998 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 406/807] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:19:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:19:03.101155 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd609185-a7b0-46af-8617-70dca32b5234 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:03.106872 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f8d9f0-c6f7-4dc9-9739-05d3aadaa97f None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:03.136799 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-47f8d9f0-c6f7-4dc9-9739-05d3aadaa97f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:19:03.138860 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 402/808] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:19:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:03.139679 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f8d9f0-c6f7-4dc9-9739-05d3aadaa97f None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:03.222408 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd609185-a7b0-46af-8617-70dca32b5234 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:03.257489 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80831b75-067b-4f19-a7c8-aaec23178f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:03.258493 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80831b75-067b-4f19-a7c8-aaec23178f20 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:03.259063 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80831b75-067b-4f19-a7c8-aaec23178f20 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:03.259536 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80831b75-067b-4f19-a7c8-aaec23178f20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:03.273203 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f8d9f0-c6f7-4dc9-9739-05d3aadaa97f None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:03.314822 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dca276-59d0-4126-89bb-1bc19600e611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:03.315615 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dca276-59d0-4126-89bb-1bc19600e611 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:03.315890 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dca276-59d0-4126-89bb-1bc19600e611 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:03.316163 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dca276-59d0-4126-89bb-1bc19600e611 None admin] PATH_INFO: `/v3/services/network` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:03.316967 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dca276-59d0-4126-89bb-1bc19600e611 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:03.318930 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dca276-59d0-4126-89bb-1bc19600e611 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:03.330585 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80831b75-067b-4f19-a7c8-aaec23178f20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:03.332384 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80831b75-067b-4f19-a7c8-aaec23178f20 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:03.332824 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-88dca276-59d0-4126-89bb-1bc19600e611 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 28 10:19:03.334680 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 403/809] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:19:03 2022] GET /identity/v3/services/network => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:03.335769 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dca276-59d0-4126-89bb-1bc19600e611 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:03.436488 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 407/810] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:19:03 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 10:19:03.437674 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80831b75-067b-4f19-a7c8-aaec23178f20 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:03.466650 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dca276-59d0-4126-89bb-1bc19600e611 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:03.506115 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad606d-d4e5-4c72-941b-3611ddf7d0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:03.506809 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad606d-d4e5-4c72-941b-3611ddf7d0a8 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:03.507101 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad606d-d4e5-4c72-941b-3611ddf7d0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:03.507568 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad606d-d4e5-4c72-941b-3611ddf7d0a8 None admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:03.508223 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ad606d-d4e5-4c72-941b-3611ddf7d0a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:03.508524 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ad606d-d4e5-4c72-941b-3611ddf7d0a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:03.509892 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ad606d-d4e5-4c72-941b-3611ddf7d0a8 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:03.526749 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 404/811] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:19:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:03.528306 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad606d-d4e5-4c72-941b-3611ddf7d0a8 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:03.541340 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80831b75-067b-4f19-a7c8-aaec23178f20 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:03.575745 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c31fb3-d114-4fed-b4da-de5457ce89ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:03.576496 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c31fb3-d114-4fed-b4da-de5457ce89ea None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:03.576781 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c31fb3-d114-4fed-b4da-de5457ce89ea None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:03.577055 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c31fb3-d114-4fed-b4da-de5457ce89ea None admin] PATH_INFO: `/v3/services` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:03.577751 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c31fb3-d114-4fed-b4da-de5457ce89ea None admin] RBAC: Adding query filter params (name=network) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:03.578054 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c31fb3-d114-4fed-b4da-de5457ce89ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:03.579447 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c31fb3-d114-4fed-b4da-de5457ce89ea None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:03.583729 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 408/812] 10.222.0.21 () {56 vars in 1112 bytes} [Mon Feb 28 10:19:03 2022] GET /identity/v3/services?name=network => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:03.584491 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c31fb3-d114-4fed-b4da-de5457ce89ea None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:03.630518 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad606d-d4e5-4c72-941b-3611ddf7d0a8 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:03.664640 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975862bd-8e26-4136-996c-89d9d2108fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:03.665427 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975862bd-8e26-4136-996c-89d9d2108fd1 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:03.665708 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975862bd-8e26-4136-996c-89d9d2108fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:03.665986 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975862bd-8e26-4136-996c-89d9d2108fd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:03.675885 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975862bd-8e26-4136-996c-89d9d2108fd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:03.677396 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975862bd-8e26-4136-996c-89d9d2108fd1 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:03.680403 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c31fb3-d114-4fed-b4da-de5457ce89ea None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:03.693998 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-975862bd-8e26-4136-996c-89d9d2108fd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:19:03.695439 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 405/813] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:19:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:03.696791 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadeb0f6-3b45-4330-bd00-e83f2279b8c0 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:03.696791 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadeb0f6-3b45-4330-bd00-e83f2279b8c0 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:03.697059 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadeb0f6-3b45-4330-bd00-e83f2279b8c0 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:03.702991 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 406/814] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:19:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:19:03.703941 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadeb0f6-3b45-4330-bd00-e83f2279b8c0 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:03.718858 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e24756-d97a-4c68-8662-ed2fa7b54a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:03.719680 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e24756-d97a-4c68-8662-ed2fa7b54a5f None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:03.719956 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e24756-d97a-4c68-8662-ed2fa7b54a5f None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:03.720221 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e24756-d97a-4c68-8662-ed2fa7b54a5f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:03.727149 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e24756-d97a-4c68-8662-ed2fa7b54a5f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:03.728568 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e24756-d97a-4c68-8662-ed2fa7b54a5f None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:03.742622 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-c1e24756-d97a-4c68-8662-ed2fa7b54a5f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 28 10:19:03.748883 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 409/815] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Feb 28 10:19:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:03.749640 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e24756-d97a-4c68-8662-ed2fa7b54a5f None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:03.810195 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadeb0f6-3b45-4330-bd00-e83f2279b8c0 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:03.858984 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ee786-45ac-47af-b5ee-3419e593c398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:03.859984 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ee786-45ac-47af-b5ee-3419e593c398 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:03.860488 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ee786-45ac-47af-b5ee-3419e593c398 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:03.860986 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ee786-45ac-47af-b5ee-3419e593c398 None admin] PATH_INFO: `/v3/services` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:03.861984 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9ee786-45ac-47af-b5ee-3419e593c398 None admin] RBAC: Adding query filter params (type=network) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:03.862737 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9ee786-45ac-47af-b5ee-3419e593c398 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:03.864478 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9ee786-45ac-47af-b5ee-3419e593c398 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:03.870116 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 407/816] 10.222.0.21 () {56 vars in 1112 bytes} [Mon Feb 28 10:19:03 2022] GET /identity/v3/services?type=network => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:03.872510 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c7d78-826d-4912-a5f2-817f5ba5ba5a None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:03.873005 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c7d78-826d-4912-a5f2-817f5ba5ba5a None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:03.873518 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c7d78-826d-4912-a5f2-817f5ba5ba5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:03.891859 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-4f6c7d78-826d-4912-a5f2-817f5ba5ba5a None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:19:03.894495 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-4f6c7d78-826d-4912-a5f2-817f5ba5ba5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:19:03.901272 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e24756-d97a-4c68-8662-ed2fa7b54a5f None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:03.948293 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7bba4-4487-47ec-94a6-f9d1976714db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:03.948948 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7bba4-4487-47ec-94a6-f9d1976714db None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:03.949292 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7bba4-4487-47ec-94a6-f9d1976714db None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:03.949704 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7bba4-4487-47ec-94a6-f9d1976714db None admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:03.950540 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c7bba4-4487-47ec-94a6-f9d1976714db None admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:03.950870 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c7bba4-4487-47ec-94a6-f9d1976714db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:03.952287 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c7bba4-4487-47ec-94a6-f9d1976714db None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:03.965595 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 410/817] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:19:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:03.966458 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7bba4-4487-47ec-94a6-f9d1976714db None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:03.980277 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 408/818] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:19:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:19:03.981620 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c7d78-826d-4912-a5f2-817f5ba5ba5a None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:04.084287 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7bba4-4487-47ec-94a6-f9d1976714db None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:04.094749 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c7d78-826d-4912-a5f2-817f5ba5ba5a None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:04.134178 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee409c4-2556-4dd4-91d5-b280547b0880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:04.134859 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee409c4-2556-4dd4-91d5-b280547b0880 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:04.135129 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee409c4-2556-4dd4-91d5-b280547b0880 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:04.135391 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee409c4-2556-4dd4-91d5-b280547b0880 None admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:04.136234 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee409c4-2556-4dd4-91d5-b280547b0880 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:04.136494 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee409c4-2556-4dd4-91d5-b280547b0880 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:04.138464 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee409c4-2556-4dd4-91d5-b280547b0880 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:04.139601 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744dd472-521a-4540-89b5-6929afecf70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:04.140986 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744dd472-521a-4540-89b5-6929afecf70d None admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:04.141748 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744dd472-521a-4540-89b5-6929afecf70d None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:04.142234 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744dd472-521a-4540-89b5-6929afecf70d None admin] PATH_INFO: `/v3/endpoints` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:04.143208 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744dd472-521a-4540-89b5-6929afecf70d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:04.146370 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744dd472-521a-4540-89b5-6929afecf70d None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:04.160991 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 411/819] 10.222.0.21 () {56 vars in 1149 bytes} [Mon Feb 28 10:19:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:04.161835 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee409c4-2556-4dd4-91d5-b280547b0880 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:04.177770 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 409/820] 10.222.0.21 () {60 vars in 1144 bytes} [Mon Feb 28 10:19:03 2022] POST /identity/v3/endpoints => generated 327 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:19:04.178786 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744dd472-521a-4540-89b5-6929afecf70d None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:04.293896 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee409c4-2556-4dd4-91d5-b280547b0880 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:04.327601 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744dd472-521a-4540-89b5-6929afecf70d None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:04.340069 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66736c-eb7a-4e59-bc04-b77ce8683746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:04.341590 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66736c-eb7a-4e59-bc04-b77ce8683746 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:04.342023 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66736c-eb7a-4e59-bc04-b77ce8683746 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:04.342438 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66736c-eb7a-4e59-bc04-b77ce8683746 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:04.352204 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee66736c-eb7a-4e59-bc04-b77ce8683746 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:04.354719 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee66736c-eb7a-4e59-bc04-b77ce8683746 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:04.367453 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffc4ac-0ff8-4546-af5e-b62c6ca46d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:04.368445 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffc4ac-0ff8-4546-af5e-b62c6ca46d1c None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:04.368730 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffc4ac-0ff8-4546-af5e-b62c6ca46d1c None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:04.369002 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffc4ac-0ff8-4546-af5e-b62c6ca46d1c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:04.369657 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ffc4ac-0ff8-4546-af5e-b62c6ca46d1c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:04.371074 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ffc4ac-0ff8-4546-af5e-b62c6ca46d1c None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:04.373155 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-ee66736c-eb7a-4e59-bc04-b77ce8683746 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:19:04.375528 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 412/821] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:19:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:04.376723 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66736c-eb7a-4e59-bc04-b77ce8683746 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:04.384294 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-f1ffc4ac-0ff8-4546-af5e-b62c6ca46d1c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 28 10:19:04.385500 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 410/822] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Feb 28 10:19:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:04.386257 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffc4ac-0ff8-4546-af5e-b62c6ca46d1c None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:04.495210 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66736c-eb7a-4e59-bc04-b77ce8683746 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:04.500802 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffc4ac-0ff8-4546-af5e-b62c6ca46d1c None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:04.528287 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1453d11-4bff-47bb-8d31-0198d73a79c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:04.529090 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1453d11-4bff-47bb-8d31-0198d73a79c7 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:04.529370 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1453d11-4bff-47bb-8d31-0198d73a79c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:04.529644 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1453d11-4bff-47bb-8d31-0198d73a79c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:04.536305 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe17b1-05f2-40c1-a988-415e21a98632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:04.537159 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe17b1-05f2-40c1-a988-415e21a98632 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:04.537580 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe17b1-05f2-40c1-a988-415e21a98632 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:04.537999 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe17b1-05f2-40c1-a988-415e21a98632 None admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:04.538940 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe17b1-05f2-40c1-a988-415e21a98632 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:04.539382 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe17b1-05f2-40c1-a988-415e21a98632 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:04.540541 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1453d11-4bff-47bb-8d31-0198d73a79c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:04.541118 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe17b1-05f2-40c1-a988-415e21a98632 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:04.541965 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1453d11-4bff-47bb-8d31-0198d73a79c7 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:04.558005 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 411/823] 10.222.0.21 () {56 vars in 1148 bytes} [Mon Feb 28 10:19:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:04.559524 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-f1453d11-4bff-47bb-8d31-0198d73a79c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:19:04.559900 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe17b1-05f2-40c1-a988-415e21a98632 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:04.560741 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 413/824] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:19:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:04.561502 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1453d11-4bff-47bb-8d31-0198d73a79c7 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:04.664528 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe17b1-05f2-40c1-a988-415e21a98632 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:04.668044 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1453d11-4bff-47bb-8d31-0198d73a79c7 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:04.698211 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca4251-eb96-4d46-8bc7-099931202525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:04.698906 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca4251-eb96-4d46-8bc7-099931202525 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:04.699188 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca4251-eb96-4d46-8bc7-099931202525 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:04.700025 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca4251-eb96-4d46-8bc7-099931202525 None admin] PATH_INFO: `/v3/services` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:04.700804 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca4251-eb96-4d46-8bc7-099931202525 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:04.701104 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca4251-eb96-4d46-8bc7-099931202525 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:04.702160 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268ac7f-b1a8-4415-8cbc-56abf5a7f377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:04.702476 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca4251-eb96-4d46-8bc7-099931202525 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:04.702879 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268ac7f-b1a8-4415-8cbc-56abf5a7f377 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:04.703160 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268ac7f-b1a8-4415-8cbc-56abf5a7f377 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:04.703460 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268ac7f-b1a8-4415-8cbc-56abf5a7f377 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:04.704297 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1268ac7f-b1a8-4415-8cbc-56abf5a7f377 None admin] RBAC: Adding query filter params (role.id=48e4608a7b3f4b87a20b10c4d1b45aa9, scope.project.id=5d1d6f8141924b2d99b766f975a3d43b, user.id=ec202a34db8e47f4a6c18285245e3f5b) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:04.704607 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1268ac7f-b1a8-4415-8cbc-56abf5a7f377 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:04.706027 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1268ac7f-b1a8-4415-8cbc-56abf5a7f377 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:04.711370 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 412/825] 10.222.0.21 () {56 vars in 1124 bytes} [Mon Feb 28 10:19:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:04.711370 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca4251-eb96-4d46-8bc7-099931202525 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:04.722678 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 414/826] 10.222.0.21 () {56 vars in 1374 bytes} [Mon Feb 28 10:19:04 2022] GET /identity/v3/role_assignments?user.id=ec202a34db8e47f4a6c18285245e3f5b&scope.project.id=5d1d6f8141924b2d99b766f975a3d43b&role.id=48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:04.722678 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268ac7f-b1a8-4415-8cbc-56abf5a7f377 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:04.823859 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca4251-eb96-4d46-8bc7-099931202525 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:04.867989 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268ac7f-b1a8-4415-8cbc-56abf5a7f377 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:04.869113 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def00742-33e6-43cd-aa53-da8014db200a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:04.869821 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def00742-33e6-43cd-aa53-da8014db200a None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:04.870110 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def00742-33e6-43cd-aa53-da8014db200a None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:04.870392 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def00742-33e6-43cd-aa53-da8014db200a None admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:04.871207 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def00742-33e6-43cd-aa53-da8014db200a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:04.871566 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def00742-33e6-43cd-aa53-da8014db200a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:04.873113 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def00742-33e6-43cd-aa53-da8014db200a None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:04.890394 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 413/827] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:04.891622 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def00742-33e6-43cd-aa53-da8014db200a None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:04.916887 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa027f-46be-45b7-bffd-8d9fb811ece0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:04.917491 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa027f-46be-45b7-bffd-8d9fb811ece0 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:04.917772 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa027f-46be-45b7-bffd-8d9fb811ece0 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:04.918575 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa027f-46be-45b7-bffd-8d9fb811ece0 None admin] PATH_INFO: `/v3/services` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:04.919312 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baa027f-46be-45b7-bffd-8d9fb811ece0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:04.919643 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baa027f-46be-45b7-bffd-8d9fb811ece0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:04.921055 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baa027f-46be-45b7-bffd-8d9fb811ece0 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:04.928980 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 415/828] 10.222.0.21 () {56 vars in 1124 bytes} [Mon Feb 28 10:19:04 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:04.935561 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa027f-46be-45b7-bffd-8d9fb811ece0 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:05.023284 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def00742-33e6-43cd-aa53-da8014db200a None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:05.052180 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa027f-46be-45b7-bffd-8d9fb811ece0 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:05.058313 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda54ff-c236-42f2-84b6-59372829bf91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:05.059520 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda54ff-c236-42f2-84b6-59372829bf91 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:05.060019 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda54ff-c236-42f2-84b6-59372829bf91 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:05.060515 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda54ff-c236-42f2-84b6-59372829bf91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:05.070042 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bda54ff-c236-42f2-84b6-59372829bf91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:05.072208 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bda54ff-c236-42f2-84b6-59372829bf91 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:05.086089 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8b43b-24ae-4890-8493-d95ea42814b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:05.086802 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8b43b-24ae-4890-8493-d95ea42814b6 None admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:05.087082 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8b43b-24ae-4890-8493-d95ea42814b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:05.087351 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8b43b-24ae-4890-8493-d95ea42814b6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:05.088134 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8b43b-24ae-4890-8493-d95ea42814b6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:05.089541 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8b43b-24ae-4890-8493-d95ea42814b6 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:05.091111 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-3bda54ff-c236-42f2-84b6-59372829bf91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:19:05.092824 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 414/829] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:19:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:05.099630 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda54ff-c236-42f2-84b6-59372829bf91 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:05.115078 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 416/830] 10.222.0.21 () {60 vars in 1144 bytes} [Mon Feb 28 10:19:04 2022] POST /identity/v3/endpoints => generated 346 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:19:05.222387 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda54ff-c236-42f2-84b6-59372829bf91 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:05.267187 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7428b1e-6dd8-4028-ab2d-e7fd834b43af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:05.268288 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7428b1e-6dd8-4028-ab2d-e7fd834b43af None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:05.268819 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7428b1e-6dd8-4028-ab2d-e7fd834b43af None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:05.269294 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7428b1e-6dd8-4028-ab2d-e7fd834b43af None admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:05.270293 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7428b1e-6dd8-4028-ab2d-e7fd834b43af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:05.270838 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7428b1e-6dd8-4028-ab2d-e7fd834b43af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:05.272541 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7428b1e-6dd8-4028-ab2d-e7fd834b43af None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:05.290709 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 415/831] 10.222.0.21 () {56 vars in 1148 bytes} [Mon Feb 28 10:19:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:05.292848 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8b43b-24ae-4890-8493-d95ea42814b6 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:05.319329 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd359f-b50b-4c98-b0b7-c5c4e26412a8 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:05.319931 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd359f-b50b-4c98-b0b7-c5c4e26412a8 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:05.320419 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd359f-b50b-4c98-b0b7-c5c4e26412a8 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:05.322729 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 416/832] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:19:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:19:05.329364 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f05dcb-b40b-411a-aeb7-02606b1c6096 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:05.329649 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f05dcb-b40b-411a-aeb7-02606b1c6096 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:05.329920 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f05dcb-b40b-411a-aeb7-02606b1c6096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:05.348728 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-29f05dcb-b40b-411a-aeb7-02606b1c6096 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:19:05.349919 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-29f05dcb-b40b-411a-aeb7-02606b1c6096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:19:05.413879 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8b43b-24ae-4890-8493-d95ea42814b6 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:05.418783 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 417/833] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:19:05 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 10:19:05.441856 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f05dcb-b40b-411a-aeb7-02606b1c6096 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:05.450482 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f178da7-64f0-4138-8e25-cd4a7e7a8e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:05.451748 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f178da7-64f0-4138-8e25-cd4a7e7a8e92 None admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:05.452227 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f178da7-64f0-4138-8e25-cd4a7e7a8e92 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:05.452691 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f178da7-64f0-4138-8e25-cd4a7e7a8e92 None admin] PATH_INFO: `/v3/projects/5d1d6f8141924b2d99b766f975a3d43b/users/1c1284bfe6cc43848731ed2b3d9e914b/roles/060d4a1eef7a45858664a42696ff4a19` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:05.468314 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f178da7-64f0-4138-8e25-cd4a7e7a8e92 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d1d6f8141924b2d99b766f975a3d43b, user_id=1c1284bfe6cc43848731ed2b3d9e914b, role_id=060d4a1eef7a45858664a42696ff4a19)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:05.470060 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f178da7-64f0-4138-8e25-cd4a7e7a8e92 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:05.484925 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 417/834] 10.222.0.21 () {58 vars in 1439 bytes} [Mon Feb 28 10:19:05 2022] PUT /identity/v3/projects/5d1d6f8141924b2d99b766f975a3d43b/users/1c1284bfe6cc43848731ed2b3d9e914b/roles/060d4a1eef7a45858664a42696ff4a19 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:19:05.549877 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f05dcb-b40b-411a-aeb7-02606b1c6096 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:05.588019 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166d88a-1241-4974-9d46-a09a416d6969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:05.588831 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166d88a-1241-4974-9d46-a09a416d6969 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:05.589112 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166d88a-1241-4974-9d46-a09a416d6969 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:05.589379 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166d88a-1241-4974-9d46-a09a416d6969 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:05.601904 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6166d88a-1241-4974-9d46-a09a416d6969 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:19:05.609620 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-6166d88a-1241-4974-9d46-a09a416d6969 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:19:05.611361 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 418/835] 10.222.0.21 () {56 vars in 1096 bytes} [Mon Feb 28 10:19:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:05.617369 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f178da7-64f0-4138-8e25-cd4a7e7a8e92 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:05.732832 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f178da7-64f0-4138-8e25-cd4a7e7a8e92 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:05.766556 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ecb53-25ea-4c2b-b374-3c12179219ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:05.767180 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ecb53-25ea-4c2b-b374-3c12179219ba None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:05.767459 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ecb53-25ea-4c2b-b374-3c12179219ba None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:05.767727 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ecb53-25ea-4c2b-b374-3c12179219ba None admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:05.768458 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ecb53-25ea-4c2b-b374-3c12179219ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:05.768757 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ecb53-25ea-4c2b-b374-3c12179219ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:05.770132 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ecb53-25ea-4c2b-b374-3c12179219ba None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:05.778590 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 418/836] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:19:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:05.783970 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166d88a-1241-4974-9d46-a09a416d6969 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:05.894102 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166d88a-1241-4974-9d46-a09a416d6969 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:05.928546 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f534a-93f1-4d5c-aa00-fbc1fba5c1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:05.929394 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f534a-93f1-4d5c-aa00-fbc1fba5c1d8 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:05.929766 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f534a-93f1-4d5c-aa00-fbc1fba5c1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:05.930041 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f534a-93f1-4d5c-aa00-fbc1fba5c1d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:05.941006 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f534a-93f1-4d5c-aa00-fbc1fba5c1d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:05.942502 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f534a-93f1-4d5c-aa00-fbc1fba5c1d8 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:05.958942 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-a64f534a-93f1-4d5c-aa00-fbc1fba5c1d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:19:05.960398 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 419/837] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:19:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:05.966664 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ecb53-25ea-4c2b-b374-3c12179219ba None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:06.067934 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ecb53-25ea-4c2b-b374-3c12179219ba None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:06.100432 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfca28-1834-416b-a57c-b7dcd2da2d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:06.101084 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfca28-1834-416b-a57c-b7dcd2da2d6d None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:06.101361 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfca28-1834-416b-a57c-b7dcd2da2d6d None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:06.101631 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfca28-1834-416b-a57c-b7dcd2da2d6d None admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:06.102335 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bfca28-1834-416b-a57c-b7dcd2da2d6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:06.102652 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bfca28-1834-416b-a57c-b7dcd2da2d6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:06.104020 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bfca28-1834-416b-a57c-b7dcd2da2d6d None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:06.120591 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 419/838] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:06.126476 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f534a-93f1-4d5c-aa00-fbc1fba5c1d8 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:06.230122 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f534a-93f1-4d5c-aa00-fbc1fba5c1d8 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:06.264076 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e844e3b5-0bda-43bf-a77d-3605474cd43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:06.265194 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844e3b5-0bda-43bf-a77d-3605474cd43e None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:06.265687 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844e3b5-0bda-43bf-a77d-3605474cd43e None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:06.266165 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844e3b5-0bda-43bf-a77d-3605474cd43e None admin] PATH_INFO: `/v3/users/swift` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:06.274057 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e844e3b5-0bda-43bf-a77d-3605474cd43e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:06.275776 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e844e3b5-0bda-43bf-a77d-3605474cd43e None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:06.289862 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-e844e3b5-0bda-43bf-a77d-3605474cd43e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 28 10:19:06.291662 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 420/839] 10.222.0.21 () {56 vars in 1096 bytes} [Mon Feb 28 10:19:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:06.298032 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfca28-1834-416b-a57c-b7dcd2da2d6d None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:06.403950 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfca28-1834-416b-a57c-b7dcd2da2d6d None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:06.438177 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8011932-e829-41dc-855a-8a1eff875007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:06.438862 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8011932-e829-41dc-855a-8a1eff875007 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:06.439137 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8011932-e829-41dc-855a-8a1eff875007 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:06.439405 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8011932-e829-41dc-855a-8a1eff875007 None admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:06.440218 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8011932-e829-41dc-855a-8a1eff875007 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:06.440522 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8011932-e829-41dc-855a-8a1eff875007 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:06.441925 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8011932-e829-41dc-855a-8a1eff875007 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:06.460549 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 420/840] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Feb 28 10:19:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:06.466299 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e844e3b5-0bda-43bf-a77d-3605474cd43e None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:06.567197 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e844e3b5-0bda-43bf-a77d-3605474cd43e None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:06.601189 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b0232-63df-4b3d-a8bf-c552a62d4d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:06.602175 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b0232-63df-4b3d-a8bf-c552a62d4d62 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:06.602703 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b0232-63df-4b3d-a8bf-c552a62d4d62 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:06.603187 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b0232-63df-4b3d-a8bf-c552a62d4d62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:06.673014 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b0232-63df-4b3d-a8bf-c552a62d4d62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:06.674902 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b0232-63df-4b3d-a8bf-c552a62d4d62 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:06.773833 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 421/841] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:19:06 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Feb 28 10:19:06.779815 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8011932-e829-41dc-855a-8a1eff875007 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:06.881271 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8011932-e829-41dc-855a-8a1eff875007 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:06.922429 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1eefc-a0b1-4b1d-b7f9-6f99fd2b98bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:06.923340 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1eefc-a0b1-4b1d-b7f9-6f99fd2b98bd None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:06.923558 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1eefc-a0b1-4b1d-b7f9-6f99fd2b98bd None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:06.923831 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1eefc-a0b1-4b1d-b7f9-6f99fd2b98bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:06.935870 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e1eefc-a0b1-4b1d-b7f9-6f99fd2b98bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:06.937305 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e1eefc-a0b1-4b1d-b7f9-6f99fd2b98bd None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:06.955115 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-03e1eefc-a0b1-4b1d-b7f9-6f99fd2b98bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:19:06.956621 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 421/842] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:19:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:06.967696 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b0232-63df-4b3d-a8bf-c552a62d4d62 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:07.065505 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b0232-63df-4b3d-a8bf-c552a62d4d62 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:07.100054 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8df16-5254-49bb-9757-b3112e4089e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:07.101079 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8df16-5254-49bb-9757-b3112e4089e6 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:07.101556 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8df16-5254-49bb-9757-b3112e4089e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:07.102042 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8df16-5254-49bb-9757-b3112e4089e6 None admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:07.102972 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd8df16-5254-49bb-9757-b3112e4089e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:07.103468 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd8df16-5254-49bb-9757-b3112e4089e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:07.105010 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd8df16-5254-49bb-9757-b3112e4089e6 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:07.117882 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 422/843] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:19:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:07.123705 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1eefc-a0b1-4b1d-b7f9-6f99fd2b98bd None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:07.227601 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1eefc-a0b1-4b1d-b7f9-6f99fd2b98bd None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:07.267342 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc487f-f046-49f5-92f7-1d3317c30c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:07.268126 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc487f-f046-49f5-92f7-1d3317c30c77 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:07.268400 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc487f-f046-49f5-92f7-1d3317c30c77 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:07.268668 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc487f-f046-49f5-92f7-1d3317c30c77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:07.275596 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc487f-f046-49f5-92f7-1d3317c30c77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:07.277076 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc487f-f046-49f5-92f7-1d3317c30c77 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:07.278312 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b08af-1f28-4347-8b46-621e0b6c1627 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:07.278559 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b08af-1f28-4347-8b46-621e0b6c1627 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:07.278873 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b08af-1f28-4347-8b46-621e0b6c1627 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:07.284559 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 423/844] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:19:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:19:07.286210 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ffba4-5cc7-47dd-90d2-ac56ba191aa5 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:07.286497 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ffba4-5cc7-47dd-90d2-ac56ba191aa5 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:07.286816 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ffba4-5cc7-47dd-90d2-ac56ba191aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:07.291367 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-58fc487f-f046-49f5-92f7-1d3317c30c77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:19:07.292853 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 422/845] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:19:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:19:07.299643 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc487f-f046-49f5-92f7-1d3317c30c77 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:07.304191 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-de8ffba4-5cc7-47dd-90d2-ac56ba191aa5 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:19:07.305568 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-de8ffba4-5cc7-47dd-90d2-ac56ba191aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:19:07.387480 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 424/846] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:19:07 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:19:07.402550 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ffba4-5cc7-47dd-90d2-ac56ba191aa5 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:07.418222 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc487f-f046-49f5-92f7-1d3317c30c77 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:07.458984 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c247c-6f1a-44d5-b94f-b9bb0f924ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:07.459638 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c247c-6f1a-44d5-b94f-b9bb0f924ec0 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:07.459923 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c247c-6f1a-44d5-b94f-b9bb0f924ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:07.460202 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c247c-6f1a-44d5-b94f-b9bb0f924ec0 None admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:07.460963 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c247c-6f1a-44d5-b94f-b9bb0f924ec0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:07.461273 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c247c-6f1a-44d5-b94f-b9bb0f924ec0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:07.463049 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c247c-6f1a-44d5-b94f-b9bb0f924ec0 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:07.480282 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 423/847] 10.222.0.21 () {56 vars in 1148 bytes} [Mon Feb 28 10:19:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:07.487779 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c247c-6f1a-44d5-b94f-b9bb0f924ec0 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:07.518415 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ffba4-5cc7-47dd-90d2-ac56ba191aa5 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:07.555920 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eb1616-590a-45bc-9a23-900de2d83e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:07.557220 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb1616-590a-45bc-9a23-900de2d83e64 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:07.557723 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb1616-590a-45bc-9a23-900de2d83e64 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:07.558368 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb1616-590a-45bc-9a23-900de2d83e64 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:07.559786 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eb1616-590a-45bc-9a23-900de2d83e64 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:07.561450 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eb1616-590a-45bc-9a23-900de2d83e64 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:07.573570 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-d6eb1616-590a-45bc-9a23-900de2d83e64 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 28 10:19:07.580735 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 425/848] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 10:19:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:07.582269 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eb1616-590a-45bc-9a23-900de2d83e64 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:07.612820 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c247c-6f1a-44d5-b94f-b9bb0f924ec0 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:07.649564 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924efbe-4b3d-455f-95a1-91db68aa8dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:07.650211 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924efbe-4b3d-455f-95a1-91db68aa8dfa None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:07.650486 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924efbe-4b3d-455f-95a1-91db68aa8dfa None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:07.650799 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924efbe-4b3d-455f-95a1-91db68aa8dfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:07.651603 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924efbe-4b3d-455f-95a1-91db68aa8dfa None admin] RBAC: Adding query filter params (role.id=48e4608a7b3f4b87a20b10c4d1b45aa9, scope.project.id=5d1d6f8141924b2d99b766f975a3d43b, user.id=8696fe8a37aa4d73a62bdc2efd35a23d) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:07.651906 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924efbe-4b3d-455f-95a1-91db68aa8dfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:07.653621 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924efbe-4b3d-455f-95a1-91db68aa8dfa None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:07.663111 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 424/849] 10.222.0.21 () {56 vars in 1374 bytes} [Mon Feb 28 10:19:07 2022] GET /identity/v3/role_assignments?user.id=8696fe8a37aa4d73a62bdc2efd35a23d&scope.project.id=5d1d6f8141924b2d99b766f975a3d43b&role.id=48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:07.663111 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821ffc8-a3d3-44b3-8572-77389ebc2cbc None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:07.663111 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821ffc8-a3d3-44b3-8572-77389ebc2cbc None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:07.663111 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821ffc8-a3d3-44b3-8572-77389ebc2cbc None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:07.663111 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 425/850] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:19:07.670796 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04759e1-500d-4fbe-a643-89802366d7f5 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:07.671384 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04759e1-500d-4fbe-a643-89802366d7f5 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:07.671816 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04759e1-500d-4fbe-a643-89802366d7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:07.693651 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-c04759e1-500d-4fbe-a643-89802366d7f5 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:19:07.694871 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eb1616-590a-45bc-9a23-900de2d83e64 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:07.695363 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-c04759e1-500d-4fbe-a643-89802366d7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:19:07.739761 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ccdace-4624-4687-8406-36057afd30cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:07.740348 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ccdace-4624-4687-8406-36057afd30cd None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:07.740641 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ccdace-4624-4687-8406-36057afd30cd None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:07.740888 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ccdace-4624-4687-8406-36057afd30cd None admin] PATH_INFO: `/v3/services` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:07.741603 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ccdace-4624-4687-8406-36057afd30cd None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:07.741904 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ccdace-4624-4687-8406-36057afd30cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:07.743337 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ccdace-4624-4687-8406-36057afd30cd None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:07.754003 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 426/851] 10.222.0.21 () {56 vars in 1126 bytes} [Mon Feb 28 10:19:07 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:07.755438 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ccdace-4624-4687-8406-36057afd30cd None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:07.788654 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 426/852] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:19:07 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:19:07.812827 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04759e1-500d-4fbe-a643-89802366d7f5 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:07.888496 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ccdace-4624-4687-8406-36057afd30cd None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:07.924152 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf019e0-209e-451d-9661-07ae71408a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:07.924812 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf019e0-209e-451d-9661-07ae71408a32 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:07.925090 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf019e0-209e-451d-9661-07ae71408a32 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:07.925360 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf019e0-209e-451d-9661-07ae71408a32 None admin] PATH_INFO: `/v3/services` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:07.926053 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf019e0-209e-451d-9661-07ae71408a32 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:07.926351 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf019e0-209e-451d-9661-07ae71408a32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:07.927430 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04759e1-500d-4fbe-a643-89802366d7f5 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:07.927759 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf019e0-209e-451d-9661-07ae71408a32 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:07.936527 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 427/853] 10.222.0.21 () {56 vars in 1126 bytes} [Mon Feb 28 10:19:07 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:07.936527 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bebf8b-265f-4ecd-a1e0-4b3489bfcbc5 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:07.936527 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bebf8b-265f-4ecd-a1e0-4b3489bfcbc5 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:07.936527 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bebf8b-265f-4ecd-a1e0-4b3489bfcbc5 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:07.936527 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 428/854] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:19:07.942074 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f823e6-c9e2-4a70-97b4-2195a9df797a None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:07.942351 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f823e6-c9e2-4a70-97b4-2195a9df797a None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:07.942628 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f823e6-c9e2-4a70-97b4-2195a9df797a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:07.963939 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-88f823e6-c9e2-4a70-97b4-2195a9df797a None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:19:07.965803 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-88f823e6-c9e2-4a70-97b4-2195a9df797a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:19:07.968256 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c7cee-9534-4509-90c7-dd1b8d68d527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:07.969065 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c7cee-9534-4509-90c7-dd1b8d68d527 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:07.969343 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c7cee-9534-4509-90c7-dd1b8d68d527 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:07.969616 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c7cee-9534-4509-90c7-dd1b8d68d527 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:07.970270 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c7cee-9534-4509-90c7-dd1b8d68d527 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:07.971691 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c7cee-9534-4509-90c7-dd1b8d68d527 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:07.983403 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-f47c7cee-9534-4509-90c7-dd1b8d68d527 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 28 10:19:07.984952 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 427/855] 10.222.0.21 () {56 vars in 1114 bytes} [Mon Feb 28 10:19:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:19:07.995704 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c7cee-9534-4509-90c7-dd1b8d68d527 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:08.066767 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 429/856] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:19:07 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 10:19:08.090939 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f823e6-c9e2-4a70-97b4-2195a9df797a None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:08.115336 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c7cee-9534-4509-90c7-dd1b8d68d527 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:08.151248 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0da7e-57b1-4d09-8b96-08e0f4966156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:08.152289 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0da7e-57b1-4d09-8b96-08e0f4966156 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:08.152870 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0da7e-57b1-4d09-8b96-08e0f4966156 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:08.153357 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0da7e-57b1-4d09-8b96-08e0f4966156 None admin] PATH_INFO: `/v3/services` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:08.154251 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e0da7e-57b1-4d09-8b96-08e0f4966156 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:08.154782 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e0da7e-57b1-4d09-8b96-08e0f4966156 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:08.156348 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e0da7e-57b1-4d09-8b96-08e0f4966156 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:08.166065 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 428/857] 10.222.0.21 () {56 vars in 1114 bytes} [Mon Feb 28 10:19:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:08.167582 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0da7e-57b1-4d09-8b96-08e0f4966156 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:08.192797 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f823e6-c9e2-4a70-97b4-2195a9df797a None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:08.227456 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6822fb-000e-463d-9846-e990ebf48243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:08.228242 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6822fb-000e-463d-9846-e990ebf48243 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:08.228523 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6822fb-000e-463d-9846-e990ebf48243 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:08.228797 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6822fb-000e-463d-9846-e990ebf48243 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:08.241649 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6822fb-000e-463d-9846-e990ebf48243 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:19:08.249733 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-3b6822fb-000e-463d-9846-e990ebf48243 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 10:19:08.251254 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 430/858] 10.222.0.21 () {56 vars in 1102 bytes} [Mon Feb 28 10:19:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:19:08.257012 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6822fb-000e-463d-9846-e990ebf48243 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:08.272386 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0da7e-57b1-4d09-8b96-08e0f4966156 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:08.305652 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8d8a3-e440-4213-b36e-38d1f690ae86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:08.306677 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8d8a3-e440-4213-b36e-38d1f690ae86 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:08.307189 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8d8a3-e440-4213-b36e-38d1f690ae86 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:08.307658 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8d8a3-e440-4213-b36e-38d1f690ae86 None admin] PATH_INFO: `/v3/services` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:08.308558 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a8d8a3-e440-4213-b36e-38d1f690ae86 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:08.309835 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a8d8a3-e440-4213-b36e-38d1f690ae86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:08.311446 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a8d8a3-e440-4213-b36e-38d1f690ae86 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:08.322922 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 429/859] 10.222.0.21 () {56 vars in 1114 bytes} [Mon Feb 28 10:19:08 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:19:08.368327 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6822fb-000e-463d-9846-e990ebf48243 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:08.407945 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b957af4d-4605-48ff-9e53-04042ce0fc2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:08.408613 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957af4d-4605-48ff-9e53-04042ce0fc2d None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:08.408935 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957af4d-4605-48ff-9e53-04042ce0fc2d None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:08.409210 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957af4d-4605-48ff-9e53-04042ce0fc2d None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:08.409957 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b957af4d-4605-48ff-9e53-04042ce0fc2d None admin] RBAC: Adding query filter params (name=service) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:08.410255 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b957af4d-4605-48ff-9e53-04042ce0fc2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:08.411723 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b957af4d-4605-48ff-9e53-04042ce0fc2d None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:08.422076 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 431/860] 10.222.0.21 () {56 vars in 1103 bytes} [Mon Feb 28 10:19:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:19:08.427663 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8d8a3-e440-4213-b36e-38d1f690ae86 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:08.548081 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8d8a3-e440-4213-b36e-38d1f690ae86 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:08.582175 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41642ee7-d2ca-4997-a2f4-fbce747218d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:08.582992 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41642ee7-d2ca-4997-a2f4-fbce747218d9 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:08.583279 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41642ee7-d2ca-4997-a2f4-fbce747218d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:08.583668 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41642ee7-d2ca-4997-a2f4-fbce747218d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:08.595146 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41642ee7-d2ca-4997-a2f4-fbce747218d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:08.596593 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41642ee7-d2ca-4997-a2f4-fbce747218d9 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:08.613150 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-41642ee7-d2ca-4997-a2f4-fbce747218d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:19:08.614694 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 430/861] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:19:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:08.620019 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b957af4d-4605-48ff-9e53-04042ce0fc2d None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:08.726725 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b957af4d-4605-48ff-9e53-04042ce0fc2d None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:08.763831 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf432a-eead-4627-8ac2-522d320e2100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:08.764852 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf432a-eead-4627-8ac2-522d320e2100 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:08.765336 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf432a-eead-4627-8ac2-522d320e2100 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:08.765839 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf432a-eead-4627-8ac2-522d320e2100 None admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:08.766786 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf432a-eead-4627-8ac2-522d320e2100 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:08.767293 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf432a-eead-4627-8ac2-522d320e2100 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:08.768828 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf432a-eead-4627-8ac2-522d320e2100 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:08.782139 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 432/862] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:19:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:08.787929 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41642ee7-d2ca-4997-a2f4-fbce747218d9 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:08.895839 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41642ee7-d2ca-4997-a2f4-fbce747218d9 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:08.932680 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac48a89-a111-487c-adb7-24f23ffae5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:08.933495 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac48a89-a111-487c-adb7-24f23ffae5e9 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:08.934421 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac48a89-a111-487c-adb7-24f23ffae5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:08.934718 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac48a89-a111-487c-adb7-24f23ffae5e9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:08.942334 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac48a89-a111-487c-adb7-24f23ffae5e9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:08.943791 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac48a89-a111-487c-adb7-24f23ffae5e9 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:08.957665 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-fac48a89-a111-487c-adb7-24f23ffae5e9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 28 10:19:08.959216 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 431/863] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Feb 28 10:19:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:08.964443 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf432a-eead-4627-8ac2-522d320e2100 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:09.067262 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf432a-eead-4627-8ac2-522d320e2100 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:09.104528 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c9a8f-08a4-4279-be5d-5d8c0e13bdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:09.105118 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c9a8f-08a4-4279-be5d-5d8c0e13bdcd None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:09.105392 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c9a8f-08a4-4279-be5d-5d8c0e13bdcd None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:09.105829 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c9a8f-08a4-4279-be5d-5d8c0e13bdcd None admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:09.107405 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c9a8f-08a4-4279-be5d-5d8c0e13bdcd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:09.107777 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c9a8f-08a4-4279-be5d-5d8c0e13bdcd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:09.109273 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c9a8f-08a4-4279-be5d-5d8c0e13bdcd None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:09.128746 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 433/864] 10.222.0.21 () {56 vars in 1149 bytes} [Mon Feb 28 10:19:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:09.134198 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac48a89-a111-487c-adb7-24f23ffae5e9 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:09.235455 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac48a89-a111-487c-adb7-24f23ffae5e9 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:09.270999 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40114e3-2730-4879-b5ac-6a725c98b9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:09.271649 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40114e3-2730-4879-b5ac-6a725c98b9c3 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:09.271927 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40114e3-2730-4879-b5ac-6a725c98b9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:09.272200 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40114e3-2730-4879-b5ac-6a725c98b9c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:09.337600 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40114e3-2730-4879-b5ac-6a725c98b9c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:09.339080 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40114e3-2730-4879-b5ac-6a725c98b9c3 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:09.439429 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 432/865] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:19:09 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 10:19:09.444806 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c9a8f-08a4-4279-be5d-5d8c0e13bdcd None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:09.548597 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c9a8f-08a4-4279-be5d-5d8c0e13bdcd None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:09.585999 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97929c-b0ee-4afd-806d-ec4e0df53b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:09.586878 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97929c-b0ee-4afd-806d-ec4e0df53b82 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:09.587154 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97929c-b0ee-4afd-806d-ec4e0df53b82 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:09.587473 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97929c-b0ee-4afd-806d-ec4e0df53b82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:09.598627 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de97929c-b0ee-4afd-806d-ec4e0df53b82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:09.600070 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de97929c-b0ee-4afd-806d-ec4e0df53b82 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:09.617855 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-de97929c-b0ee-4afd-806d-ec4e0df53b82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:19:09.619368 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 434/866] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:19:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:09.625436 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40114e3-2730-4879-b5ac-6a725c98b9c3 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:09.726936 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40114e3-2730-4879-b5ac-6a725c98b9c3 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:09.763338 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a6870-b69e-4eee-a635-3225ccab3ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:09.764376 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a6870-b69e-4eee-a635-3225ccab3ab0 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:09.764863 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a6870-b69e-4eee-a635-3225ccab3ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:09.765360 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a6870-b69e-4eee-a635-3225ccab3ab0 None admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:09.766273 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a6870-b69e-4eee-a635-3225ccab3ab0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:09.766803 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a6870-b69e-4eee-a635-3225ccab3ab0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:09.768377 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a6870-b69e-4eee-a635-3225ccab3ab0 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:09.781284 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 433/867] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:19:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:09.790631 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97929c-b0ee-4afd-806d-ec4e0df53b82 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:09.889017 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97929c-b0ee-4afd-806d-ec4e0df53b82 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:09.924786 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6014ce-dd9f-4655-9ff6-93e596dbbe85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:09.925618 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6014ce-dd9f-4655-9ff6-93e596dbbe85 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:09.925893 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6014ce-dd9f-4655-9ff6-93e596dbbe85 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:09.926212 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6014ce-dd9f-4655-9ff6-93e596dbbe85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:09.933090 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6014ce-dd9f-4655-9ff6-93e596dbbe85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:09.935218 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6014ce-dd9f-4655-9ff6-93e596dbbe85 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:09.948422 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-ca6014ce-dd9f-4655-9ff6-93e596dbbe85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:19:09.950480 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 435/868] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:19:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:09.956029 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a6870-b69e-4eee-a635-3225ccab3ab0 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:10.065418 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a6870-b69e-4eee-a635-3225ccab3ab0 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:10.087345 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9770d8-3078-40f1-9d96-da4855ced428 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:10.087860 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9770d8-3078-40f1-9d96-da4855ced428 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:10.087984 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9770d8-3078-40f1-9d96-da4855ced428 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:10.089924 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 436/869] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:19:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:19:10.095362 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817c34a-fc85-4358-aa9a-50a4da2097cf None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:10.095652 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817c34a-fc85-4358-aa9a-50a4da2097cf None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:10.096164 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817c34a-fc85-4358-aa9a-50a4da2097cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:10.100875 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b8ee0-4f00-4c04-a696-fe0e7e2f3e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:10.101865 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b8ee0-4f00-4c04-a696-fe0e7e2f3e3c None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:10.102333 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b8ee0-4f00-4c04-a696-fe0e7e2f3e3c None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:10.102791 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b8ee0-4f00-4c04-a696-fe0e7e2f3e3c None admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:10.103567 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98b8ee0-4f00-4c04-a696-fe0e7e2f3e3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:10.103869 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98b8ee0-4f00-4c04-a696-fe0e7e2f3e3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:10.105296 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98b8ee0-4f00-4c04-a696-fe0e7e2f3e3c None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:10.116665 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-3817c34a-fc85-4358-aa9a-50a4da2097cf None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:19:10.118153 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-3817c34a-fc85-4358-aa9a-50a4da2097cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:19:10.118365 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 434/870] 10.222.0.21 () {56 vars in 1148 bytes} [Mon Feb 28 10:19:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:10.127749 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b8ee0-4f00-4c04-a696-fe0e7e2f3e3c None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:10.196658 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 437/871] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:19:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:19:10.219103 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817c34a-fc85-4358-aa9a-50a4da2097cf None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:10.248648 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b8ee0-4f00-4c04-a696-fe0e7e2f3e3c None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:10.296243 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17063d-00f0-4afb-b9fe-35b0ec49c351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:10.297309 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17063d-00f0-4afb-b9fe-35b0ec49c351 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:10.297794 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17063d-00f0-4afb-b9fe-35b0ec49c351 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:10.298657 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17063d-00f0-4afb-b9fe-35b0ec49c351 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:10.299664 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b17063d-00f0-4afb-b9fe-35b0ec49c351 None admin] RBAC: Adding query filter params (role.id=060d4a1eef7a45858664a42696ff4a19, scope.project.id=5d1d6f8141924b2d99b766f975a3d43b, user.id=1c1284bfe6cc43848731ed2b3d9e914b) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:10.300507 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b17063d-00f0-4afb-b9fe-35b0ec49c351 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:10.302460 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b17063d-00f0-4afb-b9fe-35b0ec49c351 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:10.319351 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 435/872] 10.222.0.21 () {56 vars in 1374 bytes} [Mon Feb 28 10:19:10 2022] GET /identity/v3/role_assignments?user.id=1c1284bfe6cc43848731ed2b3d9e914b&scope.project.id=5d1d6f8141924b2d99b766f975a3d43b&role.id=060d4a1eef7a45858664a42696ff4a19 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:10.336497 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817c34a-fc85-4358-aa9a-50a4da2097cf None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:10.354909 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a120a-d998-4e50-95fa-378b0f4bf26c None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:10.355193 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a120a-d998-4e50-95fa-378b0f4bf26c None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:10.355477 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a120a-d998-4e50-95fa-378b0f4bf26c None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:10.362295 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 436/873] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:19:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:19:10.364321 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909766f3-3bec-4cda-9bfd-b28d3385b5bc None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:10.364606 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909766f3-3bec-4cda-9bfd-b28d3385b5bc None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:10.364882 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909766f3-3bec-4cda-9bfd-b28d3385b5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:10.376225 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d083309b-f75e-4f85-9512-bb4afb444582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:10.377312 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083309b-f75e-4f85-9512-bb4afb444582 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:10.377741 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083309b-f75e-4f85-9512-bb4afb444582 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:10.378180 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083309b-f75e-4f85-9512-bb4afb444582 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:10.379027 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d083309b-f75e-4f85-9512-bb4afb444582 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:10.380608 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d083309b-f75e-4f85-9512-bb4afb444582 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:10.382781 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-909766f3-3bec-4cda-9bfd-b28d3385b5bc None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:19:10.384040 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-909766f3-3bec-4cda-9bfd-b28d3385b5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:19:10.393585 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-d083309b-f75e-4f85-9512-bb4afb444582 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 28 10:19:10.395160 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 438/874] 10.222.0.21 () {56 vars in 1126 bytes} [Mon Feb 28 10:19:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:19:10.401557 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d083309b-f75e-4f85-9512-bb4afb444582 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:10.482161 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 437/875] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:19:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:19:10.505582 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909766f3-3bec-4cda-9bfd-b28d3385b5bc None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:10.541103 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d083309b-f75e-4f85-9512-bb4afb444582 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:10.590940 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e1c02-8c93-48a2-a986-c3b7c085a59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:10.591329 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e1c02-8c93-48a2-a986-c3b7c085a59b None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:10.591608 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e1c02-8c93-48a2-a986-c3b7c085a59b None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:10.591880 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e1c02-8c93-48a2-a986-c3b7c085a59b None admin] PATH_INFO: `/v3/services` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:10.592582 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e1c02-8c93-48a2-a986-c3b7c085a59b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:10.592883 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e1c02-8c93-48a2-a986-c3b7c085a59b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:10.594262 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e1c02-8c93-48a2-a986-c3b7c085a59b None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:10.600163 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 439/876] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Feb 28 10:19:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:19:10.606127 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e1c02-8c93-48a2-a986-c3b7c085a59b None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:10.629133 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909766f3-3bec-4cda-9bfd-b28d3385b5bc None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:10.672539 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb3ebe-4b8a-443d-9786-5b8663fa1015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:10.673319 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb3ebe-4b8a-443d-9786-5b8663fa1015 None admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:10.673602 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb3ebe-4b8a-443d-9786-5b8663fa1015 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:10.674125 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb3ebe-4b8a-443d-9786-5b8663fa1015 None admin] PATH_INFO: `/v3/services` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:10.680989 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb3ebe-4b8a-443d-9786-5b8663fa1015 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:10.682383 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb3ebe-4b8a-443d-9786-5b8663fa1015 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:10.703189 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 438/877] 10.222.0.21 () {60 vars in 1141 bytes} [Mon Feb 28 10:19:10 2022] POST /identity/v3/services => generated 269 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:19:10.728595 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e1c02-8c93-48a2-a986-c3b7c085a59b None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:10.774789 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01074bf1-7ca3-40cd-82f8-cdb7306bf4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:10.775524 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01074bf1-7ca3-40cd-82f8-cdb7306bf4a1 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:10.775806 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01074bf1-7ca3-40cd-82f8-cdb7306bf4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:10.776082 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01074bf1-7ca3-40cd-82f8-cdb7306bf4a1 None admin] PATH_INFO: `/v3/services` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:10.776852 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01074bf1-7ca3-40cd-82f8-cdb7306bf4a1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:10.777223 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01074bf1-7ca3-40cd-82f8-cdb7306bf4a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:10.779334 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01074bf1-7ca3-40cd-82f8-cdb7306bf4a1 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:10.790791 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 440/878] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Feb 28 10:19:10 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:19:10.828230 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4e865-17ff-4345-a0ef-4035039c488d None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:10.828552 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4e865-17ff-4345-a0ef-4035039c488d None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:10.828780 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4e865-17ff-4345-a0ef-4035039c488d None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:10.831086 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 439/879] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:19:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:19:10.840859 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12323232-43d0-4818-84c5-3c0332f5c124 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:10.841257 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12323232-43d0-4818-84c5-3c0332f5c124 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:10.841423 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12323232-43d0-4818-84c5-3c0332f5c124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:10.864851 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-12323232-43d0-4818-84c5-3c0332f5c124 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:19:10.866118 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-12323232-43d0-4818-84c5-3c0332f5c124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:19:10.941173 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 441/880] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:19:10 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:19:10.965443 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4e865-17ff-4345-a0ef-4035039c488d None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:11.071183 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4e865-17ff-4345-a0ef-4035039c488d None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:11.104443 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d54422-546b-4368-84c2-a8a7f9c838db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:11.105434 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d54422-546b-4368-84c2-a8a7f9c838db None admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:11.106537 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d54422-546b-4368-84c2-a8a7f9c838db None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:11.107034 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d54422-546b-4368-84c2-a8a7f9c838db None admin] PATH_INFO: `/v3/services` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:11.108004 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d54422-546b-4368-84c2-a8a7f9c838db None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:11.109599 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d54422-546b-4368-84c2-a8a7f9c838db None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:11.130790 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 440/881] 10.222.0.21 () {60 vars in 1141 bytes} [Mon Feb 28 10:19:10 2022] POST /identity/v3/services => generated 251 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:19:12.877552 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d9ecb-5f89-4fae-9d73-194b920a0a0a None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:12.878512 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d9ecb-5f89-4fae-9d73-194b920a0a0a None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:12.879042 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d9ecb-5f89-4fae-9d73-194b920a0a0a None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:12.881306 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 442/882] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:19:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:19:12.886915 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ea24c-971d-479b-ac9b-649f233fdc26 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:12.887739 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ea24c-971d-479b-ac9b-649f233fdc26 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:12.888217 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ea24c-971d-479b-ac9b-649f233fdc26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:12.906026 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-816ea24c-971d-479b-ac9b-649f233fdc26 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:19:12.907573 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-816ea24c-971d-479b-ac9b-649f233fdc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:19:12.986700 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 441/883] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:19:12 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 10:19:13.007138 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d9ecb-5f89-4fae-9d73-194b920a0a0a None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:13.111799 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d9ecb-5f89-4fae-9d73-194b920a0a0a None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:13.114233 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52923e42-d95a-409a-935d-e1649893714b None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:13.114794 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52923e42-d95a-409a-935d-e1649893714b None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:13.115300 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52923e42-d95a-409a-935d-e1649893714b None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:13.117525 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 442/884] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:19:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:19:13.123633 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2930793-2c7b-4f93-800c-84d1c30d6d0a None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:13.124208 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2930793-2c7b-4f93-800c-84d1c30d6d0a None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:13.124709 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2930793-2c7b-4f93-800c-84d1c30d6d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:13.142830 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-c2930793-2c7b-4f93-800c-84d1c30d6d0a None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:19:13.144447 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-c2930793-2c7b-4f93-800c-84d1c30d6d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:19:13.154236 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f5c5a3-3749-4e5e-948f-dc794bd1221d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:13.155177 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f5c5a3-3749-4e5e-948f-dc794bd1221d None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:13.155458 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f5c5a3-3749-4e5e-948f-dc794bd1221d None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:13.155783 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f5c5a3-3749-4e5e-948f-dc794bd1221d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:13.171530 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f5c5a3-3749-4e5e-948f-dc794bd1221d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:19:13.179147 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-97f5c5a3-3749-4e5e-948f-dc794bd1221d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 28 10:19:13.180365 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 443/885] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 10:19:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:13.181702 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5995d3-0d00-4683-b307-ac1eb0294798 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:13.181987 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5995d3-0d00-4683-b307-ac1eb0294798 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:13.182260 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5995d3-0d00-4683-b307-ac1eb0294798 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:13.184608 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 444/886] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:19:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:19:13.189437 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5995d3-0d00-4683-b307-ac1eb0294798 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:13.220048 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 443/887] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:19:13 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 10:19:13.221420 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afdf25a-46ff-4bb7-8380-4cadc75f3037 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:13.221863 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afdf25a-46ff-4bb7-8380-4cadc75f3037 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:13.222139 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afdf25a-46ff-4bb7-8380-4cadc75f3037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:13.238267 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-8afdf25a-46ff-4bb7-8380-4cadc75f3037 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:19:13.239680 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-8afdf25a-46ff-4bb7-8380-4cadc75f3037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:19:13.307658 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 444/888] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:19:13 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:19:13.309349 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5995d3-0d00-4683-b307-ac1eb0294798 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:13.315836 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afdf25a-46ff-4bb7-8380-4cadc75f3037 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:13.344533 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76024ce0-8172-4bad-a3a1-b2bcf91782fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:13.345201 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76024ce0-8172-4bad-a3a1-b2bcf91782fd None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:13.345485 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76024ce0-8172-4bad-a3a1-b2bcf91782fd None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:13.346008 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76024ce0-8172-4bad-a3a1-b2bcf91782fd None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:13.346578 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76024ce0-8172-4bad-a3a1-b2bcf91782fd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:13.346905 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76024ce0-8172-4bad-a3a1-b2bcf91782fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:13.348207 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76024ce0-8172-4bad-a3a1-b2bcf91782fd None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:13.361327 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 445/889] 10.222.0.21 () {56 vars in 1115 bytes} [Mon Feb 28 10:19:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:19:13.361327 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76024ce0-8172-4bad-a3a1-b2bcf91782fd None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:13.417345 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afdf25a-46ff-4bb7-8380-4cadc75f3037 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:13.452735 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7b33f-cebe-4d57-ae49-9c6d849976aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:13.453653 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7b33f-cebe-4d57-ae49-9c6d849976aa None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:13.453966 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7b33f-cebe-4d57-ae49-9c6d849976aa None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:13.454241 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7b33f-cebe-4d57-ae49-9c6d849976aa None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:13.454914 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7b33f-cebe-4d57-ae49-9c6d849976aa None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:13.456270 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7b33f-cebe-4d57-ae49-9c6d849976aa None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:13.459374 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76024ce0-8172-4bad-a3a1-b2bcf91782fd None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:13.468458 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-0ec7b33f-cebe-4d57-ae49-9c6d849976aa None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 28 10:19:13.474631 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 445/890] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 10:19:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:13.474631 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7b33f-cebe-4d57-ae49-9c6d849976aa None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:13.499616 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e794c1e-edac-40ef-b2b6-608d28fc1a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:13.500386 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e794c1e-edac-40ef-b2b6-608d28fc1a87 None admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:13.500737 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e794c1e-edac-40ef-b2b6-608d28fc1a87 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:13.501014 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e794c1e-edac-40ef-b2b6-608d28fc1a87 None admin] PATH_INFO: `/v3/services` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:13.501731 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e794c1e-edac-40ef-b2b6-608d28fc1a87 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:13.503095 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e794c1e-edac-40ef-b2b6-608d28fc1a87 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:13.516701 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 446/891] 10.222.0.21 () {60 vars in 1141 bytes} [Mon Feb 28 10:19:13 2022] POST /identity/v3/services => generated 241 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:19:13.517513 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e794c1e-edac-40ef-b2b6-608d28fc1a87 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:13.580733 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7b33f-cebe-4d57-ae49-9c6d849976aa None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:13.622872 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844cf4fe-e7b3-4482-b97a-4e26934aba9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:13.623670 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cf4fe-e7b3-4482-b97a-4e26934aba9e None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:13.623951 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cf4fe-e7b3-4482-b97a-4e26934aba9e None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:13.624225 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cf4fe-e7b3-4482-b97a-4e26934aba9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:13.635276 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e794c1e-edac-40ef-b2b6-608d28fc1a87 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:13.635477 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844cf4fe-e7b3-4482-b97a-4e26934aba9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:13.636933 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844cf4fe-e7b3-4482-b97a-4e26934aba9e None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:13.655074 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-844cf4fe-e7b3-4482-b97a-4e26934aba9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:19:13.661030 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 446/892] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:19:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:13.661030 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09e0bc-6928-4b12-bc5a-61c5c03bd119 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:13.661030 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09e0bc-6928-4b12-bc5a-61c5c03bd119 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:13.661030 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09e0bc-6928-4b12-bc5a-61c5c03bd119 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:13.661030 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 447/893] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:19:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:19:13.663536 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09e0bc-6928-4b12-bc5a-61c5c03bd119 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:13.678299 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0a380e-fcea-4b69-8b90-79f6da4545ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:13.678923 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a380e-fcea-4b69-8b90-79f6da4545ad None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:13.679206 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a380e-fcea-4b69-8b90-79f6da4545ad None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:13.679481 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a380e-fcea-4b69-8b90-79f6da4545ad None admin] PATH_INFO: `/v3/services` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:13.680190 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0a380e-fcea-4b69-8b90-79f6da4545ad None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:13.680498 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0a380e-fcea-4b69-8b90-79f6da4545ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:13.681901 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0a380e-fcea-4b69-8b90-79f6da4545ad None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:13.692019 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 447/894] 10.222.0.21 () {56 vars in 1126 bytes} [Mon Feb 28 10:19:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:13.692019 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5b96d-420c-4f68-bd57-45b2d9f9b93f None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:13.692019 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5b96d-420c-4f68-bd57-45b2d9f9b93f None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:13.692019 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5b96d-420c-4f68-bd57-45b2d9f9b93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:13.709436 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-c7e5b96d-420c-4f68-bd57-45b2d9f9b93f None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:19:13.710764 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-c7e5b96d-420c-4f68-bd57-45b2d9f9b93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:19:13.773580 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09e0bc-6928-4b12-bc5a-61c5c03bd119 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:13.785470 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 448/895] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:19:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:19:13.786378 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e5b96d-420c-4f68-bd57-45b2d9f9b93f None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:13.815629 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c23e1a-b6ee-46e6-b806-130b225954aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:13.816341 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c23e1a-b6ee-46e6-b806-130b225954aa None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:13.816567 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c23e1a-b6ee-46e6-b806-130b225954aa None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:13.816842 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c23e1a-b6ee-46e6-b806-130b225954aa None admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:13.817552 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c23e1a-b6ee-46e6-b806-130b225954aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:13.817854 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c23e1a-b6ee-46e6-b806-130b225954aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:13.819327 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c23e1a-b6ee-46e6-b806-130b225954aa None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:13.833489 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 448/896] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:13.834370 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c23e1a-b6ee-46e6-b806-130b225954aa None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:13.892485 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e5b96d-420c-4f68-bd57-45b2d9f9b93f None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:13.925951 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326969c3-242c-483f-a5fb-d3bdf2023a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:13.926628 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326969c3-242c-483f-a5fb-d3bdf2023a2f None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:13.926918 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326969c3-242c-483f-a5fb-d3bdf2023a2f None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:13.927196 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326969c3-242c-483f-a5fb-d3bdf2023a2f None admin] PATH_INFO: `/v3/services` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:13.927893 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326969c3-242c-483f-a5fb-d3bdf2023a2f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:13.928197 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326969c3-242c-483f-a5fb-d3bdf2023a2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:13.929613 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326969c3-242c-483f-a5fb-d3bdf2023a2f None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:13.938879 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 449/897] 10.222.0.21 () {56 vars in 1126 bytes} [Mon Feb 28 10:19:13 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:13.938879 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326969c3-242c-483f-a5fb-d3bdf2023a2f None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:13.939149 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c23e1a-b6ee-46e6-b806-130b225954aa None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:13.973439 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797bf1e4-db91-4439-885e-73eb8b62ea6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:13.974201 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797bf1e4-db91-4439-885e-73eb8b62ea6a None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:13.974483 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797bf1e4-db91-4439-885e-73eb8b62ea6a None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:13.974784 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797bf1e4-db91-4439-885e-73eb8b62ea6a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:13.975429 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797bf1e4-db91-4439-885e-73eb8b62ea6a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:13.976789 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797bf1e4-db91-4439-885e-73eb8b62ea6a None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:13.987455 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-797bf1e4-db91-4439-885e-73eb8b62ea6a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 28 10:19:13.988795 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 449/898] 10.222.0.21 () {56 vars in 1114 bytes} [Mon Feb 28 10:19:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:13.989373 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797bf1e4-db91-4439-885e-73eb8b62ea6a None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:14.039217 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326969c3-242c-483f-a5fb-d3bdf2023a2f None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:14.071542 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d72e0-c017-427d-8e67-c60da0a21b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:14.072338 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d72e0-c017-427d-8e67-c60da0a21b35 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:14.072619 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d72e0-c017-427d-8e67-c60da0a21b35 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:14.073157 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d72e0-c017-427d-8e67-c60da0a21b35 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:14.080555 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d72e0-c017-427d-8e67-c60da0a21b35 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:14.081983 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d72e0-c017-427d-8e67-c60da0a21b35 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:14.085616 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797bf1e4-db91-4439-885e-73eb8b62ea6a None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:14.095804 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-331d72e0-c017-427d-8e67-c60da0a21b35 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 28 10:19:14.101745 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 450/899] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Feb 28 10:19:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:14.101745 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d72e0-c017-427d-8e67-c60da0a21b35 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:14.123054 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d285402-96df-43ba-8dd3-f29cb72f4004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:14.123703 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d285402-96df-43ba-8dd3-f29cb72f4004 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:14.123988 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d285402-96df-43ba-8dd3-f29cb72f4004 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:14.124264 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d285402-96df-43ba-8dd3-f29cb72f4004 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:14.125036 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d285402-96df-43ba-8dd3-f29cb72f4004 None admin] RBAC: Adding query filter params (interface=public, service_id=ddb6b31c54374ec0b7bbbd2996503e53, region_id=RegionOne) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:14.125348 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d285402-96df-43ba-8dd3-f29cb72f4004 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:14.126705 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d285402-96df-43ba-8dd3-f29cb72f4004 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:14.135862 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 450/900] 10.222.0.21 () {56 vars in 1251 bytes} [Mon Feb 28 10:19:13 2022] GET /identity/v3/endpoints?service_id=ddb6b31c54374ec0b7bbbd2996503e53&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:14.135862 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d285402-96df-43ba-8dd3-f29cb72f4004 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:14.198673 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d72e0-c017-427d-8e67-c60da0a21b35 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:14.231857 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d285402-96df-43ba-8dd3-f29cb72f4004 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:14.232208 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff031f57-2048-4e1c-ba46-3af2f4678990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:14.232869 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff031f57-2048-4e1c-ba46-3af2f4678990 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:14.233151 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff031f57-2048-4e1c-ba46-3af2f4678990 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:14.233459 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff031f57-2048-4e1c-ba46-3af2f4678990 None admin] PATH_INFO: `/v3/services` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:14.234127 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff031f57-2048-4e1c-ba46-3af2f4678990 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:14.234435 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff031f57-2048-4e1c-ba46-3af2f4678990 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:14.235844 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff031f57-2048-4e1c-ba46-3af2f4678990 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:14.244959 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 451/901] 10.222.0.21 () {56 vars in 1114 bytes} [Mon Feb 28 10:19:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:14.244959 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff031f57-2048-4e1c-ba46-3af2f4678990 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:14.266882 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d01b8-1cee-4642-a961-a806763c5640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:14.267558 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d01b8-1cee-4642-a961-a806763c5640 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:14.267841 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d01b8-1cee-4642-a961-a806763c5640 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:14.268122 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d01b8-1cee-4642-a961-a806763c5640 None admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:14.268946 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d01b8-1cee-4642-a961-a806763c5640 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:14.269255 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d01b8-1cee-4642-a961-a806763c5640 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:14.270772 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d01b8-1cee-4642-a961-a806763c5640 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:14.292080 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 451/902] 10.222.0.21 () {56 vars in 1149 bytes} [Mon Feb 28 10:19:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:14.292080 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d01b8-1cee-4642-a961-a806763c5640 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:14.348052 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff031f57-2048-4e1c-ba46-3af2f4678990 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:14.384160 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec4895-20c8-429e-bc21-e9deac5256b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:14.384484 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d01b8-1cee-4642-a961-a806763c5640 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:14.384815 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec4895-20c8-429e-bc21-e9deac5256b6 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:14.385095 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec4895-20c8-429e-bc21-e9deac5256b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:14.385352 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec4895-20c8-429e-bc21-e9deac5256b6 None admin] PATH_INFO: `/v3/services` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:14.386014 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec4895-20c8-429e-bc21-e9deac5256b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:14.388502 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec4895-20c8-429e-bc21-e9deac5256b6 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:14.402630 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 452/903] 10.222.0.21 () {56 vars in 1087 bytes} [Mon Feb 28 10:19:14 2022] GET /identity/v3/services => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:19:14.402630 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec4895-20c8-429e-bc21-e9deac5256b6 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:14.421367 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988134f-0bf7-49d6-8416-62a624133368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:14.422096 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988134f-0bf7-49d6-8416-62a624133368 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:14.422382 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988134f-0bf7-49d6-8416-62a624133368 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:14.422690 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988134f-0bf7-49d6-8416-62a624133368 None admin] PATH_INFO: `/v3/services` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:14.423447 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2988134f-0bf7-49d6-8416-62a624133368 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:14.423755 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2988134f-0bf7-49d6-8416-62a624133368 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:14.425217 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2988134f-0bf7-49d6-8416-62a624133368 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:14.436338 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 452/904] 10.222.0.21 () {56 vars in 1114 bytes} [Mon Feb 28 10:19:14 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:14.439894 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988134f-0bf7-49d6-8416-62a624133368 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:14.523408 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec4895-20c8-429e-bc21-e9deac5256b6 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:14.562775 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88eeba-100a-4464-9176-087df7fc9ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:14.563910 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988134f-0bf7-49d6-8416-62a624133368 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:14.564136 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88eeba-100a-4464-9176-087df7fc9ace None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:14.564628 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88eeba-100a-4464-9176-087df7fc9ace None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:14.565102 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88eeba-100a-4464-9176-087df7fc9ace None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:14.601054 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229bc4b-f5ac-4a2a-b076-a63f04958396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:14.601709 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229bc4b-f5ac-4a2a-b076-a63f04958396 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:14.601990 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229bc4b-f5ac-4a2a-b076-a63f04958396 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:14.602266 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229bc4b-f5ac-4a2a-b076-a63f04958396 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:14.603429 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229bc4b-f5ac-4a2a-b076-a63f04958396 None admin] RBAC: Adding query filter params (interface=public, service_id=fd8ee33cd3f242df826c03631172931a, region_id=RegionOne) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:14.603429 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229bc4b-f5ac-4a2a-b076-a63f04958396 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:14.605275 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229bc4b-f5ac-4a2a-b076-a63f04958396 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:14.610535 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 453/905] 10.222.0.21 () {56 vars in 1251 bytes} [Mon Feb 28 10:19:14 2022] GET /identity/v3/endpoints?service_id=fd8ee33cd3f242df826c03631172931a&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:19:14.616564 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229bc4b-f5ac-4a2a-b076-a63f04958396 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:14.646132 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d88eeba-100a-4464-9176-087df7fc9ace None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:14.647868 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d88eeba-100a-4464-9176-087df7fc9ace None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:14.719650 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229bc4b-f5ac-4a2a-b076-a63f04958396 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:14.754921 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f6aa8-5000-4e29-ab6d-de43a72fc846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:14.755732 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f6aa8-5000-4e29-ab6d-de43a72fc846 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:14.756116 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f6aa8-5000-4e29-ab6d-de43a72fc846 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:14.756505 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f6aa8-5000-4e29-ab6d-de43a72fc846 None admin] PATH_INFO: `/v3/services` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:14.757137 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 453/906] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:19:14 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 10:19:14.757392 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f6aa8-5000-4e29-ab6d-de43a72fc846 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:14.764989 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f6aa8-5000-4e29-ab6d-de43a72fc846 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:14.765156 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88eeba-100a-4464-9176-087df7fc9ace None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:14.771958 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 454/907] 10.222.0.21 () {56 vars in 1087 bytes} [Mon Feb 28 10:19:14 2022] GET /identity/v3/services => generated 1497 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:19:14.877375 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88eeba-100a-4464-9176-087df7fc9ace None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:14.915238 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d2603-3bde-462c-adde-30b4d2276827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:14.916092 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d2603-3bde-462c-adde-30b4d2276827 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:14.916368 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d2603-3bde-462c-adde-30b4d2276827 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:14.916637 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d2603-3bde-462c-adde-30b4d2276827 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:14.928278 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d2603-3bde-462c-adde-30b4d2276827 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:14.929744 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d2603-3bde-462c-adde-30b4d2276827 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:14.950053 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-f34d2603-3bde-462c-adde-30b4d2276827 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:19:14.951137 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 454/908] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:19:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:14.956741 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f6aa8-5000-4e29-ab6d-de43a72fc846 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:15.057353 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f6aa8-5000-4e29-ab6d-de43a72fc846 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:15.092865 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e623d2-76c9-412e-8cc4-06bc7eda31c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:15.093518 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e623d2-76c9-412e-8cc4-06bc7eda31c7 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:15.093795 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e623d2-76c9-412e-8cc4-06bc7eda31c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:15.094070 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e623d2-76c9-412e-8cc4-06bc7eda31c7 None admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:15.094797 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e623d2-76c9-412e-8cc4-06bc7eda31c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:15.095098 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e623d2-76c9-412e-8cc4-06bc7eda31c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:15.096440 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e623d2-76c9-412e-8cc4-06bc7eda31c7 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:15.112639 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 455/909] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:19:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:15.113994 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d2603-3bde-462c-adde-30b4d2276827 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:15.218521 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d2603-3bde-462c-adde-30b4d2276827 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:15.253512 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a025a24-90db-4e30-b432-2a4ebe23934c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:15.254280 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a025a24-90db-4e30-b432-2a4ebe23934c None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:15.254557 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a025a24-90db-4e30-b432-2a4ebe23934c None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:15.254845 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a025a24-90db-4e30-b432-2a4ebe23934c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:15.261464 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a025a24-90db-4e30-b432-2a4ebe23934c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:15.263520 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a025a24-90db-4e30-b432-2a4ebe23934c None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:15.276088 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-4a025a24-90db-4e30-b432-2a4ebe23934c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:19:15.282705 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 455/910] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:19:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:15.284514 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e623d2-76c9-412e-8cc4-06bc7eda31c7 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:15.385960 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e623d2-76c9-412e-8cc4-06bc7eda31c7 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:15.421073 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f32c8-5e49-411a-a9b8-cee137c87259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:15.421735 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f32c8-5e49-411a-a9b8-cee137c87259 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:15.422011 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f32c8-5e49-411a-a9b8-cee137c87259 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:15.422274 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f32c8-5e49-411a-a9b8-cee137c87259 None admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:15.423071 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f32c8-5e49-411a-a9b8-cee137c87259 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:15.423373 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f32c8-5e49-411a-a9b8-cee137c87259 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:15.424777 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f32c8-5e49-411a-a9b8-cee137c87259 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:15.442559 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 456/911] 10.222.0.21 () {56 vars in 1148 bytes} [Mon Feb 28 10:19:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:15.443936 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a025a24-90db-4e30-b432-2a4ebe23934c None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:15.551333 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a025a24-90db-4e30-b432-2a4ebe23934c None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:15.588758 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e4229-49c2-4e50-968f-48fc381d559d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:15.589404 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e4229-49c2-4e50-968f-48fc381d559d None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:15.589677 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e4229-49c2-4e50-968f-48fc381d559d None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:15.590061 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e4229-49c2-4e50-968f-48fc381d559d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:15.591034 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e4229-49c2-4e50-968f-48fc381d559d None admin] RBAC: Adding query filter params (role.id=0abd451d1e894a6b8575ab7e6685f50a, scope.project.id=5d1d6f8141924b2d99b766f975a3d43b, user.id=1c1284bfe6cc43848731ed2b3d9e914b) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:15.591349 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e4229-49c2-4e50-968f-48fc381d559d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:15.592797 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e4229-49c2-4e50-968f-48fc381d559d None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:15.602719 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 456/912] 10.222.0.21 () {56 vars in 1374 bytes} [Mon Feb 28 10:19:15 2022] GET /identity/v3/role_assignments?user.id=1c1284bfe6cc43848731ed2b3d9e914b&scope.project.id=5d1d6f8141924b2d99b766f975a3d43b&role.id=0abd451d1e894a6b8575ab7e6685f50a => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:15.919181 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc409b-9412-4565-9125-2588763b4f4c None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:15.919691 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc409b-9412-4565-9125-2588763b4f4c None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:15.919945 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc409b-9412-4565-9125-2588763b4f4c None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:15.921981 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 457/913] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:19:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:19:15.927606 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b33ca7-5919-42f7-a4a7-6a5b9da209be None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:15.928168 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b33ca7-5919-42f7-a4a7-6a5b9da209be None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:15.928168 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b33ca7-5919-42f7-a4a7-6a5b9da209be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:15.945289 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-67b33ca7-5919-42f7-a4a7-6a5b9da209be None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:19:15.946476 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-67b33ca7-5919-42f7-a4a7-6a5b9da209be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:19:16.017112 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 457/914] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:19:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:19:16.041096 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc409b-9412-4565-9125-2588763b4f4c None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:16.143941 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc409b-9412-4565-9125-2588763b4f4c None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:16.177659 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831a8aa-3a02-40cc-b5a2-8f8a88f9df57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:16.178453 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831a8aa-3a02-40cc-b5a2-8f8a88f9df57 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:16.178767 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831a8aa-3a02-40cc-b5a2-8f8a88f9df57 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:16.179039 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831a8aa-3a02-40cc-b5a2-8f8a88f9df57 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:16.179682 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5831a8aa-3a02-40cc-b5a2-8f8a88f9df57 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:16.181037 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5831a8aa-3a02-40cc-b5a2-8f8a88f9df57 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:16.192861 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-5831a8aa-3a02-40cc-b5a2-8f8a88f9df57 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 28 10:19:16.194317 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 458/915] 10.222.0.21 () {56 vars in 1126 bytes} [Mon Feb 28 10:19:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:16.200701 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b33ca7-5919-42f7-a4a7-6a5b9da209be None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:16.299978 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b33ca7-5919-42f7-a4a7-6a5b9da209be None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:16.334387 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9b202-7274-471b-809d-3b0379f66100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:16.335093 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9b202-7274-471b-809d-3b0379f66100 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:16.335374 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9b202-7274-471b-809d-3b0379f66100 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:16.335650 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9b202-7274-471b-809d-3b0379f66100 None admin] PATH_INFO: `/v3/services` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:16.336352 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a9b202-7274-471b-809d-3b0379f66100 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:16.336658 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a9b202-7274-471b-809d-3b0379f66100 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:16.338098 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a9b202-7274-471b-809d-3b0379f66100 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:16.343419 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 458/916] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Feb 28 10:19:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:16.349038 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831a8aa-3a02-40cc-b5a2-8f8a88f9df57 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:16.454268 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831a8aa-3a02-40cc-b5a2-8f8a88f9df57 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:16.492028 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd471a3-367b-4f42-98df-03e6f01c0711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:16.492712 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd471a3-367b-4f42-98df-03e6f01c0711 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:16.492990 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd471a3-367b-4f42-98df-03e6f01c0711 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:16.493261 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd471a3-367b-4f42-98df-03e6f01c0711 None admin] PATH_INFO: `/v3/services` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:16.493983 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd471a3-367b-4f42-98df-03e6f01c0711 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:16.494287 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd471a3-367b-4f42-98df-03e6f01c0711 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:16.495732 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd471a3-367b-4f42-98df-03e6f01c0711 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:16.502123 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 459/917] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Feb 28 10:19:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:16.507883 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9b202-7274-471b-809d-3b0379f66100 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:16.610012 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9b202-7274-471b-809d-3b0379f66100 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:16.644190 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4764a632-9fe7-4ec6-b365-21b7cc744ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:16.644846 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764a632-9fe7-4ec6-b365-21b7cc744ba8 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:16.645176 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764a632-9fe7-4ec6-b365-21b7cc744ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:16.645454 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764a632-9fe7-4ec6-b365-21b7cc744ba8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:16.646236 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4764a632-9fe7-4ec6-b365-21b7cc744ba8 None admin] RBAC: Adding query filter params (interface=public, service_id=cacb7403ffee4d98acc891f8be0ce76c, region_id=RegionOne) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:16.646548 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4764a632-9fe7-4ec6-b365-21b7cc744ba8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:16.647932 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4764a632-9fe7-4ec6-b365-21b7cc744ba8 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:16.653803 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 459/918] 10.222.0.21 () {56 vars in 1251 bytes} [Mon Feb 28 10:19:16 2022] GET /identity/v3/endpoints?service_id=cacb7403ffee4d98acc891f8be0ce76c&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:16.659371 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd471a3-367b-4f42-98df-03e6f01c0711 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:16.764358 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd471a3-367b-4f42-98df-03e6f01c0711 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:16.798295 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259b081-2c54-4d43-8be9-95a6368467fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:16.798990 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259b081-2c54-4d43-8be9-95a6368467fd None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:16.799271 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259b081-2c54-4d43-8be9-95a6368467fd None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:16.799543 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259b081-2c54-4d43-8be9-95a6368467fd None admin] PATH_INFO: `/v3/services` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:16.800213 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3259b081-2c54-4d43-8be9-95a6368467fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:16.801642 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3259b081-2c54-4d43-8be9-95a6368467fd None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:16.807961 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 460/919] 10.222.0.21 () {56 vars in 1087 bytes} [Mon Feb 28 10:19:16 2022] GET /identity/v3/services => generated 1497 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:19:16.894429 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e247a5-3aeb-4acc-b083-030ce2daec45 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:16.894804 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e247a5-3aeb-4acc-b083-030ce2daec45 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:16.895009 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e247a5-3aeb-4acc-b083-030ce2daec45 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:16.897105 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 460/920] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:19:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:19:16.903438 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69751b79-51e2-409d-ba6e-46a988038fc4 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:16.903756 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69751b79-51e2-409d-ba6e-46a988038fc4 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:16.903981 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69751b79-51e2-409d-ba6e-46a988038fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:16.921859 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-69751b79-51e2-409d-ba6e-46a988038fc4 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:19:16.923109 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-69751b79-51e2-409d-ba6e-46a988038fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:19:16.995575 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 461/921] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:19:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:19:17.018984 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e247a5-3aeb-4acc-b083-030ce2daec45 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:17.123963 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e247a5-3aeb-4acc-b083-030ce2daec45 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:17.159761 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aacb9b-0980-4ea7-9675-8e92854e3af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:17.160573 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aacb9b-0980-4ea7-9675-8e92854e3af4 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:17.160851 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aacb9b-0980-4ea7-9675-8e92854e3af4 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:17.161120 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aacb9b-0980-4ea7-9675-8e92854e3af4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:17.161769 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aacb9b-0980-4ea7-9675-8e92854e3af4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:17.163279 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aacb9b-0980-4ea7-9675-8e92854e3af4 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:17.175174 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-28aacb9b-0980-4ea7-9675-8e92854e3af4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 28 10:19:17.176725 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 461/922] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Feb 28 10:19:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:17.182496 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69751b79-51e2-409d-ba6e-46a988038fc4 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:17.235525 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44810c6b-e0fc-41cb-9bf6-87505066243a None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:17.236173 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44810c6b-e0fc-41cb-9bf6-87505066243a None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:17.236662 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44810c6b-e0fc-41cb-9bf6-87505066243a None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:17.238937 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 462/923] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:19:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:19:17.244283 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc7639-7f01-433b-850f-8486f4a27a9b None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:17.244824 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc7639-7f01-433b-850f-8486f4a27a9b None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:17.245301 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc7639-7f01-433b-850f-8486f4a27a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:17.264711 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-c3fc7639-7f01-433b-850f-8486f4a27a9b None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:19:17.266673 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-c3fc7639-7f01-433b-850f-8486f4a27a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:19:17.293631 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69751b79-51e2-409d-ba6e-46a988038fc4 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:17.338797 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44f593-c119-4efa-a47b-76c438cdc957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:17.346487 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44f593-c119-4efa-a47b-76c438cdc957 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:17.346665 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 463/924] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:19:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:19:17.346751 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44f593-c119-4efa-a47b-76c438cdc957 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:17.346751 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44f593-c119-4efa-a47b-76c438cdc957 None admin] PATH_INFO: `/v3/services` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:17.346751 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e44f593-c119-4efa-a47b-76c438cdc957 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:17.346751 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e44f593-c119-4efa-a47b-76c438cdc957 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:17.346751 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e44f593-c119-4efa-a47b-76c438cdc957 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:17.351166 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 462/925] 10.222.0.21 () {56 vars in 1126 bytes} [Mon Feb 28 10:19:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:17.359881 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc7639-7f01-433b-850f-8486f4a27a9b None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:17.367766 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44f593-c119-4efa-a47b-76c438cdc957 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:17.478473 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc7639-7f01-433b-850f-8486f4a27a9b None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:17.487751 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44f593-c119-4efa-a47b-76c438cdc957 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:17.520079 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0a6f9-dd19-4e9f-bc70-4022a573736f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:17.520750 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0a6f9-dd19-4e9f-bc70-4022a573736f None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:17.521038 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0a6f9-dd19-4e9f-bc70-4022a573736f None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:17.521309 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0a6f9-dd19-4e9f-bc70-4022a573736f None admin] PATH_INFO: `/v3/services` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:17.522340 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e0a6f9-dd19-4e9f-bc70-4022a573736f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:17.522669 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e0a6f9-dd19-4e9f-bc70-4022a573736f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:17.524495 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e0a6f9-dd19-4e9f-bc70-4022a573736f None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:17.534711 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 464/926] 10.222.0.21 () {56 vars in 1126 bytes} [Mon Feb 28 10:19:17 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:17.536174 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628d655-1fa8-485d-b88e-e88a547542f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:17.537274 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0a6f9-dd19-4e9f-bc70-4022a573736f None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:17.538299 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628d655-1fa8-485d-b88e-e88a547542f9 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:17.539131 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628d655-1fa8-485d-b88e-e88a547542f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:17.539424 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628d655-1fa8-485d-b88e-e88a547542f9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:17.540233 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628d655-1fa8-485d-b88e-e88a547542f9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:17.541651 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628d655-1fa8-485d-b88e-e88a547542f9 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:17.553963 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-a628d655-1fa8-485d-b88e-e88a547542f9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 28 10:19:17.560508 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 463/927] 10.222.0.21 () {56 vars in 1114 bytes} [Mon Feb 28 10:19:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:19:17.561985 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628d655-1fa8-485d-b88e-e88a547542f9 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:17.665441 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0a6f9-dd19-4e9f-bc70-4022a573736f None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:17.685943 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628d655-1fa8-485d-b88e-e88a547542f9 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:17.707660 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2ab14-b630-4113-9a94-46d1b55fac72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:17.708316 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2ab14-b630-4113-9a94-46d1b55fac72 None admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:17.708594 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2ab14-b630-4113-9a94-46d1b55fac72 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:17.708870 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2ab14-b630-4113-9a94-46d1b55fac72 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:17.709604 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2ab14-b630-4113-9a94-46d1b55fac72 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:17.711009 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2ab14-b630-4113-9a94-46d1b55fac72 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:17.725596 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088731fb-8b66-4b7b-af62-750fa8d55445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:17.726263 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088731fb-8b66-4b7b-af62-750fa8d55445 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:17.726544 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088731fb-8b66-4b7b-af62-750fa8d55445 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:17.726902 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088731fb-8b66-4b7b-af62-750fa8d55445 None admin] PATH_INFO: `/v3/services` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:17.727603 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088731fb-8b66-4b7b-af62-750fa8d55445 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:17.727909 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088731fb-8b66-4b7b-af62-750fa8d55445 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:17.729282 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088731fb-8b66-4b7b-af62-750fa8d55445 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:17.733712 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 465/928] 10.222.0.21 () {60 vars in 1144 bytes} [Mon Feb 28 10:19:17 2022] POST /identity/v3/endpoints => generated 347 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:19:17.744326 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 464/929] 10.222.0.21 () {56 vars in 1114 bytes} [Mon Feb 28 10:19:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:19:17.755162 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2ab14-b630-4113-9a94-46d1b55fac72 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:17.876500 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2ab14-b630-4113-9a94-46d1b55fac72 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:17.912687 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c6c63-fe32-432a-b493-8d4d43c28543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:17.913363 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c6c63-fe32-432a-b493-8d4d43c28543 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:17.913645 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c6c63-fe32-432a-b493-8d4d43c28543 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:17.913921 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c6c63-fe32-432a-b493-8d4d43c28543 None admin] PATH_INFO: `/v3/services` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:17.914649 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c6c63-fe32-432a-b493-8d4d43c28543 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:17.914966 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c6c63-fe32-432a-b493-8d4d43c28543 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:17.916349 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c6c63-fe32-432a-b493-8d4d43c28543 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:17.920516 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5e127-57ce-45f1-a158-f1023bdb0e15 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:17.920805 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5e127-57ce-45f1-a158-f1023bdb0e15 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:17.921080 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5e127-57ce-45f1-a158-f1023bdb0e15 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:17.922087 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 466/930] 10.222.0.21 () {56 vars in 1114 bytes} [Mon Feb 28 10:19:17 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:17.923523 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 465/931] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:19:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:19:17.927576 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c6c63-fe32-432a-b493-8d4d43c28543 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:17.929044 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4140a4b-c987-480a-9bef-259fe4a13ca9 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:17.929335 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4140a4b-c987-480a-9bef-259fe4a13ca9 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:17.929614 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4140a4b-c987-480a-9bef-259fe4a13ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:17.951076 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-f4140a4b-c987-480a-9bef-259fe4a13ca9 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:19:17.952903 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-f4140a4b-c987-480a-9bef-259fe4a13ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:19:18.036188 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 466/932] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:19:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:19:18.058521 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c6c63-fe32-432a-b493-8d4d43c28543 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:18.059613 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4140a4b-c987-480a-9bef-259fe4a13ca9 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:18.105779 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d673fa2-2e57-4437-8a0b-f7fca697efe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:18.107162 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d673fa2-2e57-4437-8a0b-f7fca697efe0 None admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:18.107784 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d673fa2-2e57-4437-8a0b-f7fca697efe0 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:18.108274 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d673fa2-2e57-4437-8a0b-f7fca697efe0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:18.109551 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d673fa2-2e57-4437-8a0b-f7fca697efe0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:18.111159 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d673fa2-2e57-4437-8a0b-f7fca697efe0 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:18.135944 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 467/933] 10.222.0.21 () {60 vars in 1144 bytes} [Mon Feb 28 10:19:17 2022] POST /identity/v3/endpoints => generated 346 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:19:18.170570 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4140a4b-c987-480a-9bef-259fe4a13ca9 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:18.220243 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8849f-af44-4dd9-876e-268eede62a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:18.221113 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8849f-af44-4dd9-876e-268eede62a3c None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:18.221448 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8849f-af44-4dd9-876e-268eede62a3c None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:18.221756 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8849f-af44-4dd9-876e-268eede62a3c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:18.234335 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d8849f-af44-4dd9-876e-268eede62a3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:19:18.241961 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-94d8849f-af44-4dd9-876e-268eede62a3c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 28 10:19:18.243656 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 467/934] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 10:19:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:19:18.249764 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d673fa2-2e57-4437-8a0b-f7fca697efe0 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:18.355579 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d673fa2-2e57-4437-8a0b-f7fca697efe0 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:18.389023 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0347cb7-f00c-46d6-8ac0-29ff836d29ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:18.390055 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0347cb7-f00c-46d6-8ac0-29ff836d29ba None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:18.390565 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0347cb7-f00c-46d6-8ac0-29ff836d29ba None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:18.391058 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0347cb7-f00c-46d6-8ac0-29ff836d29ba None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:18.391998 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0347cb7-f00c-46d6-8ac0-29ff836d29ba None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:18.392504 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0347cb7-f00c-46d6-8ac0-29ff836d29ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:18.394056 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0347cb7-f00c-46d6-8ac0-29ff836d29ba None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:18.406699 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 468/935] 10.222.0.21 () {56 vars in 1115 bytes} [Mon Feb 28 10:19:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:18.409194 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8849f-af44-4dd9-876e-268eede62a3c None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:18.509097 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8849f-af44-4dd9-876e-268eede62a3c None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:18.544851 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3729f4a-502a-43d2-9261-37ad0cef396f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:18.546094 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3729f4a-502a-43d2-9261-37ad0cef396f None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:18.546578 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3729f4a-502a-43d2-9261-37ad0cef396f None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:18.547065 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3729f4a-502a-43d2-9261-37ad0cef396f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:18.561611 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3729f4a-502a-43d2-9261-37ad0cef396f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:18.563438 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3729f4a-502a-43d2-9261-37ad0cef396f None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:18.580654 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-f3729f4a-502a-43d2-9261-37ad0cef396f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:19:18.586545 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 468/936] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:19:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:18.588466 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0347cb7-f00c-46d6-8ac0-29ff836d29ba None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:18.693617 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0347cb7-f00c-46d6-8ac0-29ff836d29ba None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:18.727968 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3128b4-6290-4fa9-8dde-5d05471c6558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:18.728629 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3128b4-6290-4fa9-8dde-5d05471c6558 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:18.728910 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3128b4-6290-4fa9-8dde-5d05471c6558 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:18.729186 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3128b4-6290-4fa9-8dde-5d05471c6558 None admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:18.729898 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3128b4-6290-4fa9-8dde-5d05471c6558 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:18.730204 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3128b4-6290-4fa9-8dde-5d05471c6558 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:18.731651 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3128b4-6290-4fa9-8dde-5d05471c6558 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:18.743927 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 469/937] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:18.750148 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3729f4a-502a-43d2-9261-37ad0cef396f None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:18.848936 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3729f4a-502a-43d2-9261-37ad0cef396f None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:18.883805 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57347a11-206d-4394-9075-1a5770bbaee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:18.884618 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57347a11-206d-4394-9075-1a5770bbaee1 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:18.884893 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57347a11-206d-4394-9075-1a5770bbaee1 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:18.885163 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57347a11-206d-4394-9075-1a5770bbaee1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:18.893752 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57347a11-206d-4394-9075-1a5770bbaee1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:18.895219 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57347a11-206d-4394-9075-1a5770bbaee1 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:18.909955 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-57347a11-206d-4394-9075-1a5770bbaee1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 28 10:19:18.916152 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 469/938] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Feb 28 10:19:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:18.917628 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3128b4-6290-4fa9-8dde-5d05471c6558 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:19.024835 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3128b4-6290-4fa9-8dde-5d05471c6558 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:19.060906 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8806af3f-2cfa-458f-b20f-d8cfaa9f8006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:19.062356 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806af3f-2cfa-458f-b20f-d8cfaa9f8006 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:19.062876 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806af3f-2cfa-458f-b20f-d8cfaa9f8006 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:19.063368 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806af3f-2cfa-458f-b20f-d8cfaa9f8006 None admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:19.064409 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8806af3f-2cfa-458f-b20f-d8cfaa9f8006 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:19.064932 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8806af3f-2cfa-458f-b20f-d8cfaa9f8006 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:19.066553 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8806af3f-2cfa-458f-b20f-d8cfaa9f8006 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:19.084959 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 470/939] 10.222.0.21 () {56 vars in 1149 bytes} [Mon Feb 28 10:19:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:19.094622 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57347a11-206d-4394-9075-1a5770bbaee1 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:19.189947 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57347a11-206d-4394-9075-1a5770bbaee1 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:19.224486 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136c9822-57a2-4e8f-8ac6-42520b18f631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:19.225273 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c9822-57a2-4e8f-8ac6-42520b18f631 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:19.225552 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c9822-57a2-4e8f-8ac6-42520b18f631 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:19.225820 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c9822-57a2-4e8f-8ac6-42520b18f631 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:19.237144 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136c9822-57a2-4e8f-8ac6-42520b18f631 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:19.238574 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136c9822-57a2-4e8f-8ac6-42520b18f631 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:19.255118 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-136c9822-57a2-4e8f-8ac6-42520b18f631 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:19:19.261033 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 470/940] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:19:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:19.262941 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8806af3f-2cfa-458f-b20f-d8cfaa9f8006 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:19.303345 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109fd5b-d999-432b-8d47-1c8d20752bb5 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:19.303700 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109fd5b-d999-432b-8d47-1c8d20752bb5 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:19.303878 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109fd5b-d999-432b-8d47-1c8d20752bb5 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:19.306034 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 471/941] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:19:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:19:19.312524 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d871b-7f62-4926-8ff6-b8335f2750fa None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:19.312930 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d871b-7f62-4926-8ff6-b8335f2750fa None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:19.313299 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d871b-7f62-4926-8ff6-b8335f2750fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:19.330228 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-3b7d871b-7f62-4926-8ff6-b8335f2750fa None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:19:19.331576 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-3b7d871b-7f62-4926-8ff6-b8335f2750fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:19:19.371435 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8806af3f-2cfa-458f-b20f-d8cfaa9f8006 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:19.406362 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 472/942] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:19:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:19:19.414004 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb2e9d-ea1d-4ac0-ba8d-9ae5967c9898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:19.414651 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb2e9d-ea1d-4ac0-ba8d-9ae5967c9898 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:19.414931 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb2e9d-ea1d-4ac0-ba8d-9ae5967c9898 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:19.415202 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb2e9d-ea1d-4ac0-ba8d-9ae5967c9898 None admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:19.415931 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb2e9d-ea1d-4ac0-ba8d-9ae5967c9898 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:19.416208 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb2e9d-ea1d-4ac0-ba8d-9ae5967c9898 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:19.417558 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb2e9d-ea1d-4ac0-ba8d-9ae5967c9898 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:19.426042 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d871b-7f62-4926-8ff6-b8335f2750fa None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:19.434270 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 471/943] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:19:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:19.440465 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb2e9d-ea1d-4ac0-ba8d-9ae5967c9898 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:19.552533 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d871b-7f62-4926-8ff6-b8335f2750fa None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:19.554648 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb2e9d-ea1d-4ac0-ba8d-9ae5967c9898 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:19.589224 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a9d28-46cb-43a9-b0ef-3555d8b93e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:19.590389 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a9d28-46cb-43a9-b0ef-3555d8b93e59 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:19.590938 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a9d28-46cb-43a9-b0ef-3555d8b93e59 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:19.591565 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a9d28-46cb-43a9-b0ef-3555d8b93e59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:19.595213 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006bae1-a879-4c91-8480-e454f3140d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:19.596079 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006bae1-a879-4c91-8480-e454f3140d51 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:19.596447 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006bae1-a879-4c91-8480-e454f3140d51 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:19.596788 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006bae1-a879-4c91-8480-e454f3140d51 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:19.597497 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f006bae1-a879-4c91-8480-e454f3140d51 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:19.599087 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f006bae1-a879-4c91-8480-e454f3140d51 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:19.600331 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a9d28-46cb-43a9-b0ef-3555d8b93e59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:19.601908 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a9d28-46cb-43a9-b0ef-3555d8b93e59 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:19.612086 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-f006bae1-a879-4c91-8480-e454f3140d51 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 28 10:19:19.614629 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 473/944] 10.222.0.21 () {56 vars in 1126 bytes} [Mon Feb 28 10:19:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:19.620730 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-dd3a9d28-46cb-43a9-b0ef-3555d8b93e59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:19:19.622429 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006bae1-a879-4c91-8480-e454f3140d51 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:19.626990 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 472/945] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:19:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:19.628254 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a9d28-46cb-43a9-b0ef-3555d8b93e59 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:19.738770 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006bae1-a879-4c91-8480-e454f3140d51 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:19.739071 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a9d28-46cb-43a9-b0ef-3555d8b93e59 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:19.774442 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a70676-774e-4fd4-8718-344914ae2a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:19.775157 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a70676-774e-4fd4-8718-344914ae2a07 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:19.775432 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a70676-774e-4fd4-8718-344914ae2a07 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:19.775748 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a70676-774e-4fd4-8718-344914ae2a07 None admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:19.776523 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a70676-774e-4fd4-8718-344914ae2a07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:19.776883 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a70676-774e-4fd4-8718-344914ae2a07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:19.778520 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a70676-774e-4fd4-8718-344914ae2a07 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:19.783512 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f2bb0-ad73-42f9-9137-1f511079ec51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:19.784546 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f2bb0-ad73-42f9-9137-1f511079ec51 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:19.785035 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f2bb0-ad73-42f9-9137-1f511079ec51 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:19.785500 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f2bb0-ad73-42f9-9137-1f511079ec51 None admin] PATH_INFO: `/v3/services` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:19.787160 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f2bb0-ad73-42f9-9137-1f511079ec51 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:19.787685 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f2bb0-ad73-42f9-9137-1f511079ec51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:19.790089 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f2bb0-ad73-42f9-9137-1f511079ec51 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:19.801820 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 473/947] 10.222.0.21 () {56 vars in 1148 bytes} [Mon Feb 28 10:19:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:19:19.801820 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a70676-774e-4fd4-8718-344914ae2a07 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:19.802580 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 474/947] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Feb 28 10:19:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:19:19.804791 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f2bb0-ad73-42f9-9137-1f511079ec51 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:19.916778 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f2bb0-ad73-42f9-9137-1f511079ec51 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:19.930265 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a70676-774e-4fd4-8718-344914ae2a07 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:19.956795 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc38d3-0313-4f41-a298-c487b856908f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:19.958305 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc38d3-0313-4f41-a298-c487b856908f None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:19.958786 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc38d3-0313-4f41-a298-c487b856908f None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:19.959199 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc38d3-0313-4f41-a298-c487b856908f None admin] PATH_INFO: `/v3/services` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:19.960475 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacc38d3-0313-4f41-a298-c487b856908f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:19.960928 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacc38d3-0313-4f41-a298-c487b856908f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:19.962845 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacc38d3-0313-4f41-a298-c487b856908f None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:19.968981 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c53554-6955-400a-89db-c73fc686c171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:19.974343 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c53554-6955-400a-89db-c73fc686c171 None admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:19.974343 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c53554-6955-400a-89db-c73fc686c171 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:19.974343 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c53554-6955-400a-89db-c73fc686c171 None admin] PATH_INFO: `/v3/projects/5d1d6f8141924b2d99b766f975a3d43b/users/1c1284bfe6cc43848731ed2b3d9e914b/roles/0abd451d1e894a6b8575ab7e6685f50a` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:19.974716 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 475/948] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Feb 28 10:19:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:19.975921 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc38d3-0313-4f41-a298-c487b856908f None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:19.976674 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c53554-6955-400a-89db-c73fc686c171 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d1d6f8141924b2d99b766f975a3d43b, user_id=1c1284bfe6cc43848731ed2b3d9e914b, role_id=0abd451d1e894a6b8575ab7e6685f50a)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:19.978376 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c53554-6955-400a-89db-c73fc686c171 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:19.993956 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 474/949] 10.222.0.21 () {58 vars in 1439 bytes} [Mon Feb 28 10:19:19 2022] PUT /identity/v3/projects/5d1d6f8141924b2d99b766f975a3d43b/users/1c1284bfe6cc43848731ed2b3d9e914b/roles/0abd451d1e894a6b8575ab7e6685f50a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:19:20.095678 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc38d3-0313-4f41-a298-c487b856908f None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:20.135137 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f47470-18ef-4359-9e67-954e998408cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:20.136105 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f47470-18ef-4359-9e67-954e998408cf None admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:20.136570 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f47470-18ef-4359-9e67-954e998408cf None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:20.137167 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f47470-18ef-4359-9e67-954e998408cf None admin] PATH_INFO: `/v3/endpoints` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:20.138687 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f47470-18ef-4359-9e67-954e998408cf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:20.140304 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f47470-18ef-4359-9e67-954e998408cf None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:20.166961 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 476/950] 10.222.0.21 () {60 vars in 1144 bytes} [Mon Feb 28 10:19:19 2022] POST /identity/v3/endpoints => generated 349 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:19:20.170730 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507bebd-d2d8-4f35-8445-1b44275e984b None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:20.170730 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507bebd-d2d8-4f35-8445-1b44275e984b None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:20.170730 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507bebd-d2d8-4f35-8445-1b44275e984b None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:20.171513 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 475/951] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:19:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:19:20.177735 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01924e4b-6b04-455b-98ee-f08cc579815e None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:20.178303 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01924e4b-6b04-455b-98ee-f08cc579815e None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:20.178756 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01924e4b-6b04-455b-98ee-f08cc579815e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:20.198931 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-01924e4b-6b04-455b-98ee-f08cc579815e None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:19:20.201209 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-01924e4b-6b04-455b-98ee-f08cc579815e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:19:20.287956 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 477/952] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:19:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 10:19:20.311510 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507bebd-d2d8-4f35-8445-1b44275e984b None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:20.419192 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507bebd-d2d8-4f35-8445-1b44275e984b None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:20.453469 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d2c9b-36ef-431b-808e-17c649a8681a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:20.454262 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d2c9b-36ef-431b-808e-17c649a8681a None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:20.454543 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d2c9b-36ef-431b-808e-17c649a8681a None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:20.454840 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d2c9b-36ef-431b-808e-17c649a8681a None admin] PATH_INFO: `/v3/services/compute` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:20.455489 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d2c9b-36ef-431b-808e-17c649a8681a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:20.456865 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d2c9b-36ef-431b-808e-17c649a8681a None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:20.468127 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-cc8d2c9b-36ef-431b-808e-17c649a8681a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 28 10:19:20.469677 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 476/953] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:19:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:20.475541 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01924e4b-6b04-455b-98ee-f08cc579815e None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:20.578906 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01924e4b-6b04-455b-98ee-f08cc579815e None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:20.613366 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744cbd5d-8eab-4d9c-a0c3-aa0a6dacaa0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:20.614312 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744cbd5d-8eab-4d9c-a0c3-aa0a6dacaa0d None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:20.614773 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744cbd5d-8eab-4d9c-a0c3-aa0a6dacaa0d None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:20.615192 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744cbd5d-8eab-4d9c-a0c3-aa0a6dacaa0d None admin] PATH_INFO: `/v3/services` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:20.616027 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744cbd5d-8eab-4d9c-a0c3-aa0a6dacaa0d None admin] RBAC: Adding query filter params (name=compute) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:20.616473 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744cbd5d-8eab-4d9c-a0c3-aa0a6dacaa0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:20.618070 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744cbd5d-8eab-4d9c-a0c3-aa0a6dacaa0d None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:20.623867 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 478/954] 10.222.0.21 () {56 vars in 1112 bytes} [Mon Feb 28 10:19:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:20.629386 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d2c9b-36ef-431b-808e-17c649a8681a None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:20.631958 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc996c-cd59-4a90-aa15-fee2f5e84a25 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:20.632378 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc996c-cd59-4a90-aa15-fee2f5e84a25 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:20.632666 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc996c-cd59-4a90-aa15-fee2f5e84a25 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:20.634523 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 479/955] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:19:20.639426 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b81e1-2e60-4817-9395-ec6b69b373af None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:20.639714 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b81e1-2e60-4817-9395-ec6b69b373af None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:20.639992 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b81e1-2e60-4817-9395-ec6b69b373af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:20.657561 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-739b81e1-2e60-4817-9395-ec6b69b373af None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:19:20.659090 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-739b81e1-2e60-4817-9395-ec6b69b373af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:19:20.731646 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 480/956] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:19:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 10:19:20.749756 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d2c9b-36ef-431b-808e-17c649a8681a None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:20.759412 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b81e1-2e60-4817-9395-ec6b69b373af None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:20.784341 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7803229-141e-4dfb-b405-9bc87378b05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:20.785419 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7803229-141e-4dfb-b405-9bc87378b05d None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:20.785957 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7803229-141e-4dfb-b405-9bc87378b05d None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:20.786449 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7803229-141e-4dfb-b405-9bc87378b05d None admin] PATH_INFO: `/v3/services` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:20.787433 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7803229-141e-4dfb-b405-9bc87378b05d None admin] RBAC: Adding query filter params (type=compute) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:20.787956 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7803229-141e-4dfb-b405-9bc87378b05d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:20.789514 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7803229-141e-4dfb-b405-9bc87378b05d None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:20.795319 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 477/957] 10.222.0.21 () {56 vars in 1112 bytes} [Mon Feb 28 10:19:20 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:20.864272 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b81e1-2e60-4817-9395-ec6b69b373af None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:20.902077 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400ec08-122e-4276-90bc-2f0f323c3da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:20.903338 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400ec08-122e-4276-90bc-2f0f323c3da1 None admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:20.903618 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400ec08-122e-4276-90bc-2f0f323c3da1 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:20.903890 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400ec08-122e-4276-90bc-2f0f323c3da1 None admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:20.904597 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d400ec08-122e-4276-90bc-2f0f323c3da1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:20.906041 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d400ec08-122e-4276-90bc-2f0f323c3da1 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:20.907451 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.common [None req-d400ec08-122e-4276-90bc-2f0f323c3da1 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Feb 28 10:19:20.927075 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.sql.core [None req-d400ec08-122e-4276-90bc-2f0f323c3da1 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Feb 28 10:19:20.927075 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Feb 28 10:19:20.927075 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [parameters: {'id': '1bf2af4031d941f3a7e8f434109ec66e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Feb 28 10:19:20.927075 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79318) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 28 10:19:20.934490 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-d400ec08-122e-4276-90bc-2f0f323c3da1 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1bf2af4031d941f3a7e8f434109ec66e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1bf2af4031d941f3a7e8f434109ec66e. Feb 28 10:19:20.936315 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 481/958] 10.222.0.21 () {60 vars in 1140 bytes} [Mon Feb 28 10:19:20 2022] POST /identity/v3/projects => generated 262 bytes in 177 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:20.942084 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7803229-141e-4dfb-b405-9bc87378b05d None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:21.047987 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7803229-141e-4dfb-b405-9bc87378b05d None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:21.083904 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3c527-281b-42b8-ad0e-32263be4f342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:21.084773 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3c527-281b-42b8-ad0e-32263be4f342 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:21.085061 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3c527-281b-42b8-ad0e-32263be4f342 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:21.085339 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3c527-281b-42b8-ad0e-32263be4f342 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:21.093021 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d3c527-281b-42b8-ad0e-32263be4f342 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:21.094467 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d3c527-281b-42b8-ad0e-32263be4f342 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:21.108482 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-30d3c527-281b-42b8-ad0e-32263be4f342 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:19:21.110058 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 478/959] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:19:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:21.115629 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400ec08-122e-4276-90bc-2f0f323c3da1 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:21.220487 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400ec08-122e-4276-90bc-2f0f323c3da1 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:21.258027 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3e78e-a37c-474f-a0e5-db82c4e74e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:21.259088 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3e78e-a37c-474f-a0e5-db82c4e74e7b None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:21.259573 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3e78e-a37c-474f-a0e5-db82c4e74e7b None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:21.260043 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3e78e-a37c-474f-a0e5-db82c4e74e7b None admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:21.261049 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d3e78e-a37c-474f-a0e5-db82c4e74e7b None admin] RBAC: Adding query filter params (name=service) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:21.261563 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d3e78e-a37c-474f-a0e5-db82c4e74e7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:21.264063 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d3e78e-a37c-474f-a0e5-db82c4e74e7b None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:21.296326 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 482/960] 10.222.0.21 () {56 vars in 1112 bytes} [Mon Feb 28 10:19:21 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:19:22.381501 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a4936-3c0f-4609-8586-06401ad91943 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:22.382024 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a4936-3c0f-4609-8586-06401ad91943 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:22.382024 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a4936-3c0f-4609-8586-06401ad91943 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:22.384057 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 479/961] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:19:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:19:22.390195 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda01cda-7ab5-41d6-86a5-a9ad10526e27 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:22.390651 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda01cda-7ab5-41d6-86a5-a9ad10526e27 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:22.390947 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda01cda-7ab5-41d6-86a5-a9ad10526e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:22.409061 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-bda01cda-7ab5-41d6-86a5-a9ad10526e27 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:19:22.410554 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-bda01cda-7ab5-41d6-86a5-a9ad10526e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:19:22.482715 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 483/962] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:19:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:19:22.502250 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a4936-3c0f-4609-8586-06401ad91943 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:22.605817 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a4936-3c0f-4609-8586-06401ad91943 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:22.641788 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e6f4d-d051-4f51-99d4-1635bad33b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:22.642513 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e6f4d-d051-4f51-99d4-1635bad33b65 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:22.642819 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e6f4d-d051-4f51-99d4-1635bad33b65 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:22.643089 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e6f4d-d051-4f51-99d4-1635bad33b65 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:22.653297 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276dd408-ee26-4969-82c2-ac7ee0b15a76 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:22.653607 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276dd408-ee26-4969-82c2-ac7ee0b15a76 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:22.653899 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276dd408-ee26-4969-82c2-ac7ee0b15a76 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:22.656073 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 484/963] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:19:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:19:22.657851 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e6f4d-d051-4f51-99d4-1635bad33b65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:19:22.664289 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd19a1-c69e-4f7e-b83f-f1d1fa108c17 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:22.664837 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd19a1-c69e-4f7e-b83f-f1d1fa108c17 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:22.665262 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-578e6f4d-d051-4f51-99d4-1635bad33b65 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 28 10:19:22.665541 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd19a1-c69e-4f7e-b83f-f1d1fa108c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:22.670651 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 480/964] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 10:19:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:22.673204 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e6f4d-d051-4f51-99d4-1635bad33b65 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:22.688608 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-48fd19a1-c69e-4f7e-b83f-f1d1fa108c17 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:19:22.690241 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-48fd19a1-c69e-4f7e-b83f-f1d1fa108c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:19:22.768385 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 485/965] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:19:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:19:22.796619 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd19a1-c69e-4f7e-b83f-f1d1fa108c17 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:22.815208 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e6f4d-d051-4f51-99d4-1635bad33b65 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:22.872705 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac016ddb-6cc1-44a4-bde2-d03469a095b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:22.873775 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac016ddb-6cc1-44a4-bde2-d03469a095b7 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:22.874252 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac016ddb-6cc1-44a4-bde2-d03469a095b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:22.874749 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac016ddb-6cc1-44a4-bde2-d03469a095b7 None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:22.875689 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac016ddb-6cc1-44a4-bde2-d03469a095b7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:22.876207 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac016ddb-6cc1-44a4-bde2-d03469a095b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:22.877782 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac016ddb-6cc1-44a4-bde2-d03469a095b7 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:22.894762 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 481/966] 10.222.0.21 () {56 vars in 1115 bytes} [Mon Feb 28 10:19:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:22.896392 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac016ddb-6cc1-44a4-bde2-d03469a095b7 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:22.929649 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd19a1-c69e-4f7e-b83f-f1d1fa108c17 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:22.972470 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e21c95-6b44-453b-b863-25e3bc2ed5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:22.973461 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e21c95-6b44-453b-b863-25e3bc2ed5a2 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:22.973748 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e21c95-6b44-453b-b863-25e3bc2ed5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:22.974107 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e21c95-6b44-453b-b863-25e3bc2ed5a2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:22.975305 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e21c95-6b44-453b-b863-25e3bc2ed5a2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:22.976683 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e21c95-6b44-453b-b863-25e3bc2ed5a2 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:22.993047 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-f3e21c95-6b44-453b-b863-25e3bc2ed5a2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 28 10:19:22.995535 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 486/967] 10.222.0.21 () {56 vars in 1126 bytes} [Mon Feb 28 10:19:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:19:23.005277 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e21c95-6b44-453b-b863-25e3bc2ed5a2 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:23.035422 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac016ddb-6cc1-44a4-bde2-d03469a095b7 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:23.083736 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289354cf-bb12-4e9d-9ff7-dce53de22c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:23.085338 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289354cf-bb12-4e9d-9ff7-dce53de22c1c None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:23.085828 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289354cf-bb12-4e9d-9ff7-dce53de22c1c None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:23.086550 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289354cf-bb12-4e9d-9ff7-dce53de22c1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:23.099773 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289354cf-bb12-4e9d-9ff7-dce53de22c1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:23.103053 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289354cf-bb12-4e9d-9ff7-dce53de22c1c None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:23.123313 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-289354cf-bb12-4e9d-9ff7-dce53de22c1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:19:23.131013 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 482/968] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:19:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:23.132359 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289354cf-bb12-4e9d-9ff7-dce53de22c1c None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:23.140713 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e21c95-6b44-453b-b863-25e3bc2ed5a2 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:23.192669 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b99457-527f-473a-aa01-249457558c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:23.194098 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b99457-527f-473a-aa01-249457558c41 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:23.194531 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b99457-527f-473a-aa01-249457558c41 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:23.194974 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b99457-527f-473a-aa01-249457558c41 None admin] PATH_INFO: `/v3/services` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:23.196089 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b99457-527f-473a-aa01-249457558c41 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:23.196712 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b99457-527f-473a-aa01-249457558c41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:23.199237 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b99457-527f-473a-aa01-249457558c41 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:23.207615 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 487/969] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Feb 28 10:19:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:19:23.214415 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b99457-527f-473a-aa01-249457558c41 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:23.269558 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289354cf-bb12-4e9d-9ff7-dce53de22c1c None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:23.309318 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e497b0-8bd8-433b-9e20-b43b6f849bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:23.309974 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e497b0-8bd8-433b-9e20-b43b6f849bbb None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:23.310254 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e497b0-8bd8-433b-9e20-b43b6f849bbb None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:23.310522 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e497b0-8bd8-433b-9e20-b43b6f849bbb None admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:23.311267 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e497b0-8bd8-433b-9e20-b43b6f849bbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:23.311572 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e497b0-8bd8-433b-9e20-b43b6f849bbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:23.312946 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e497b0-8bd8-433b-9e20-b43b6f849bbb None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:23.328760 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 483/970] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:19:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:23.330488 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1110f6-62a9-42bb-9fe3-8f13a26505ee None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:23.330991 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1110f6-62a9-42bb-9fe3-8f13a26505ee None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:23.331478 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1110f6-62a9-42bb-9fe3-8f13a26505ee None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:23.333748 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 484/971] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:19:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:19:23.334913 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1110f6-62a9-42bb-9fe3-8f13a26505ee None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:23.351438 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b99457-527f-473a-aa01-249457558c41 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:23.395170 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce847455-1955-4882-941d-30f266c13748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:23.396544 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce847455-1955-4882-941d-30f266c13748 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:23.396970 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce847455-1955-4882-941d-30f266c13748 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:23.397381 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce847455-1955-4882-941d-30f266c13748 None admin] PATH_INFO: `/v3/services` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:23.398229 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce847455-1955-4882-941d-30f266c13748 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:23.398525 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce847455-1955-4882-941d-30f266c13748 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:23.400439 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce847455-1955-4882-941d-30f266c13748 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:23.405992 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 488/972] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Feb 28 10:19:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:19:23.412081 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415cef8-796d-43c6-81d7-8ed18e60f3a7 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:23.412367 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415cef8-796d-43c6-81d7-8ed18e60f3a7 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:23.412643 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415cef8-796d-43c6-81d7-8ed18e60f3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:23.430609 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-4415cef8-796d-43c6-81d7-8ed18e60f3a7 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:19:23.431797 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-4415cef8-796d-43c6-81d7-8ed18e60f3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:19:23.448866 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1110f6-62a9-42bb-9fe3-8f13a26505ee None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:23.483512 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9890dc7-357e-4d34-af15-9f716af3bc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:23.484671 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9890dc7-357e-4d34-af15-9f716af3bc3d None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:23.485170 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9890dc7-357e-4d34-af15-9f716af3bc3d None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:23.485614 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9890dc7-357e-4d34-af15-9f716af3bc3d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:23.493066 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9890dc7-357e-4d34-af15-9f716af3bc3d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:23.494723 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9890dc7-357e-4d34-af15-9f716af3bc3d None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:23.508507 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 489/973] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:19:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:19:23.509435 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-e9890dc7-357e-4d34-af15-9f716af3bc3d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 28 10:19:23.509708 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415cef8-796d-43c6-81d7-8ed18e60f3a7 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:23.510784 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 485/974] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Feb 28 10:19:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:23.516992 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9890dc7-357e-4d34-af15-9f716af3bc3d None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:23.618159 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415cef8-796d-43c6-81d7-8ed18e60f3a7 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:23.618493 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9890dc7-357e-4d34-af15-9f716af3bc3d None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:23.652158 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f826a37-54c2-49f8-9010-c5e1c889b7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:23.652581 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68372346-f00c-42e6-a8af-46b028209cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:23.653066 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f826a37-54c2-49f8-9010-c5e1c889b7e8 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:23.653259 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68372346-f00c-42e6-a8af-46b028209cb3 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:23.653362 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f826a37-54c2-49f8-9010-c5e1c889b7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:23.653527 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68372346-f00c-42e6-a8af-46b028209cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:23.653619 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f826a37-54c2-49f8-9010-c5e1c889b7e8 None admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:23.653761 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68372346-f00c-42e6-a8af-46b028209cb3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:23.654399 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f826a37-54c2-49f8-9010-c5e1c889b7e8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:23.654554 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68372346-f00c-42e6-a8af-46b028209cb3 None admin] RBAC: Adding query filter params (interface=admin, service_id=cacb7403ffee4d98acc891f8be0ce76c, region_id=RegionOne) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:23.654744 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f826a37-54c2-49f8-9010-c5e1c889b7e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:23.654881 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68372346-f00c-42e6-a8af-46b028209cb3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:23.656143 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f826a37-54c2-49f8-9010-c5e1c889b7e8 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:23.656444 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68372346-f00c-42e6-a8af-46b028209cb3 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:23.666214 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 490/975] 10.222.0.21 () {56 vars in 1249 bytes} [Mon Feb 28 10:19:23 2022] GET /identity/v3/endpoints?service_id=cacb7403ffee4d98acc891f8be0ce76c&interface=admin®ion_id=RegionOne => generated 193 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:23.666214 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68372346-f00c-42e6-a8af-46b028209cb3 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:23.675196 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 486/976] 10.222.0.21 () {56 vars in 1149 bytes} [Mon Feb 28 10:19:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:19:23.676079 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f826a37-54c2-49f8-9010-c5e1c889b7e8 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:23.766217 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68372346-f00c-42e6-a8af-46b028209cb3 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:23.778867 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f826a37-54c2-49f8-9010-c5e1c889b7e8 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:23.798486 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af2865-f8d6-4f11-8dab-d1020c334e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:23.799188 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af2865-f8d6-4f11-8dab-d1020c334e48 None admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:23.799467 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af2865-f8d6-4f11-8dab-d1020c334e48 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:23.799737 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af2865-f8d6-4f11-8dab-d1020c334e48 None admin] PATH_INFO: `/v3/services` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:23.800451 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af2865-f8d6-4f11-8dab-d1020c334e48 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:23.801816 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af2865-f8d6-4f11-8dab-d1020c334e48 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:23.813743 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b3a8a-618b-4d12-a02f-334baab8bacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:23.814396 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b3a8a-618b-4d12-a02f-334baab8bacc None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:23.814715 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b3a8a-618b-4d12-a02f-334baab8bacc None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:23.814989 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b3a8a-618b-4d12-a02f-334baab8bacc None admin] PATH_INFO: `/v3/services` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:23.815663 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b3a8a-618b-4d12-a02f-334baab8bacc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:23.817018 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b3a8a-618b-4d12-a02f-334baab8bacc None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:23.817520 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 491/977] 10.222.0.21 () {60 vars in 1141 bytes} [Mon Feb 28 10:19:23 2022] POST /identity/v3/services => generated 242 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:19:23.818322 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af2865-f8d6-4f11-8dab-d1020c334e48 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:23.823603 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 487/978] 10.222.0.21 () {56 vars in 1087 bytes} [Mon Feb 28 10:19:23 2022] GET /identity/v3/services => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:19:23.825027 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86cc01-d6ca-4a45-abcb-d395c1f4f108 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:23.825295 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86cc01-d6ca-4a45-abcb-d395c1f4f108 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:23.825668 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86cc01-d6ca-4a45-abcb-d395c1f4f108 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:23.827566 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 488/979] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:19:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:19:23.833581 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5cffa-258d-4744-8c4a-7778e668c2bd None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:23.833928 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5cffa-258d-4744-8c4a-7778e668c2bd None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:23.834139 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5cffa-258d-4744-8c4a-7778e668c2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:23.856618 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-19c5cffa-258d-4744-8c4a-7778e668c2bd None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:19:23.857923 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-19c5cffa-258d-4744-8c4a-7778e668c2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:19:23.955817 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 489/980] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:19:23 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:19:23.970229 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af2865-f8d6-4f11-8dab-d1020c334e48 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:23.981371 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5cffa-258d-4744-8c4a-7778e668c2bd None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:24.013342 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1239477-24a2-401a-a8ce-2b5334f233a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:24.014012 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1239477-24a2-401a-a8ce-2b5334f233a6 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:24.014289 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1239477-24a2-401a-a8ce-2b5334f233a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:24.014557 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1239477-24a2-401a-a8ce-2b5334f233a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:24.091852 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1239477-24a2-401a-a8ce-2b5334f233a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:24.093291 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1239477-24a2-401a-a8ce-2b5334f233a6 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:24.116281 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5cffa-258d-4744-8c4a-7778e668c2bd None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:24.156848 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266c69c-1564-43dd-aff7-6bedf0ce3c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:24.157520 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266c69c-1564-43dd-aff7-6bedf0ce3c59 None admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:24.157799 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266c69c-1564-43dd-aff7-6bedf0ce3c59 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:24.158069 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266c69c-1564-43dd-aff7-6bedf0ce3c59 None admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:24.158805 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5266c69c-1564-43dd-aff7-6bedf0ce3c59 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:24.160239 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5266c69c-1564-43dd-aff7-6bedf0ce3c59 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:24.161542 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.common [None req-5266c69c-1564-43dd-aff7-6bedf0ce3c59 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Feb 28 10:19:24.177195 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.sql.core [None req-5266c69c-1564-43dd-aff7-6bedf0ce3c59 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Feb 28 10:19:24.177195 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Feb 28 10:19:24.177195 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [parameters: {'user_id': '24a3889fc10647c68e94e6f2f19dc94b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Feb 28 10:19:24.177195 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79319) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 28 10:19:24.192642 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-5266c69c-1564-43dd-aff7-6bedf0ce3c59 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Feb 28 10:19:24.193201 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 492/981] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:19:23 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 10:19:24.194050 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 490/982] 10.222.0.21 () {60 vars in 1131 bytes} [Mon Feb 28 10:19:23 2022] POST /identity/v3/users => generated 160 bytes in 213 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:19:24.199918 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1239477-24a2-401a-a8ce-2b5334f233a6 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:24.200229 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266c69c-1564-43dd-aff7-6bedf0ce3c59 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:24.301016 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1239477-24a2-401a-a8ce-2b5334f233a6 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:24.302581 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266c69c-1564-43dd-aff7-6bedf0ce3c59 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:24.334956 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d1d30-3f79-4b4b-953e-9cf00c76f00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:24.335916 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d1d30-3f79-4b4b-953e-9cf00c76f00b None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:24.336193 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d1d30-3f79-4b4b-953e-9cf00c76f00b None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:24.336457 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d1d30-3f79-4b4b-953e-9cf00c76f00b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:24.337013 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef84177-e5a2-4f31-9c04-ca652e62e046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:24.337791 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef84177-e5a2-4f31-9c04-ca652e62e046 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:24.338075 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef84177-e5a2-4f31-9c04-ca652e62e046 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:24.338393 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef84177-e5a2-4f31-9c04-ca652e62e046 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:24.344664 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d1d30-3f79-4b4b-953e-9cf00c76f00b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:24.346443 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d1d30-3f79-4b4b-953e-9cf00c76f00b None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:24.349447 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef84177-e5a2-4f31-9c04-ca652e62e046 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:24.351128 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef84177-e5a2-4f31-9c04-ca652e62e046 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:24.362893 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-c01d1d30-3f79-4b4b-953e-9cf00c76f00b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 28 10:19:24.367348 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-1ef84177-e5a2-4f31-9c04-ca652e62e046 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:19:24.368764 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 493/984] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:19:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:24.369685 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d1d30-3f79-4b4b-953e-9cf00c76f00b None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:24.373311 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 491/984] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:19:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:19:24.374146 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef84177-e5a2-4f31-9c04-ca652e62e046 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:24.485092 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef84177-e5a2-4f31-9c04-ca652e62e046 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:24.491168 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d1d30-3f79-4b4b-953e-9cf00c76f00b None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:24.519246 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34340b0-5b84-4e11-a935-b8e0b9a0e28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:24.519952 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34340b0-5b84-4e11-a935-b8e0b9a0e28d None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:24.520239 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34340b0-5b84-4e11-a935-b8e0b9a0e28d None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:24.520517 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34340b0-5b84-4e11-a935-b8e0b9a0e28d None admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:24.521229 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34340b0-5b84-4e11-a935-b8e0b9a0e28d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:24.521535 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34340b0-5b84-4e11-a935-b8e0b9a0e28d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:24.522949 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34340b0-5b84-4e11-a935-b8e0b9a0e28d None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:24.531871 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c258eb6-37ad-4c8c-9dec-aadc34561412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:24.532965 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c258eb6-37ad-4c8c-9dec-aadc34561412 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:24.533250 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c258eb6-37ad-4c8c-9dec-aadc34561412 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:24.533526 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c258eb6-37ad-4c8c-9dec-aadc34561412 None admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:24.534589 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c258eb6-37ad-4c8c-9dec-aadc34561412 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:24.534923 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c258eb6-37ad-4c8c-9dec-aadc34561412 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:24.536567 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c258eb6-37ad-4c8c-9dec-aadc34561412 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:24.544443 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 492/985] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:19:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:24.545807 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34340b0-5b84-4e11-a935-b8e0b9a0e28d None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:24.601053 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 494/986] 10.222.0.21 () {56 vars in 1101 bytes} [Mon Feb 28 10:19:24 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:24.655220 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34340b0-5b84-4e11-a935-b8e0b9a0e28d None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:24.697658 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffdd92d-ce3b-4bca-b5b5-47d3b9a7293d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:24.698783 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffdd92d-ce3b-4bca-b5b5-47d3b9a7293d None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:24.699066 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffdd92d-ce3b-4bca-b5b5-47d3b9a7293d None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:24.700200 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffdd92d-ce3b-4bca-b5b5-47d3b9a7293d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:24.707761 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffdd92d-ce3b-4bca-b5b5-47d3b9a7293d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:24.709258 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffdd92d-ce3b-4bca-b5b5-47d3b9a7293d None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:24.723949 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-dffdd92d-ce3b-4bca-b5b5-47d3b9a7293d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:19:24.725579 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 493/987] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:19:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:24.731861 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c258eb6-37ad-4c8c-9dec-aadc34561412 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:24.844732 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c258eb6-37ad-4c8c-9dec-aadc34561412 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:24.880814 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe5c424-4897-44e3-beda-cf6fd6523a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:24.881530 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5c424-4897-44e3-beda-cf6fd6523a3c None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:24.881817 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5c424-4897-44e3-beda-cf6fd6523a3c None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:24.882089 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5c424-4897-44e3-beda-cf6fd6523a3c None admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:24.882899 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe5c424-4897-44e3-beda-cf6fd6523a3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:24.883208 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe5c424-4897-44e3-beda-cf6fd6523a3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:24.884643 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe5c424-4897-44e3-beda-cf6fd6523a3c None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:24.897747 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 495/988] 10.222.0.21 () {56 vars in 1148 bytes} [Mon Feb 28 10:19:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:24.904422 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffdd92d-ce3b-4bca-b5b5-47d3b9a7293d None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:25.002566 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffdd92d-ce3b-4bca-b5b5-47d3b9a7293d None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:25.037043 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d064483-bc12-448f-ab93-4d498f15c7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:25.037692 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d064483-bc12-448f-ab93-4d498f15c7aa None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:25.037973 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d064483-bc12-448f-ab93-4d498f15c7aa None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:25.038248 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d064483-bc12-448f-ab93-4d498f15c7aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:25.039101 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d064483-bc12-448f-ab93-4d498f15c7aa None admin] RBAC: Adding query filter params (role.id=0abd451d1e894a6b8575ab7e6685f50a, scope.project.id=5d1d6f8141924b2d99b766f975a3d43b, user.id=1c1284bfe6cc43848731ed2b3d9e914b) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:25.039411 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d064483-bc12-448f-ab93-4d498f15c7aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:25.040837 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d064483-bc12-448f-ab93-4d498f15c7aa None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:25.047282 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 494/989] 10.222.0.21 () {56 vars in 1374 bytes} [Mon Feb 28 10:19:24 2022] GET /identity/v3/role_assignments?user.id=1c1284bfe6cc43848731ed2b3d9e914b&scope.project.id=5d1d6f8141924b2d99b766f975a3d43b&role.id=0abd451d1e894a6b8575ab7e6685f50a => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:26.195121 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0151e3-9d3f-49df-ad9e-a069664a8890 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:26.203703 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0151e3-9d3f-49df-ad9e-a069664a8890 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:26.203703 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0151e3-9d3f-49df-ad9e-a069664a8890 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:26.203703 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 496/990] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:19:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:19:26.206560 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193e4bb-2504-4b68-bb46-3c7b3c924ac0 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:26.207417 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193e4bb-2504-4b68-bb46-3c7b3c924ac0 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:26.207901 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193e4bb-2504-4b68-bb46-3c7b3c924ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:26.226878 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-7193e4bb-2504-4b68-bb46-3c7b3c924ac0 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:19:26.228813 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-7193e4bb-2504-4b68-bb46-3c7b3c924ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:19:26.249962 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c6c0d-1e45-4a3c-aebd-6e3070d372fe None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:26.250737 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c6c0d-1e45-4a3c-aebd-6e3070d372fe None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:26.250737 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c6c0d-1e45-4a3c-aebd-6e3070d372fe None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:26.252313 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 497/991] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:19:26.257458 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085411ff-fa60-4e5f-85a0-4e676e9b7639 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:26.257747 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085411ff-fa60-4e5f-85a0-4e676e9b7639 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:26.258022 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085411ff-fa60-4e5f-85a0-4e676e9b7639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:26.274837 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-085411ff-fa60-4e5f-85a0-4e676e9b7639 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:19:26.276017 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-085411ff-fa60-4e5f-85a0-4e676e9b7639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:19:26.299077 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 495/992] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:19:26 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:19:26.321549 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193e4bb-2504-4b68-bb46-3c7b3c924ac0 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:26.344974 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 498/993] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:19:26 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 10:19:26.368647 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085411ff-fa60-4e5f-85a0-4e676e9b7639 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:26.416689 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193e4bb-2504-4b68-bb46-3c7b3c924ac0 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:26.449552 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281e134-74b5-4637-9d19-2d70a1fa0661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:26.450382 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281e134-74b5-4637-9d19-2d70a1fa0661 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:26.450687 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281e134-74b5-4637-9d19-2d70a1fa0661 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:26.450963 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281e134-74b5-4637-9d19-2d70a1fa0661 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:26.451605 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1281e134-74b5-4637-9d19-2d70a1fa0661 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:26.452963 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1281e134-74b5-4637-9d19-2d70a1fa0661 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:26.463658 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-1281e134-74b5-4637-9d19-2d70a1fa0661 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 28 10:19:26.470250 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 496/994] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:19:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:19:26.470407 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085411ff-fa60-4e5f-85a0-4e676e9b7639 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:26.471443 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281e134-74b5-4637-9d19-2d70a1fa0661 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:26.498709 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a60caa9-56ab-4988-a5a0-99f2fd3199a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:26.499511 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60caa9-56ab-4988-a5a0-99f2fd3199a4 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:26.499781 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60caa9-56ab-4988-a5a0-99f2fd3199a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:26.500061 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60caa9-56ab-4988-a5a0-99f2fd3199a4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:26.500705 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a60caa9-56ab-4988-a5a0-99f2fd3199a4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:26.502067 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a60caa9-56ab-4988-a5a0-99f2fd3199a4 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:26.513666 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-6a60caa9-56ab-4988-a5a0-99f2fd3199a4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 28 10:19:26.515013 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 499/995] 10.222.0.21 () {56 vars in 1126 bytes} [Mon Feb 28 10:19:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:19:26.520679 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a60caa9-56ab-4988-a5a0-99f2fd3199a4 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:26.569888 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281e134-74b5-4637-9d19-2d70a1fa0661 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:26.605006 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0a73d-7d86-4ed1-ac76-e581b46f7c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:26.605694 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0a73d-7d86-4ed1-ac76-e581b46f7c10 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:26.606389 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0a73d-7d86-4ed1-ac76-e581b46f7c10 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:26.606699 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0a73d-7d86-4ed1-ac76-e581b46f7c10 None admin] PATH_INFO: `/v3/services` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:26.607680 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd0a73d-7d86-4ed1-ac76-e581b46f7c10 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:26.607990 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd0a73d-7d86-4ed1-ac76-e581b46f7c10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:26.609867 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd0a73d-7d86-4ed1-ac76-e581b46f7c10 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:26.620767 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 497/996] 10.222.0.21 () {56 vars in 1112 bytes} [Mon Feb 28 10:19:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:19:26.620924 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a60caa9-56ab-4988-a5a0-99f2fd3199a4 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:26.621858 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0a73d-7d86-4ed1-ac76-e581b46f7c10 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:26.651283 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441060a-0278-45ee-8699-21cbb5e65f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:26.652119 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441060a-0278-45ee-8699-21cbb5e65f29 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:26.653456 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441060a-0278-45ee-8699-21cbb5e65f29 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:26.653879 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441060a-0278-45ee-8699-21cbb5e65f29 None admin] PATH_INFO: `/v3/services` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:26.654816 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441060a-0278-45ee-8699-21cbb5e65f29 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:26.655297 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441060a-0278-45ee-8699-21cbb5e65f29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:26.657368 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441060a-0278-45ee-8699-21cbb5e65f29 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:26.667688 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 500/997] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Feb 28 10:19:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:19:26.669723 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441060a-0278-45ee-8699-21cbb5e65f29 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:26.725277 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0a73d-7d86-4ed1-ac76-e581b46f7c10 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:26.765146 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27031d83-967f-4afc-acb9-270a267a8fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:26.765811 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27031d83-967f-4afc-acb9-270a267a8fee None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:26.766099 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27031d83-967f-4afc-acb9-270a267a8fee None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:26.766374 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27031d83-967f-4afc-acb9-270a267a8fee None admin] PATH_INFO: `/v3/services` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:26.767534 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27031d83-967f-4afc-acb9-270a267a8fee None admin] RBAC: Adding query filter params (type=compute) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:26.767844 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27031d83-967f-4afc-acb9-270a267a8fee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:26.769675 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27031d83-967f-4afc-acb9-270a267a8fee None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:26.781113 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 498/998] 10.222.0.21 () {56 vars in 1112 bytes} [Mon Feb 28 10:19:26 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:26.781290 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441060a-0278-45ee-8699-21cbb5e65f29 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:26.782707 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27031d83-967f-4afc-acb9-270a267a8fee None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:26.813399 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fed315-bb4f-4302-a6c1-89641220ed0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:26.814062 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fed315-bb4f-4302-a6c1-89641220ed0a None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:26.814349 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fed315-bb4f-4302-a6c1-89641220ed0a None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:26.814766 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fed315-bb4f-4302-a6c1-89641220ed0a None admin] PATH_INFO: `/v3/services` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:26.815467 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fed315-bb4f-4302-a6c1-89641220ed0a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:26.815771 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fed315-bb4f-4302-a6c1-89641220ed0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:26.817135 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fed315-bb4f-4302-a6c1-89641220ed0a None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:26.822039 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 501/999] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Feb 28 10:19:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:26.827877 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fed315-bb4f-4302-a6c1-89641220ed0a None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:26.888628 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27031d83-967f-4afc-acb9-270a267a8fee None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:26.928053 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8851d0d-3462-466c-9d87-53beff47e2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:26.928867 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8851d0d-3462-466c-9d87-53beff47e2e5 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:26.929479 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8851d0d-3462-466c-9d87-53beff47e2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:26.929759 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8851d0d-3462-466c-9d87-53beff47e2e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:26.930726 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8851d0d-3462-466c-9d87-53beff47e2e5 None admin] RBAC: Adding query filter params (interface=public, service_id=e727ef011ceb4713ad1ce4ed6dae1a51, region_id=RegionOne) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:26.931039 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8851d0d-3462-466c-9d87-53beff47e2e5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:26.932410 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8851d0d-3462-466c-9d87-53beff47e2e5 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:26.937954 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fed315-bb4f-4302-a6c1-89641220ed0a None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:26.942665 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 499/1000] 10.222.0.21 () {56 vars in 1251 bytes} [Mon Feb 28 10:19:26 2022] GET /identity/v3/endpoints?service_id=e727ef011ceb4713ad1ce4ed6dae1a51&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:26.943734 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8851d0d-3462-466c-9d87-53beff47e2e5 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:26.972334 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd868b8b-9430-4716-b04e-ef8e1be2d1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:26.972985 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd868b8b-9430-4716-b04e-ef8e1be2d1c1 None admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:26.973262 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd868b8b-9430-4716-b04e-ef8e1be2d1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:26.973544 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd868b8b-9430-4716-b04e-ef8e1be2d1c1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:26.974265 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd868b8b-9430-4716-b04e-ef8e1be2d1c1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:26.975717 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd868b8b-9430-4716-b04e-ef8e1be2d1c1 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:26.998634 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 502/1001] 10.222.0.21 () {60 vars in 1144 bytes} [Mon Feb 28 10:19:26 2022] POST /identity/v3/endpoints => generated 325 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:19:27.055749 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8851d0d-3462-466c-9d87-53beff47e2e5 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:27.103072 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c412571-73d3-4ed7-be8c-6a88e4e46950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:27.103786 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c412571-73d3-4ed7-be8c-6a88e4e46950 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:27.104073 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c412571-73d3-4ed7-be8c-6a88e4e46950 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:27.104346 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c412571-73d3-4ed7-be8c-6a88e4e46950 None admin] PATH_INFO: `/v3/services` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:27.105024 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c412571-73d3-4ed7-be8c-6a88e4e46950 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:27.106496 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c412571-73d3-4ed7-be8c-6a88e4e46950 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:27.114152 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 500/1002] 10.222.0.21 () {56 vars in 1087 bytes} [Mon Feb 28 10:19:26 2022] GET /identity/v3/services => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:19:27.450097 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd6db0-8ba0-4898-a69f-1d58f2e6148a None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:27.450675 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd6db0-8ba0-4898-a69f-1d58f2e6148a None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:27.450675 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd6db0-8ba0-4898-a69f-1d58f2e6148a None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:27.452578 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 503/1003] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:19:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:19:27.457628 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5812a-1039-4f7e-9510-03a43b0ee6a8 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:27.458014 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5812a-1039-4f7e-9510-03a43b0ee6a8 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:27.458206 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5812a-1039-4f7e-9510-03a43b0ee6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:27.474792 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-d5b5812a-1039-4f7e-9510-03a43b0ee6a8 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:19:27.475966 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-d5b5812a-1039-4f7e-9510-03a43b0ee6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:19:27.541695 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 501/1004] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:19:27 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:19:27.563970 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd6db0-8ba0-4898-a69f-1d58f2e6148a None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:27.663381 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd6db0-8ba0-4898-a69f-1d58f2e6148a None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:27.696408 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd9c57-c51c-4b99-b984-fb480040e427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:27.697217 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd9c57-c51c-4b99-b984-fb480040e427 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:27.697494 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd9c57-c51c-4b99-b984-fb480040e427 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:27.697761 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd9c57-c51c-4b99-b984-fb480040e427 None admin] PATH_INFO: `/v3/services/image` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:27.698680 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd9c57-c51c-4b99-b984-fb480040e427 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:27.700639 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd9c57-c51c-4b99-b984-fb480040e427 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:27.711035 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-92fd9c57-c51c-4b99-b984-fb480040e427 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 28 10:19:27.712439 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 504/1005] 10.222.0.21 () {56 vars in 1105 bytes} [Mon Feb 28 10:19:27 2022] GET /identity/v3/services/image => generated 86 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:27.718396 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5812a-1039-4f7e-9510-03a43b0ee6a8 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:27.815481 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5812a-1039-4f7e-9510-03a43b0ee6a8 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:27.856313 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7dade-2c00-460b-820d-acc5d8ad6499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:27.857226 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7dade-2c00-460b-820d-acc5d8ad6499 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:27.857691 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7dade-2c00-460b-820d-acc5d8ad6499 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:27.858152 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7dade-2c00-460b-820d-acc5d8ad6499 None admin] PATH_INFO: `/v3/services` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:27.859141 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b7dade-2c00-460b-820d-acc5d8ad6499 None admin] RBAC: Adding query filter params (name=image) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:27.859634 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b7dade-2c00-460b-820d-acc5d8ad6499 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:27.861164 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b7dade-2c00-460b-820d-acc5d8ad6499 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:27.870882 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 502/1006] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:19:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:27.872632 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd9c57-c51c-4b99-b984-fb480040e427 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:27.970315 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd9c57-c51c-4b99-b984-fb480040e427 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:28.001809 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7932f-464e-4c5d-ba33-c3a04514c759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:28.002466 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7932f-464e-4c5d-ba33-c3a04514c759 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:28.002777 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7932f-464e-4c5d-ba33-c3a04514c759 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:28.003048 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7932f-464e-4c5d-ba33-c3a04514c759 None admin] PATH_INFO: `/v3/services` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:28.003739 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd7932f-464e-4c5d-ba33-c3a04514c759 None admin] RBAC: Adding query filter params (type=image) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:28.004040 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd7932f-464e-4c5d-ba33-c3a04514c759 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:28.005379 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd7932f-464e-4c5d-ba33-c3a04514c759 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:28.018886 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 505/1007] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:19:27 2022] GET /identity/v3/services?type=image => generated 122 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:29.398029 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b68ff4-c380-48d3-a511-c148289ebaef None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:29.398579 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b68ff4-c380-48d3-a511-c148289ebaef None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:29.398579 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b68ff4-c380-48d3-a511-c148289ebaef None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:29.400514 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 503/1008] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:19:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:19:29.406240 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee4cee-9830-415b-9d7e-54bae6ea2fb8 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:29.406708 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee4cee-9830-415b-9d7e-54bae6ea2fb8 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:29.406875 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee4cee-9830-415b-9d7e-54bae6ea2fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:29.423518 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-e8ee4cee-9830-415b-9d7e-54bae6ea2fb8 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:19:29.424701 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-e8ee4cee-9830-415b-9d7e-54bae6ea2fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:19:29.443928 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3760991-1469-4204-91d3-5f8dbfba2f2c None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:29.444212 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3760991-1469-4204-91d3-5f8dbfba2f2c None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:29.444486 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3760991-1469-4204-91d3-5f8dbfba2f2c None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:29.446479 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 504/1009] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:19:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:19:29.452678 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c334064-01e4-4928-b143-78f90d083d23 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:29.452962 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c334064-01e4-4928-b143-78f90d083d23 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:29.453238 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c334064-01e4-4928-b143-78f90d083d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:29.470707 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-9c334064-01e4-4928-b143-78f90d083d23 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:19:29.471886 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-9c334064-01e4-4928-b143-78f90d083d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:19:29.491386 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 506/1010] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:19:29 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:19:29.515730 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee4cee-9830-415b-9d7e-54bae6ea2fb8 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:29.539387 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 505/1011] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:19:29 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 10:19:29.563346 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c334064-01e4-4928-b143-78f90d083d23 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:29.618097 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee4cee-9830-415b-9d7e-54bae6ea2fb8 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:29.653281 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7fea9-f47b-4ba3-a0a6-b27656b824ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:29.654901 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7fea9-f47b-4ba3-a0a6-b27656b824ed None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:29.655592 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7fea9-f47b-4ba3-a0a6-b27656b824ed None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:29.656030 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7fea9-f47b-4ba3-a0a6-b27656b824ed None admin] PATH_INFO: `/v3/domains/default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:29.658064 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a7fea9-f47b-4ba3-a0a6-b27656b824ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:29.659762 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a7fea9-f47b-4ba3-a0a6-b27656b824ed None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:29.659894 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c334064-01e4-4928-b143-78f90d083d23 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:29.662868 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 507/1012] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:19:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:19:29.667634 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7fea9-f47b-4ba3-a0a6-b27656b824ed None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:29.693138 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb720a75-bb1e-48d3-9b32-76d244ea6683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:29.693920 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb720a75-bb1e-48d3-9b32-76d244ea6683 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:29.694197 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb720a75-bb1e-48d3-9b32-76d244ea6683 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:29.694469 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb720a75-bb1e-48d3-9b32-76d244ea6683 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:29.695138 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb720a75-bb1e-48d3-9b32-76d244ea6683 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:29.696512 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb720a75-bb1e-48d3-9b32-76d244ea6683 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:29.708087 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-cb720a75-bb1e-48d3-9b32-76d244ea6683 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 28 10:19:29.709267 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 506/1013] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:19:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:19:29.715286 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb720a75-bb1e-48d3-9b32-76d244ea6683 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:29.773077 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7fea9-f47b-4ba3-a0a6-b27656b824ed None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:29.806819 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e993e90-2204-4828-8b9a-1a11851ae19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:29.807487 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e993e90-2204-4828-8b9a-1a11851ae19d None admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:29.807769 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e993e90-2204-4828-8b9a-1a11851ae19d None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:29.808108 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e993e90-2204-4828-8b9a-1a11851ae19d None admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:29.808873 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e993e90-2204-4828-8b9a-1a11851ae19d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:29.810346 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e993e90-2204-4828-8b9a-1a11851ae19d None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:29.816608 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb720a75-bb1e-48d3-9b32-76d244ea6683 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:29.846629 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 508/1014] 10.222.0.21 () {60 vars in 1141 bytes} [Mon Feb 28 10:19:29 2022] POST /identity/v3/projects => generated 311 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:19:29.863303 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20b683-a5c6-4aa9-92d3-36bddd075b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:29.863978 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20b683-a5c6-4aa9-92d3-36bddd075b43 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:29.864257 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20b683-a5c6-4aa9-92d3-36bddd075b43 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:29.864531 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20b683-a5c6-4aa9-92d3-36bddd075b43 None admin] PATH_INFO: `/v3/services` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:29.865241 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20b683-a5c6-4aa9-92d3-36bddd075b43 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:29.865541 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20b683-a5c6-4aa9-92d3-36bddd075b43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:29.866973 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20b683-a5c6-4aa9-92d3-36bddd075b43 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:29.872571 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 507/1015] 10.222.0.21 () {56 vars in 1112 bytes} [Mon Feb 28 10:19:29 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:19:29.878410 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e993e90-2204-4828-8b9a-1a11851ae19d None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:29.987773 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e993e90-2204-4828-8b9a-1a11851ae19d None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:30.023688 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623be8d4-6f27-4ca4-ad3a-02cee6ad1a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:30.024708 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623be8d4-6f27-4ca4-ad3a-02cee6ad1a18 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:30.024708 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623be8d4-6f27-4ca4-ad3a-02cee6ad1a18 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:30.024957 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623be8d4-6f27-4ca4-ad3a-02cee6ad1a18 None admin] PATH_INFO: `/v3/services` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:30.025596 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623be8d4-6f27-4ca4-ad3a-02cee6ad1a18 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:30.025901 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623be8d4-6f27-4ca4-ad3a-02cee6ad1a18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:30.027812 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623be8d4-6f27-4ca4-ad3a-02cee6ad1a18 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:30.033817 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 509/1016] 10.222.0.21 () {56 vars in 1112 bytes} [Mon Feb 28 10:19:29 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:19:30.039307 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20b683-a5c6-4aa9-92d3-36bddd075b43 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:30.140542 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20b683-a5c6-4aa9-92d3-36bddd075b43 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:30.171670 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6c6df-b47e-4cf7-a869-0630890562fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:30.172318 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6c6df-b47e-4cf7-a869-0630890562fc None admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:30.172599 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6c6df-b47e-4cf7-a869-0630890562fc None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:30.172870 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6c6df-b47e-4cf7-a869-0630890562fc None admin] PATH_INFO: `/v3/endpoints` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:30.173613 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af6c6df-b47e-4cf7-a869-0630890562fc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:30.175002 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af6c6df-b47e-4cf7-a869-0630890562fc None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:30.195301 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 508/1017] 10.222.0.21 () {60 vars in 1144 bytes} [Mon Feb 28 10:19:30 2022] POST /identity/v3/endpoints => generated 334 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:19:30.341158 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b18fdd-70b1-4cae-a5d3-13a73a4cc186 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:30.341374 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b18fdd-70b1-4cae-a5d3-13a73a4cc186 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:30.341666 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b18fdd-70b1-4cae-a5d3-13a73a4cc186 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:30.343653 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 510/1018] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:19:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:19:30.349407 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132cfc3b-a30a-421c-80ed-66162982820a None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:30.349691 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132cfc3b-a30a-421c-80ed-66162982820a None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:30.349972 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132cfc3b-a30a-421c-80ed-66162982820a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:30.367937 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-132cfc3b-a30a-421c-80ed-66162982820a None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:19:30.369182 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-132cfc3b-a30a-421c-80ed-66162982820a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:19:30.442659 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 509/1019] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:19:30 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:19:30.467107 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b18fdd-70b1-4cae-a5d3-13a73a4cc186 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:30.570922 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b18fdd-70b1-4cae-a5d3-13a73a4cc186 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:30.605696 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79054e6-b0a5-437f-9dbf-1541dbe7f8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:30.606449 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79054e6-b0a5-437f-9dbf-1541dbe7f8e8 None admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:30.606763 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79054e6-b0a5-437f-9dbf-1541dbe7f8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:30.607038 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79054e6-b0a5-437f-9dbf-1541dbe7f8e8 None admin] PATH_INFO: `/v3/services` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:30.607752 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79054e6-b0a5-437f-9dbf-1541dbe7f8e8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:30.609102 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79054e6-b0a5-437f-9dbf-1541dbe7f8e8 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:30.630670 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 511/1020] 10.222.0.21 () {60 vars in 1141 bytes} [Mon Feb 28 10:19:30 2022] POST /identity/v3/services => generated 242 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:19:32.231670 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b01b9-3deb-4b26-a9c3-df83dad97a48 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:32.232205 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b01b9-3deb-4b26-a9c3-df83dad97a48 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:32.232205 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b01b9-3deb-4b26-a9c3-df83dad97a48 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:32.234017 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 510/1021] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:19:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:19:32.240172 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e7c1c-fb2f-46d8-8c0d-f6bc237e81ea None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:32.240711 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e7c1c-fb2f-46d8-8c0d-f6bc237e81ea None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:32.240711 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e7c1c-fb2f-46d8-8c0d-f6bc237e81ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:32.259175 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-b18e7c1c-fb2f-46d8-8c0d-f6bc237e81ea None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:19:32.260378 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-b18e7c1c-fb2f-46d8-8c0d-f6bc237e81ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:19:32.331113 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 512/1022] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:19:32 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:19:32.357123 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b01b9-3deb-4b26-a9c3-df83dad97a48 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:32.453853 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b01b9-3deb-4b26-a9c3-df83dad97a48 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:32.487397 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f24504f-d7b0-4d31-8be5-3d870163d9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:32.488101 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24504f-d7b0-4d31-8be5-3d870163d9bc None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:32.488374 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24504f-d7b0-4d31-8be5-3d870163d9bc None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:32.488637 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24504f-d7b0-4d31-8be5-3d870163d9bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:32.489780 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f24504f-d7b0-4d31-8be5-3d870163d9bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:32.491288 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f24504f-d7b0-4d31-8be5-3d870163d9bc None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:32.498128 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 511/1023] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:19:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:19:32.499326 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e7c1c-fb2f-46d8-8c0d-f6bc237e81ea None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:32.595371 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e7c1c-fb2f-46d8-8c0d-f6bc237e81ea None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:32.602484 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29c9ff-a223-4797-94cc-dcb55923d11a None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:32.602799 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29c9ff-a223-4797-94cc-dcb55923d11a None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:32.603078 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29c9ff-a223-4797-94cc-dcb55923d11a None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:32.604864 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 512/1024] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:19:32.610674 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021992a5-ab3f-430e-a2c2-42b1e30b855e None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:32.611170 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021992a5-ab3f-430e-a2c2-42b1e30b855e None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:32.611442 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021992a5-ab3f-430e-a2c2-42b1e30b855e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:32.628564 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-021992a5-ab3f-430e-a2c2-42b1e30b855e None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:19:32.629799 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-021992a5-ab3f-430e-a2c2-42b1e30b855e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:19:32.631494 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce007fe2-2a2e-4beb-be19-31efe2c2059e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:32.632246 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce007fe2-2a2e-4beb-be19-31efe2c2059e None admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:32.632528 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce007fe2-2a2e-4beb-be19-31efe2c2059e None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:32.632800 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce007fe2-2a2e-4beb-be19-31efe2c2059e None admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:32.633527 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce007fe2-2a2e-4beb-be19-31efe2c2059e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:32.635035 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce007fe2-2a2e-4beb-be19-31efe2c2059e None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:32.657917 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 513/1025] 10.222.0.21 () {60 vars in 1132 bytes} [Mon Feb 28 10:19:32 2022] POST /identity/v3/users => generated 285 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:19:32.705379 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 513/1026] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:19:32 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 10:19:32.729526 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce007fe2-2a2e-4beb-be19-31efe2c2059e None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:32.833100 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce007fe2-2a2e-4beb-be19-31efe2c2059e None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:32.869274 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c180b29-e956-4e93-8195-13129b80d859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:32.870089 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c180b29-e956-4e93-8195-13129b80d859 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:32.870371 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c180b29-e956-4e93-8195-13129b80d859 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:32.870737 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c180b29-e956-4e93-8195-13129b80d859 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:32.881889 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c180b29-e956-4e93-8195-13129b80d859 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:19:32.889445 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-1c180b29-e956-4e93-8195-13129b80d859 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 28 10:19:32.890682 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 514/1027] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 10:19:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:32.896705 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021992a5-ab3f-430e-a2c2-42b1e30b855e None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:32.994403 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021992a5-ab3f-430e-a2c2-42b1e30b855e None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:33.019857 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b831d-8e80-49b8-a0aa-75646717c8f0 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:33.020137 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b831d-8e80-49b8-a0aa-75646717c8f0 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:33.020591 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b831d-8e80-49b8-a0aa-75646717c8f0 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:33.022382 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 515/1028] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:19:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:19:33.026786 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c2418e-aaa9-47ba-b4b2-efc4bff50557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:33.027992 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2418e-aaa9-47ba-b4b2-efc4bff50557 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:33.028278 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2418e-aaa9-47ba-b4b2-efc4bff50557 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:33.028396 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d3d7f-8720-4ab7-8be1-ae090732ed3a None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:33.028564 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2418e-aaa9-47ba-b4b2-efc4bff50557 None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:33.028669 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d3d7f-8720-4ab7-8be1-ae090732ed3a None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:33.028887 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d3d7f-8720-4ab7-8be1-ae090732ed3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:33.029290 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c2418e-aaa9-47ba-b4b2-efc4bff50557 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:33.029596 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c2418e-aaa9-47ba-b4b2-efc4bff50557 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:33.030992 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c2418e-aaa9-47ba-b4b2-efc4bff50557 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:33.044254 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 514/1029] 10.222.0.21 () {56 vars in 1115 bytes} [Mon Feb 28 10:19:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:33.045461 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c2418e-aaa9-47ba-b4b2-efc4bff50557 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:33.046672 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-121d3d7f-8720-4ab7-8be1-ae090732ed3a None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:19:33.047845 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-121d3d7f-8720-4ab7-8be1-ae090732ed3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:19:33.118845 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 516/1030] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:19:33 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 10:19:33.136713 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d3d7f-8720-4ab7-8be1-ae090732ed3a None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:33.144563 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c2418e-aaa9-47ba-b4b2-efc4bff50557 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:33.178107 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb35e9e7-acc9-4dca-9a82-ff39d69c0130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:33.178917 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35e9e7-acc9-4dca-9a82-ff39d69c0130 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:33.179253 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35e9e7-acc9-4dca-9a82-ff39d69c0130 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:33.179526 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35e9e7-acc9-4dca-9a82-ff39d69c0130 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:33.190477 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb35e9e7-acc9-4dca-9a82-ff39d69c0130 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:33.191944 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb35e9e7-acc9-4dca-9a82-ff39d69c0130 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:33.208559 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-cb35e9e7-acc9-4dca-9a82-ff39d69c0130 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:19:33.209879 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 515/1031] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:19:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:33.215972 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb35e9e7-acc9-4dca-9a82-ff39d69c0130 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:33.233846 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d3d7f-8720-4ab7-8be1-ae090732ed3a None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:33.268019 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a4cb6-3121-4a02-bc14-6df7c21398f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:33.268805 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a4cb6-3121-4a02-bc14-6df7c21398f3 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:33.269084 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a4cb6-3121-4a02-bc14-6df7c21398f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:33.269358 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a4cb6-3121-4a02-bc14-6df7c21398f3 None admin] PATH_INFO: `/v3/services/image` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:33.269998 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a4cb6-3121-4a02-bc14-6df7c21398f3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:33.271390 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a4cb6-3121-4a02-bc14-6df7c21398f3 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:33.281737 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-d07a4cb6-3121-4a02-bc14-6df7c21398f3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 28 10:19:33.283072 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 517/1032] 10.222.0.21 () {56 vars in 1105 bytes} [Mon Feb 28 10:19:33 2022] GET /identity/v3/services/image => generated 86 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:19:33.288879 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a4cb6-3121-4a02-bc14-6df7c21398f3 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:33.317673 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb35e9e7-acc9-4dca-9a82-ff39d69c0130 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:33.350363 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afcba1e-fc1f-42ff-86a4-bbbe68cad0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:33.351069 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcba1e-fc1f-42ff-86a4-bbbe68cad0c4 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:33.351349 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcba1e-fc1f-42ff-86a4-bbbe68cad0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:33.351619 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcba1e-fc1f-42ff-86a4-bbbe68cad0c4 None admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:33.352328 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afcba1e-fc1f-42ff-86a4-bbbe68cad0c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:33.352630 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afcba1e-fc1f-42ff-86a4-bbbe68cad0c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:33.354079 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afcba1e-fc1f-42ff-86a4-bbbe68cad0c4 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:33.370785 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 516/1033] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:19:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:19:33.372496 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afcba1e-fc1f-42ff-86a4-bbbe68cad0c4 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:33.392257 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a4cb6-3121-4a02-bc14-6df7c21398f3 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:33.426792 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0a76d-86d8-464e-805c-3381e7ac684d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:33.427448 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0a76d-86d8-464e-805c-3381e7ac684d None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:33.427725 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0a76d-86d8-464e-805c-3381e7ac684d None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:33.427996 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0a76d-86d8-464e-805c-3381e7ac684d None admin] PATH_INFO: `/v3/services` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:33.428686 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0a76d-86d8-464e-805c-3381e7ac684d None admin] RBAC: Adding query filter params (name=image) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:33.428987 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0a76d-86d8-464e-805c-3381e7ac684d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:33.430345 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0a76d-86d8-464e-805c-3381e7ac684d None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:33.435851 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 518/1034] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:19:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:19:33.441198 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0a76d-86d8-464e-805c-3381e7ac684d None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:33.469944 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afcba1e-fc1f-42ff-86a4-bbbe68cad0c4 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:33.503806 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d221edb-08e3-47a2-83b3-f6233b661cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:33.504591 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d221edb-08e3-47a2-83b3-f6233b661cbf None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:33.504871 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d221edb-08e3-47a2-83b3-f6233b661cbf None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:33.505142 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d221edb-08e3-47a2-83b3-f6233b661cbf None admin] PATH_INFO: `/v3/users/nova` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:33.512736 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d221edb-08e3-47a2-83b3-f6233b661cbf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:33.514175 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d221edb-08e3-47a2-83b3-f6233b661cbf None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:33.528216 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-6d221edb-08e3-47a2-83b3-f6233b661cbf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 10:19:33.530489 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 517/1035] 10.222.0.21 () {56 vars in 1093 bytes} [Mon Feb 28 10:19:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:19:33.534949 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d221edb-08e3-47a2-83b3-f6233b661cbf None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:33.536872 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0a76d-86d8-464e-805c-3381e7ac684d None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:33.570641 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64188acb-a327-4844-b981-f7fc2ac35911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:33.571305 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64188acb-a327-4844-b981-f7fc2ac35911 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:33.571585 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64188acb-a327-4844-b981-f7fc2ac35911 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:33.571857 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64188acb-a327-4844-b981-f7fc2ac35911 None admin] PATH_INFO: `/v3/services` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:33.572544 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64188acb-a327-4844-b981-f7fc2ac35911 None admin] RBAC: Adding query filter params (type=image) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:33.572843 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64188acb-a327-4844-b981-f7fc2ac35911 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:33.574506 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64188acb-a327-4844-b981-f7fc2ac35911 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:33.579440 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 519/1036] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:19:33 2022] GET /identity/v3/services?type=image => generated 350 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:19:33.584961 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64188acb-a327-4844-b981-f7fc2ac35911 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:33.636246 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d221edb-08e3-47a2-83b3-f6233b661cbf None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:33.671564 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0605efb6-561f-4e6d-ade5-c18e6d1340f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:33.672599 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605efb6-561f-4e6d-ade5-c18e6d1340f5 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:33.673103 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605efb6-561f-4e6d-ade5-c18e6d1340f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:33.673584 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605efb6-561f-4e6d-ade5-c18e6d1340f5 None admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:33.674651 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0605efb6-561f-4e6d-ade5-c18e6d1340f5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:33.675122 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0605efb6-561f-4e6d-ade5-c18e6d1340f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:33.676548 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0605efb6-561f-4e6d-ade5-c18e6d1340f5 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:33.680847 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64188acb-a327-4844-b981-f7fc2ac35911 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:33.698763 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 518/1037] 10.222.0.21 () {56 vars in 1133 bytes} [Mon Feb 28 10:19:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:19:33.700271 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0605efb6-561f-4e6d-ade5-c18e6d1340f5 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:33.714201 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e32af-32f9-427a-9fdf-bdfc1f29eaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:33.715154 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e32af-32f9-427a-9fdf-bdfc1f29eaa3 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:33.715154 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e32af-32f9-427a-9fdf-bdfc1f29eaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:33.715431 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e32af-32f9-427a-9fdf-bdfc1f29eaa3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:33.716186 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e32af-32f9-427a-9fdf-bdfc1f29eaa3 None admin] RBAC: Adding query filter params (interface=public, service_id=fd47c8d86c7244979e0065b7b21e5e0d, region_id=RegionOne) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:33.716496 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e32af-32f9-427a-9fdf-bdfc1f29eaa3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:33.717846 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e32af-32f9-427a-9fdf-bdfc1f29eaa3 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:33.727251 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 520/1038] 10.222.0.21 () {56 vars in 1251 bytes} [Mon Feb 28 10:19:33 2022] GET /identity/v3/endpoints?service_id=fd47c8d86c7244979e0065b7b21e5e0d&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:19:33.728113 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e32af-32f9-427a-9fdf-bdfc1f29eaa3 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:33.796614 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0605efb6-561f-4e6d-ade5-c18e6d1340f5 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:33.824456 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e32af-32f9-427a-9fdf-bdfc1f29eaa3 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:33.830696 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a1cba8-5e75-4118-aee2-69c8b6606aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:33.831341 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1cba8-5e75-4118-aee2-69c8b6606aab None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:33.831624 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1cba8-5e75-4118-aee2-69c8b6606aab None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:33.831895 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1cba8-5e75-4118-aee2-69c8b6606aab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:33.862362 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815856a2-fbc9-4216-962f-caacdeab2ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:33.863061 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815856a2-fbc9-4216-962f-caacdeab2ced None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:33.863342 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815856a2-fbc9-4216-962f-caacdeab2ced None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:33.863615 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815856a2-fbc9-4216-962f-caacdeab2ced None admin] PATH_INFO: `/v3/services` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:33.864299 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815856a2-fbc9-4216-962f-caacdeab2ced None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:33.865695 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815856a2-fbc9-4216-962f-caacdeab2ced None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:33.874155 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 521/1039] 10.222.0.21 () {56 vars in 1087 bytes} [Mon Feb 28 10:19:33 2022] GET /identity/v3/services => generated 1957 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:19:33.903372 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a1cba8-5e75-4118-aee2-69c8b6606aab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:33.905132 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a1cba8-5e75-4118-aee2-69c8b6606aab None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:34.008545 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 519/1040] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:19:33 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 10:19:34.014349 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815856a2-fbc9-4216-962f-caacdeab2ced None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:34.115659 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815856a2-fbc9-4216-962f-caacdeab2ced None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:34.148357 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00db90-51f3-43b3-8198-48b5a089e59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:34.149135 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00db90-51f3-43b3-8198-48b5a089e59b None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:34.149416 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00db90-51f3-43b3-8198-48b5a089e59b None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:34.149688 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00db90-51f3-43b3-8198-48b5a089e59b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:34.160131 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb00db90-51f3-43b3-8198-48b5a089e59b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:34.161510 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb00db90-51f3-43b3-8198-48b5a089e59b None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:34.178139 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-fb00db90-51f3-43b3-8198-48b5a089e59b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:19:34.184409 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 522/1041] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:19:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:34.185894 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a1cba8-5e75-4118-aee2-69c8b6606aab None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:34.281661 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a1cba8-5e75-4118-aee2-69c8b6606aab None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:34.315128 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08001f0-3966-4bb1-9ab3-24ee824531a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:34.315788 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08001f0-3966-4bb1-9ab3-24ee824531a3 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:34.316068 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08001f0-3966-4bb1-9ab3-24ee824531a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:34.316339 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08001f0-3966-4bb1-9ab3-24ee824531a3 None admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:34.317044 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08001f0-3966-4bb1-9ab3-24ee824531a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:34.317347 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08001f0-3966-4bb1-9ab3-24ee824531a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:34.318722 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08001f0-3966-4bb1-9ab3-24ee824531a3 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:34.334694 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 520/1042] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:19:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:34.335878 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00db90-51f3-43b3-8198-48b5a089e59b None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:34.432174 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00db90-51f3-43b3-8198-48b5a089e59b None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:34.465256 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904b46e-a3fb-480a-a89f-b667cfa72100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:34.466032 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904b46e-a3fb-480a-a89f-b667cfa72100 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:34.466315 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904b46e-a3fb-480a-a89f-b667cfa72100 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:34.466590 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904b46e-a3fb-480a-a89f-b667cfa72100 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:34.473166 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e904b46e-a3fb-480a-a89f-b667cfa72100 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:34.474613 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e904b46e-a3fb-480a-a89f-b667cfa72100 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:34.488659 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-e904b46e-a3fb-480a-a89f-b667cfa72100 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:19:34.489963 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 523/1043] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:19:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:34.495611 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08001f0-3966-4bb1-9ab3-24ee824531a3 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:34.593438 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08001f0-3966-4bb1-9ab3-24ee824531a3 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:34.625831 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49dfe43-0fd2-4b48-9842-7fb51a7ac0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:34.626483 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49dfe43-0fd2-4b48-9842-7fb51a7ac0f1 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:34.626793 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49dfe43-0fd2-4b48-9842-7fb51a7ac0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:34.627068 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49dfe43-0fd2-4b48-9842-7fb51a7ac0f1 None admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:34.627838 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49dfe43-0fd2-4b48-9842-7fb51a7ac0f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:34.628143 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49dfe43-0fd2-4b48-9842-7fb51a7ac0f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:34.629558 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49dfe43-0fd2-4b48-9842-7fb51a7ac0f1 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:34.641989 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 521/1044] 10.222.0.21 () {56 vars in 1148 bytes} [Mon Feb 28 10:19:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:34.647725 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904b46e-a3fb-480a-a89f-b667cfa72100 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:34.748941 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904b46e-a3fb-480a-a89f-b667cfa72100 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:34.782275 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5e87b-7ebf-42ea-b4e6-f543bd1f9543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:34.782966 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5e87b-7ebf-42ea-b4e6-f543bd1f9543 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:34.783249 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5e87b-7ebf-42ea-b4e6-f543bd1f9543 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:34.783524 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5e87b-7ebf-42ea-b4e6-f543bd1f9543 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:34.784354 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa5e87b-7ebf-42ea-b4e6-f543bd1f9543 None admin] RBAC: Adding query filter params (role.id=0abd451d1e894a6b8575ab7e6685f50a, scope.project.id=5d1d6f8141924b2d99b766f975a3d43b, user.id=ec202a34db8e47f4a6c18285245e3f5b) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:34.784664 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa5e87b-7ebf-42ea-b4e6-f543bd1f9543 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:34.786107 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa5e87b-7ebf-42ea-b4e6-f543bd1f9543 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:34.791848 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 524/1045] 10.222.0.21 () {56 vars in 1374 bytes} [Mon Feb 28 10:19:34 2022] GET /identity/v3/role_assignments?user.id=ec202a34db8e47f4a6c18285245e3f5b&scope.project.id=5d1d6f8141924b2d99b766f975a3d43b&role.id=0abd451d1e894a6b8575ab7e6685f50a => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:35.077678 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8a9ee-f24b-4b17-98fd-0204d857e64c None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:35.078060 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8a9ee-f24b-4b17-98fd-0204d857e64c None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:35.078238 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8a9ee-f24b-4b17-98fd-0204d857e64c None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:35.080036 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 522/1046] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:19:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:19:35.085695 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594a9e3-9856-4f31-a054-5862fa09cb8d None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:35.085985 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594a9e3-9856-4f31-a054-5862fa09cb8d None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:35.086261 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594a9e3-9856-4f31-a054-5862fa09cb8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:35.102721 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-2594a9e3-9856-4f31-a054-5862fa09cb8d None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:19:35.103902 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-2594a9e3-9856-4f31-a054-5862fa09cb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:19:35.168712 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 525/1047] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:19:35 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 10:19:35.192501 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8a9ee-f24b-4b17-98fd-0204d857e64c None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:35.289195 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8a9ee-f24b-4b17-98fd-0204d857e64c None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:35.320903 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f30935-e84d-47ce-8104-be2dfc286f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:35.321678 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f30935-e84d-47ce-8104-be2dfc286f2b None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:35.321958 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f30935-e84d-47ce-8104-be2dfc286f2b None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:35.322233 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f30935-e84d-47ce-8104-be2dfc286f2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:35.332251 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f30935-e84d-47ce-8104-be2dfc286f2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:19:35.338896 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-36f30935-e84d-47ce-8104-be2dfc286f2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:19:35.340791 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 523/1048] 10.222.0.21 () {56 vars in 1096 bytes} [Mon Feb 28 10:19:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:35.346661 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2594a9e3-9856-4f31-a054-5862fa09cb8d None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:35.441159 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2594a9e3-9856-4f31-a054-5862fa09cb8d None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:35.473862 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895aa9e-076d-40f0-a4aa-99abc8b22da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:35.474527 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895aa9e-076d-40f0-a4aa-99abc8b22da7 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:35.474846 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895aa9e-076d-40f0-a4aa-99abc8b22da7 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:35.475119 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895aa9e-076d-40f0-a4aa-99abc8b22da7 None admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:35.475853 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895aa9e-076d-40f0-a4aa-99abc8b22da7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:35.476152 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895aa9e-076d-40f0-a4aa-99abc8b22da7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:35.477505 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895aa9e-076d-40f0-a4aa-99abc8b22da7 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:35.486399 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 526/1049] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:19:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:19:35.492091 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f30935-e84d-47ce-8104-be2dfc286f2b None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:35.591894 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f30935-e84d-47ce-8104-be2dfc286f2b None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:35.624426 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b5f22-7c1d-4bbf-ab1a-85d8585a8d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:35.625285 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b5f22-7c1d-4bbf-ab1a-85d8585a8d44 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:35.625564 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b5f22-7c1d-4bbf-ab1a-85d8585a8d44 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:35.625833 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b5f22-7c1d-4bbf-ab1a-85d8585a8d44 None admin] PATH_INFO: `/v3/users/21811013bdcf4d8b847a4d9ff90b1d32` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:35.639511 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b5f22-7c1d-4bbf-ab1a-85d8585a8d44 None admin] RBAC: Authorizing `identity:get_user(user_id=21811013bdcf4d8b847a4d9ff90b1d32)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:35.640956 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b5f22-7c1d-4bbf-ab1a-85d8585a8d44 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:35.646818 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 524/1050] 10.222.0.21 () {56 vars in 1177 bytes} [Mon Feb 28 10:19:35 2022] GET /identity/v3/users/21811013bdcf4d8b847a4d9ff90b1d32 => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:35.648728 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895aa9e-076d-40f0-a4aa-99abc8b22da7 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:35.744866 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895aa9e-076d-40f0-a4aa-99abc8b22da7 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:35.778021 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47846990-096c-4efa-9465-7ad767e6be8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:35.778847 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47846990-096c-4efa-9465-7ad767e6be8a None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:35.779168 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47846990-096c-4efa-9465-7ad767e6be8a None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:35.779427 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47846990-096c-4efa-9465-7ad767e6be8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:35.851351 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47846990-096c-4efa-9465-7ad767e6be8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:35.852814 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47846990-096c-4efa-9465-7ad767e6be8a None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:35.958170 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 527/1051] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:19:35 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 10:19:35.960599 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b5f22-7c1d-4bbf-ab1a-85d8585a8d44 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:36.060146 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b5f22-7c1d-4bbf-ab1a-85d8585a8d44 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:36.093406 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea163ae7-5765-4b58-96bd-4781fb642429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:36.094242 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea163ae7-5765-4b58-96bd-4781fb642429 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:36.094521 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea163ae7-5765-4b58-96bd-4781fb642429 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:36.094827 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea163ae7-5765-4b58-96bd-4781fb642429 None admin] PATH_INFO: `/v3/projects/5d1a8371aac3476ebd566b1ac7b60729` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:36.095995 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea163ae7-5765-4b58-96bd-4781fb642429 None admin] RBAC: Authorizing `identity:get_project(project_id=5d1a8371aac3476ebd566b1ac7b60729)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:36.097409 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea163ae7-5765-4b58-96bd-4781fb642429 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:36.102688 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 525/1052] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:19:35 2022] GET /identity/v3/projects/5d1a8371aac3476ebd566b1ac7b60729 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:36.105503 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47846990-096c-4efa-9465-7ad767e6be8a None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:36.201851 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47846990-096c-4efa-9465-7ad767e6be8a None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:36.234396 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6b320f-07df-4df3-b4c8-146b1c7deb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:36.235077 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b320f-07df-4df3-b4c8-146b1c7deb54 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:36.235362 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b320f-07df-4df3-b4c8-146b1c7deb54 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:36.235635 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b320f-07df-4df3-b4c8-146b1c7deb54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:36.236448 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6b320f-07df-4df3-b4c8-146b1c7deb54 None admin] RBAC: Adding query filter params (role.id=48e4608a7b3f4b87a20b10c4d1b45aa9, scope.project.id=5d1a8371aac3476ebd566b1ac7b60729, user.id=21811013bdcf4d8b847a4d9ff90b1d32) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:36.236756 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6b320f-07df-4df3-b4c8-146b1c7deb54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:36.238185 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6b320f-07df-4df3-b4c8-146b1c7deb54 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:36.250694 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 528/1053] 10.222.0.21 () {56 vars in 1374 bytes} [Mon Feb 28 10:19:36 2022] GET /identity/v3/role_assignments?user.id=21811013bdcf4d8b847a4d9ff90b1d32&scope.project.id=5d1a8371aac3476ebd566b1ac7b60729&role.id=48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:36.279238 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65043641-8dfd-4ff0-a4d7-976940ed7f1d None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:36.279532 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65043641-8dfd-4ff0-a4d7-976940ed7f1d None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:36.279787 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65043641-8dfd-4ff0-a4d7-976940ed7f1d None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:36.281615 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 526/1054] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:19:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:19:36.287763 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66025315-f006-4063-ae96-cf5b18e1b6d3 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:36.288075 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66025315-f006-4063-ae96-cf5b18e1b6d3 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:36.288326 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66025315-f006-4063-ae96-cf5b18e1b6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:36.306241 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-66025315-f006-4063-ae96-cf5b18e1b6d3 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:19:36.307494 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-66025315-f006-4063-ae96-cf5b18e1b6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:19:36.378194 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 529/1055] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:19:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:19:36.401981 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65043641-8dfd-4ff0-a4d7-976940ed7f1d None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:36.505296 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65043641-8dfd-4ff0-a4d7-976940ed7f1d None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:36.538868 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df4572-2b2b-4432-83a0-2c73a7f0189c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:36.539754 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df4572-2b2b-4432-83a0-2c73a7f0189c None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:36.540103 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df4572-2b2b-4432-83a0-2c73a7f0189c None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:36.540392 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df4572-2b2b-4432-83a0-2c73a7f0189c None admin] PATH_INFO: `/v3/services/image` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:36.541103 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df4572-2b2b-4432-83a0-2c73a7f0189c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:36.542457 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df4572-2b2b-4432-83a0-2c73a7f0189c None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:36.553547 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-c4df4572-2b2b-4432-83a0-2c73a7f0189c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 28 10:19:36.560369 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 527/1056] 10.222.0.21 () {56 vars in 1105 bytes} [Mon Feb 28 10:19:36 2022] GET /identity/v3/services/image => generated 86 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:19:36.561822 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66025315-f006-4063-ae96-cf5b18e1b6d3 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:36.665692 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66025315-f006-4063-ae96-cf5b18e1b6d3 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:36.698393 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32935876-1c19-4598-b43b-c91e0f5e2252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:36.699883 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32935876-1c19-4598-b43b-c91e0f5e2252 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:36.700198 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32935876-1c19-4598-b43b-c91e0f5e2252 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:36.700441 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32935876-1c19-4598-b43b-c91e0f5e2252 None admin] PATH_INFO: `/v3/services` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:36.701116 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32935876-1c19-4598-b43b-c91e0f5e2252 None admin] RBAC: Adding query filter params (name=image) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:36.701418 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32935876-1c19-4598-b43b-c91e0f5e2252 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:36.702842 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32935876-1c19-4598-b43b-c91e0f5e2252 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:36.712350 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 530/1057] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:19:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:19:36.713287 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df4572-2b2b-4432-83a0-2c73a7f0189c None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:36.814894 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df4572-2b2b-4432-83a0-2c73a7f0189c None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:36.854203 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68edbae8-1e1a-4eee-8472-72025e8a6005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:36.854904 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edbae8-1e1a-4eee-8472-72025e8a6005 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:36.855188 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edbae8-1e1a-4eee-8472-72025e8a6005 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:36.856088 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edbae8-1e1a-4eee-8472-72025e8a6005 None admin] PATH_INFO: `/v3/services` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:36.856818 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68edbae8-1e1a-4eee-8472-72025e8a6005 None admin] RBAC: Adding query filter params (type=image) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:36.857154 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68edbae8-1e1a-4eee-8472-72025e8a6005 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:36.858552 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68edbae8-1e1a-4eee-8472-72025e8a6005 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:36.863682 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 528/1058] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:19:36 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:19:36.869126 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32935876-1c19-4598-b43b-c91e0f5e2252 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:36.968452 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32935876-1c19-4598-b43b-c91e0f5e2252 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:37.000946 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c227669-b34a-4da0-a5f2-32a923e69f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:37.001600 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c227669-b34a-4da0-a5f2-32a923e69f6e None admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:37.001880 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c227669-b34a-4da0-a5f2-32a923e69f6e None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:37.002149 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c227669-b34a-4da0-a5f2-32a923e69f6e None admin] PATH_INFO: `/v3/endpoints` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:37.002919 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c227669-b34a-4da0-a5f2-32a923e69f6e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:37.004265 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c227669-b34a-4da0-a5f2-32a923e69f6e None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:37.030631 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 531/1059] 10.222.0.21 () {60 vars in 1144 bytes} [Mon Feb 28 10:19:36 2022] POST /identity/v3/endpoints => generated 327 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:19:37.154244 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7533e-ecf1-4ad5-8de4-3882efc88097 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:37.154652 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7533e-ecf1-4ad5-8de4-3882efc88097 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:37.154837 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7533e-ecf1-4ad5-8de4-3882efc88097 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:37.156849 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 529/1060] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:19:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:19:37.162421 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90beafae-e5f5-4464-8771-8597db06161d None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:37.162751 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90beafae-e5f5-4464-8771-8597db06161d None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:37.163024 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90beafae-e5f5-4464-8771-8597db06161d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:37.181642 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-90beafae-e5f5-4464-8771-8597db06161d None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:19:37.182913 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-90beafae-e5f5-4464-8771-8597db06161d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:19:37.259796 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 532/1061] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:19:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:19:37.282308 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7533e-ecf1-4ad5-8de4-3882efc88097 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:37.382396 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7533e-ecf1-4ad5-8de4-3882efc88097 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:37.417187 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62272706-8483-43c6-8161-32289bf2b749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:37.418648 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62272706-8483-43c6-8161-32289bf2b749 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:37.418894 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62272706-8483-43c6-8161-32289bf2b749 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:37.419165 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62272706-8483-43c6-8161-32289bf2b749 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:37.429637 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62272706-8483-43c6-8161-32289bf2b749 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:19:37.436815 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-62272706-8483-43c6-8161-32289bf2b749 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 28 10:19:37.438187 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 530/1062] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 10:19:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:37.444582 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90beafae-e5f5-4464-8771-8597db06161d None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:37.545543 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90beafae-e5f5-4464-8771-8597db06161d None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:37.579969 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf150b-d0e7-4bd8-b92e-acbfd23253ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:37.580630 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf150b-d0e7-4bd8-b92e-acbfd23253ae None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:37.580913 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf150b-d0e7-4bd8-b92e-acbfd23253ae None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:37.581191 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf150b-d0e7-4bd8-b92e-acbfd23253ae None admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:37.581993 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadf150b-d0e7-4bd8-b92e-acbfd23253ae None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:37.582299 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadf150b-d0e7-4bd8-b92e-acbfd23253ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:37.583744 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadf150b-d0e7-4bd8-b92e-acbfd23253ae None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:37.597084 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 533/1063] 10.222.0.21 () {56 vars in 1115 bytes} [Mon Feb 28 10:19:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:37.598299 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62272706-8483-43c6-8161-32289bf2b749 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:37.691391 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62272706-8483-43c6-8161-32289bf2b749 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:37.725238 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc01f0-2a71-44a9-a901-b6b5dd6cf77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:37.726017 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc01f0-2a71-44a9-a901-b6b5dd6cf77b None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:37.726295 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc01f0-2a71-44a9-a901-b6b5dd6cf77b None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:37.726563 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc01f0-2a71-44a9-a901-b6b5dd6cf77b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:37.737022 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fc01f0-2a71-44a9-a901-b6b5dd6cf77b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:37.738467 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fc01f0-2a71-44a9-a901-b6b5dd6cf77b None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:37.754702 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-24fc01f0-2a71-44a9-a901-b6b5dd6cf77b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:19:37.756068 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 531/1064] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:19:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:37.762022 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf150b-d0e7-4bd8-b92e-acbfd23253ae None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:37.868618 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf150b-d0e7-4bd8-b92e-acbfd23253ae None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:37.900546 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7249e2-a207-4556-8c8d-3c49701f55cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:37.901203 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7249e2-a207-4556-8c8d-3c49701f55cb None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:37.901483 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7249e2-a207-4556-8c8d-3c49701f55cb None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:37.901755 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7249e2-a207-4556-8c8d-3c49701f55cb None admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:37.903161 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7249e2-a207-4556-8c8d-3c49701f55cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:37.903463 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7249e2-a207-4556-8c8d-3c49701f55cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:37.904822 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7249e2-a207-4556-8c8d-3c49701f55cb None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:37.920954 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 534/1065] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:19:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:37.922145 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc01f0-2a71-44a9-a901-b6b5dd6cf77b None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:38.056550 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc01f0-2a71-44a9-a901-b6b5dd6cf77b None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:38.090612 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed85a25f-7604-43b9-84b3-bc94ba1ee0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:38.091413 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85a25f-7604-43b9-84b3-bc94ba1ee0df None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:38.091689 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85a25f-7604-43b9-84b3-bc94ba1ee0df None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:38.091956 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85a25f-7604-43b9-84b3-bc94ba1ee0df None admin] PATH_INFO: `/v3/users/nova` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:38.099708 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed85a25f-7604-43b9-84b3-bc94ba1ee0df None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:38.101184 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed85a25f-7604-43b9-84b3-bc94ba1ee0df None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:38.115077 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-ed85a25f-7604-43b9-84b3-bc94ba1ee0df None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 10:19:38.120839 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 532/1066] 10.222.0.21 () {56 vars in 1093 bytes} [Mon Feb 28 10:19:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:38.123310 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7249e2-a207-4556-8c8d-3c49701f55cb None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:38.263341 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7249e2-a207-4556-8c8d-3c49701f55cb None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:38.300721 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d11e5-54da-4143-b761-9663d43cd066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:38.301380 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d11e5-54da-4143-b761-9663d43cd066 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:38.301655 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d11e5-54da-4143-b761-9663d43cd066 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:38.301924 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d11e5-54da-4143-b761-9663d43cd066 None admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:38.302769 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4d11e5-54da-4143-b761-9663d43cd066 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:38.303072 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4d11e5-54da-4143-b761-9663d43cd066 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:38.304473 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4d11e5-54da-4143-b761-9663d43cd066 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:38.325562 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 535/1067] 10.222.0.21 () {56 vars in 1133 bytes} [Mon Feb 28 10:19:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:38.327582 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed85a25f-7604-43b9-84b3-bc94ba1ee0df None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:38.430772 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed85a25f-7604-43b9-84b3-bc94ba1ee0df None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:38.465262 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ccb107-b2af-4efa-a1fa-f62522c3ceff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:38.471105 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ccb107-b2af-4efa-a1fa-f62522c3ceff None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:38.471844 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ccb107-b2af-4efa-a1fa-f62522c3ceff None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:38.472123 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ccb107-b2af-4efa-a1fa-f62522c3ceff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:38.483079 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ccb107-b2af-4efa-a1fa-f62522c3ceff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:38.484514 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ccb107-b2af-4efa-a1fa-f62522c3ceff None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:38.500989 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-e1ccb107-b2af-4efa-a1fa-f62522c3ceff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:19:38.506672 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 533/1068] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:19:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:38.508402 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d11e5-54da-4143-b761-9663d43cd066 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:38.585615 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68979bb6-a920-48d5-801b-397d9161e82e None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:38.585969 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68979bb6-a920-48d5-801b-397d9161e82e None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:38.586175 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68979bb6-a920-48d5-801b-397d9161e82e None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:38.588118 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 534/1069] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:19:38.593217 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b4c48-14f4-4ae4-9885-d57afdfbb187 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:38.593509 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b4c48-14f4-4ae4-9885-d57afdfbb187 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:38.593786 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b4c48-14f4-4ae4-9885-d57afdfbb187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:38.611001 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-106b4c48-14f4-4ae4-9885-d57afdfbb187 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:19:38.611309 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d11e5-54da-4143-b761-9663d43cd066 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:38.612209 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-106b4c48-14f4-4ae4-9885-d57afdfbb187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:19:38.645536 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c864e-01d6-4257-9e34-d7524439bf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:38.646201 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c864e-01d6-4257-9e34-d7524439bf60 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:38.646474 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c864e-01d6-4257-9e34-d7524439bf60 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:38.646776 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c864e-01d6-4257-9e34-d7524439bf60 None admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:38.647480 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c864e-01d6-4257-9e34-d7524439bf60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:38.647780 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c864e-01d6-4257-9e34-d7524439bf60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:38.649122 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c864e-01d6-4257-9e34-d7524439bf60 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:38.661261 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 536/1070] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:19:38.666737 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c864e-01d6-4257-9e34-d7524439bf60 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:38.678373 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 535/1071] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:19:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:19:38.703330 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b4c48-14f4-4ae4-9885-d57afdfbb187 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:38.766930 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c864e-01d6-4257-9e34-d7524439bf60 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:38.798794 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b4c48-14f4-4ae4-9885-d57afdfbb187 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:38.799817 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5648c1-52db-480c-8c40-f01189add48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:38.800833 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5648c1-52db-480c-8c40-f01189add48e None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:38.801138 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5648c1-52db-480c-8c40-f01189add48e None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:38.801413 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5648c1-52db-480c-8c40-f01189add48e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:38.808179 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5648c1-52db-480c-8c40-f01189add48e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:38.810295 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5648c1-52db-480c-8c40-f01189add48e None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:38.824161 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-4c5648c1-52db-480c-8c40-f01189add48e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:19:38.825385 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 537/1072] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:19:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:19:38.831038 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5648c1-52db-480c-8c40-f01189add48e None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:38.839084 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ee367-8734-41a3-a4b1-58b25afecf97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:38.839999 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ee367-8734-41a3-a4b1-58b25afecf97 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:38.840280 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ee367-8734-41a3-a4b1-58b25afecf97 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:38.840561 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ee367-8734-41a3-a4b1-58b25afecf97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:38.858662 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ee367-8734-41a3-a4b1-58b25afecf97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:19:38.865804 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-355ee367-8734-41a3-a4b1-58b25afecf97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:19:38.866790 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 536/1073] 10.222.0.21 () {56 vars in 1096 bytes} [Mon Feb 28 10:19:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:19:38.872743 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ee367-8734-41a3-a4b1-58b25afecf97 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:38.932552 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5648c1-52db-480c-8c40-f01189add48e None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:38.967776 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffafe3-0959-4892-ae1b-35da38773dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:38.968337 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffafe3-0959-4892-ae1b-35da38773dde None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:38.968622 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffafe3-0959-4892-ae1b-35da38773dde None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:38.968893 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffafe3-0959-4892-ae1b-35da38773dde None admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:38.969655 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ffafe3-0959-4892-ae1b-35da38773dde None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:38.969959 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ffafe3-0959-4892-ae1b-35da38773dde None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:38.970428 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ee367-8734-41a3-a4b1-58b25afecf97 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:38.971404 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ffafe3-0959-4892-ae1b-35da38773dde None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:38.982861 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 538/1074] 10.222.0.21 () {56 vars in 1148 bytes} [Mon Feb 28 10:19:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:19:38.988680 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffafe3-0959-4892-ae1b-35da38773dde None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:39.004120 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe7650c-9640-4b0d-97e1-6669f919b858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:39.004779 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7650c-9640-4b0d-97e1-6669f919b858 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:39.005057 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7650c-9640-4b0d-97e1-6669f919b858 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:39.005329 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7650c-9640-4b0d-97e1-6669f919b858 None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:39.006069 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe7650c-9640-4b0d-97e1-6669f919b858 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:39.006372 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe7650c-9640-4b0d-97e1-6669f919b858 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:39.007842 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe7650c-9640-4b0d-97e1-6669f919b858 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:39.016094 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 537/1075] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:19:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:19:39.022190 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe7650c-9640-4b0d-97e1-6669f919b858 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:39.091201 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffafe3-0959-4892-ae1b-35da38773dde None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:39.120283 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe7650c-9640-4b0d-97e1-6669f919b858 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:39.123393 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883074a0-57e5-4b07-b6c3-0da06057fddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:39.124280 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883074a0-57e5-4b07-b6c3-0da06057fddd None admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:39.124555 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883074a0-57e5-4b07-b6c3-0da06057fddd None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:39.124824 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883074a0-57e5-4b07-b6c3-0da06057fddd None admin] PATH_INFO: `/v3/projects/5d1d6f8141924b2d99b766f975a3d43b/users/ec202a34db8e47f4a6c18285245e3f5b/roles/0abd451d1e894a6b8575ab7e6685f50a` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:39.127068 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883074a0-57e5-4b07-b6c3-0da06057fddd None admin] RBAC: Authorizing `identity:create_grant(project_id=5d1d6f8141924b2d99b766f975a3d43b, user_id=ec202a34db8e47f4a6c18285245e3f5b, role_id=0abd451d1e894a6b8575ab7e6685f50a)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:39.128481 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883074a0-57e5-4b07-b6c3-0da06057fddd None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:39.142520 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 539/1076] 10.222.0.21 () {58 vars in 1439 bytes} [Mon Feb 28 10:19:38 2022] PUT /identity/v3/projects/5d1d6f8141924b2d99b766f975a3d43b/users/ec202a34db8e47f4a6c18285245e3f5b/roles/0abd451d1e894a6b8575ab7e6685f50a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:19:39.157212 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058a60c-cb58-419c-95ef-e4e4e20d8dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:39.158474 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058a60c-cb58-419c-95ef-e4e4e20d8dbe None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:39.158939 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058a60c-cb58-419c-95ef-e4e4e20d8dbe None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:39.159379 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058a60c-cb58-419c-95ef-e4e4e20d8dbe None admin] PATH_INFO: `/v3/users/21811013bdcf4d8b847a4d9ff90b1d32` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:39.160965 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058a60c-cb58-419c-95ef-e4e4e20d8dbe None admin] RBAC: Authorizing `identity:get_user(user_id=21811013bdcf4d8b847a4d9ff90b1d32)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:39.162732 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058a60c-cb58-419c-95ef-e4e4e20d8dbe None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:39.164731 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 538/1077] 10.222.0.21 () {56 vars in 1177 bytes} [Mon Feb 28 10:19:39 2022] GET /identity/v3/users/21811013bdcf4d8b847a4d9ff90b1d32 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:19:39.171759 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883074a0-57e5-4b07-b6c3-0da06057fddd None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:39.276661 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883074a0-57e5-4b07-b6c3-0da06057fddd None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:39.311874 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f693f54c-b03a-414a-b75e-2f9715bdd99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:39.312741 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693f54c-b03a-414a-b75e-2f9715bdd99d None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:39.313020 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693f54c-b03a-414a-b75e-2f9715bdd99d None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:39.313290 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693f54c-b03a-414a-b75e-2f9715bdd99d None admin] PATH_INFO: `/v3/projects/5d1a8371aac3476ebd566b1ac7b60729` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:39.314514 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f693f54c-b03a-414a-b75e-2f9715bdd99d None admin] RBAC: Authorizing `identity:get_project(project_id=5d1a8371aac3476ebd566b1ac7b60729)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:39.315967 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f693f54c-b03a-414a-b75e-2f9715bdd99d None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:39.318273 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 540/1078] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:19:39 2022] GET /identity/v3/projects/5d1a8371aac3476ebd566b1ac7b60729 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:19:39.324098 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058a60c-cb58-419c-95ef-e4e4e20d8dbe None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:39.398911 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95c0e4-c360-4e88-9a96-db53880d0112 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:39.399203 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95c0e4-c360-4e88-9a96-db53880d0112 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:39.399555 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95c0e4-c360-4e88-9a96-db53880d0112 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:39.401470 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 541/1079] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:19:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:19:39.407038 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7efcf-ddef-47c7-a923-ace6d6ea7b6e None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:39.407324 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7efcf-ddef-47c7-a923-ace6d6ea7b6e None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:39.407605 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7efcf-ddef-47c7-a923-ace6d6ea7b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:39.424245 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-19c7efcf-ddef-47c7-a923-ace6d6ea7b6e None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:19:39.425388 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058a60c-cb58-419c-95ef-e4e4e20d8dbe None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:39.425523 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-19c7efcf-ddef-47c7-a923-ace6d6ea7b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:19:39.459670 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52ce13-2315-4d0b-b7db-d26f9e714392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:39.460549 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52ce13-2315-4d0b-b7db-d26f9e714392 None admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:39.460825 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52ce13-2315-4d0b-b7db-d26f9e714392 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:39.461094 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52ce13-2315-4d0b-b7db-d26f9e714392 None admin] PATH_INFO: `/v3/projects/5d1a8371aac3476ebd566b1ac7b60729/users/21811013bdcf4d8b847a4d9ff90b1d32/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:39.463078 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52ce13-2315-4d0b-b7db-d26f9e714392 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d1a8371aac3476ebd566b1ac7b60729, user_id=21811013bdcf4d8b847a4d9ff90b1d32, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:39.464510 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52ce13-2315-4d0b-b7db-d26f9e714392 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:39.479610 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 539/1080] 10.222.0.21 () {58 vars in 1439 bytes} [Mon Feb 28 10:19:39 2022] PUT /identity/v3/projects/5d1a8371aac3476ebd566b1ac7b60729/users/21811013bdcf4d8b847a4d9ff90b1d32/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:19:39.495370 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 542/1081] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:19:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 10:19:39.518616 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52ce13-2315-4d0b-b7db-d26f9e714392 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:39.623833 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52ce13-2315-4d0b-b7db-d26f9e714392 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:39.662583 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da0ebc3-da52-477f-9349-e48aab7a7fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:39.663284 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0ebc3-da52-477f-9349-e48aab7a7fd6 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:39.663567 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0ebc3-da52-477f-9349-e48aab7a7fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:39.663842 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0ebc3-da52-477f-9349-e48aab7a7fd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:39.729779 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da0ebc3-da52-477f-9349-e48aab7a7fd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:39.731325 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da0ebc3-da52-477f-9349-e48aab7a7fd6 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:39.824471 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 540/1082] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:19:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 10:19:39.830470 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c7efcf-ddef-47c7-a923-ace6d6ea7b6e None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:39.925876 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c7efcf-ddef-47c7-a923-ace6d6ea7b6e None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:39.957581 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4fa07-c4f3-4cc9-800a-aa4f7fbbfed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:39.958363 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4fa07-c4f3-4cc9-800a-aa4f7fbbfed9 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:39.958668 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4fa07-c4f3-4cc9-800a-aa4f7fbbfed9 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:39.958944 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4fa07-c4f3-4cc9-800a-aa4f7fbbfed9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:39.969372 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a4fa07-c4f3-4cc9-800a-aa4f7fbbfed9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:39.970840 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a4fa07-c4f3-4cc9-800a-aa4f7fbbfed9 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:39.987458 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-84a4fa07-c4f3-4cc9-800a-aa4f7fbbfed9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:19:39.988644 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 543/1083] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:19:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:39.994769 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da0ebc3-da52-477f-9349-e48aab7a7fd6 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:40.088412 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da0ebc3-da52-477f-9349-e48aab7a7fd6 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:40.120941 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd8f4b-9133-4315-9b6d-6acd486ccf78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:40.121747 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd8f4b-9133-4315-9b6d-6acd486ccf78 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:40.122023 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd8f4b-9133-4315-9b6d-6acd486ccf78 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:40.122292 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd8f4b-9133-4315-9b6d-6acd486ccf78 None admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:40.123026 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdd8f4b-9133-4315-9b6d-6acd486ccf78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:40.123325 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdd8f4b-9133-4315-9b6d-6acd486ccf78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:40.124686 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdd8f4b-9133-4315-9b6d-6acd486ccf78 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:40.135580 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 541/1084] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:41.533704 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bf8f6-a3dc-447f-90d3-f6e46fa0ba57 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:41.534246 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bf8f6-a3dc-447f-90d3-f6e46fa0ba57 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:41.534246 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bf8f6-a3dc-447f-90d3-f6e46fa0ba57 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:41.536094 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 544/1085] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:19:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:19:41.541544 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0533b7-aee2-464b-9a1f-b1ee19e64478 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:41.541990 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0533b7-aee2-464b-9a1f-b1ee19e64478 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:41.542086 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0533b7-aee2-464b-9a1f-b1ee19e64478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:41.559726 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-2a0533b7-aee2-464b-9a1f-b1ee19e64478 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:19:41.560892 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-2a0533b7-aee2-464b-9a1f-b1ee19e64478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:19:41.624438 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 542/1086] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:19:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:19:41.648133 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492bf8f6-a3dc-447f-90d3-f6e46fa0ba57 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:41.744750 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492bf8f6-a3dc-447f-90d3-f6e46fa0ba57 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:41.772274 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b85ac9-7497-4718-8e44-16b3d78af3d5 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:41.772560 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b85ac9-7497-4718-8e44-16b3d78af3d5 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:41.772836 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b85ac9-7497-4718-8e44-16b3d78af3d5 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:41.774668 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 543/1087] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:19:41.777072 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d541e-8a28-4de4-9bce-ee29c454139b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:41.778425 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d541e-8a28-4de4-9bce-ee29c454139b None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:41.778735 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d541e-8a28-4de4-9bce-ee29c454139b None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:41.779012 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d541e-8a28-4de4-9bce-ee29c454139b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:41.780270 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2f9bd-4313-4e3e-93b6-2f4180c485c8 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:41.780550 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2f9bd-4313-4e3e-93b6-2f4180c485c8 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:41.780825 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2f9bd-4313-4e3e-93b6-2f4180c485c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:41.788921 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d541e-8a28-4de4-9bce-ee29c454139b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:19:41.796170 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-858d541e-8a28-4de4-9bce-ee29c454139b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 28 10:19:41.802224 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 545/1088] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Feb 28 10:19:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:41.802385 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-c6d2f9bd-4313-4e3e-93b6-2f4180c485c8 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:19:41.802385 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-c6d2f9bd-4313-4e3e-93b6-2f4180c485c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:19:41.803206 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d541e-8a28-4de4-9bce-ee29c454139b None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:41.866088 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 544/1089] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:19:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 10:19:41.889555 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2f9bd-4313-4e3e-93b6-2f4180c485c8 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:41.899594 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d541e-8a28-4de4-9bce-ee29c454139b None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:41.930494 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fca3028-5676-4912-af45-b8dd1dde1b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:41.931165 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca3028-5676-4912-af45-b8dd1dde1b6d None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:41.931439 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca3028-5676-4912-af45-b8dd1dde1b6d None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:41.931704 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca3028-5676-4912-af45-b8dd1dde1b6d None admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:41.932428 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fca3028-5676-4912-af45-b8dd1dde1b6d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:41.932723 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fca3028-5676-4912-af45-b8dd1dde1b6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:41.934648 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fca3028-5676-4912-af45-b8dd1dde1b6d None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:41.942173 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 546/1090] 10.222.0.21 () {56 vars in 1115 bytes} [Mon Feb 28 10:19:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:41.947610 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fca3028-5676-4912-af45-b8dd1dde1b6d None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:41.983800 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2f9bd-4313-4e3e-93b6-2f4180c485c8 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:42.018885 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca70a610-ae6d-4f7b-9fd3-91a8fde77d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:42.019661 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70a610-ae6d-4f7b-9fd3-91a8fde77d6b None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:42.019941 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70a610-ae6d-4f7b-9fd3-91a8fde77d6b None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:42.020215 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70a610-ae6d-4f7b-9fd3-91a8fde77d6b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:42.030322 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca70a610-ae6d-4f7b-9fd3-91a8fde77d6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:19:42.037036 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-ca70a610-ae6d-4f7b-9fd3-91a8fde77d6b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:19:42.038391 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 545/1091] 10.222.0.21 () {56 vars in 1096 bytes} [Mon Feb 28 10:19:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:19:42.041089 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fca3028-5676-4912-af45-b8dd1dde1b6d None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:42.045151 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca70a610-ae6d-4f7b-9fd3-91a8fde77d6b None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:42.073527 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69bb1f-7176-4925-a6d0-ac6dfa63def1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:42.074588 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69bb1f-7176-4925-a6d0-ac6dfa63def1 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:42.074902 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69bb1f-7176-4925-a6d0-ac6dfa63def1 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:42.075168 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69bb1f-7176-4925-a6d0-ac6dfa63def1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:42.085274 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69bb1f-7176-4925-a6d0-ac6dfa63def1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:42.086767 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69bb1f-7176-4925-a6d0-ac6dfa63def1 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:42.104704 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-0a69bb1f-7176-4925-a6d0-ac6dfa63def1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:19:42.106908 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 547/1092] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:19:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:19:42.112277 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69bb1f-7176-4925-a6d0-ac6dfa63def1 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:42.141665 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca70a610-ae6d-4f7b-9fd3-91a8fde77d6b None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:42.174093 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486eccec-424c-41bb-8fd8-2d707c512795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:42.174776 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486eccec-424c-41bb-8fd8-2d707c512795 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:42.175059 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486eccec-424c-41bb-8fd8-2d707c512795 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:42.175328 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486eccec-424c-41bb-8fd8-2d707c512795 None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:42.176052 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486eccec-424c-41bb-8fd8-2d707c512795 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:42.176351 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486eccec-424c-41bb-8fd8-2d707c512795 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:42.177697 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486eccec-424c-41bb-8fd8-2d707c512795 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:42.185483 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 546/1093] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:19:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:19:42.191058 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486eccec-424c-41bb-8fd8-2d707c512795 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:42.206235 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69bb1f-7176-4925-a6d0-ac6dfa63def1 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:42.238505 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d9c13-5723-45e4-b1fa-5da4b5a7ca58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:42.239190 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d9c13-5723-45e4-b1fa-5da4b5a7ca58 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:42.239471 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d9c13-5723-45e4-b1fa-5da4b5a7ca58 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:42.239746 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d9c13-5723-45e4-b1fa-5da4b5a7ca58 None admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:42.240451 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d9c13-5723-45e4-b1fa-5da4b5a7ca58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:42.240752 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d9c13-5723-45e4-b1fa-5da4b5a7ca58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:42.242106 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d9c13-5723-45e4-b1fa-5da4b5a7ca58 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:42.253416 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 548/1094] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:19:42.258915 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d9c13-5723-45e4-b1fa-5da4b5a7ca58 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:42.287290 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486eccec-424c-41bb-8fd8-2d707c512795 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:42.318577 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a2ad6-c7e9-42b5-b750-601dc89e8203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:42.319384 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a2ad6-c7e9-42b5-b750-601dc89e8203 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:42.319660 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a2ad6-c7e9-42b5-b750-601dc89e8203 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:42.319931 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a2ad6-c7e9-42b5-b750-601dc89e8203 None admin] PATH_INFO: `/v3/users/21811013bdcf4d8b847a4d9ff90b1d32` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:42.321112 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2a2ad6-c7e9-42b5-b750-601dc89e8203 None admin] RBAC: Authorizing `identity:get_user(user_id=21811013bdcf4d8b847a4d9ff90b1d32)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:42.322519 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2a2ad6-c7e9-42b5-b750-601dc89e8203 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:42.324938 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 547/1095] 10.222.0.21 () {56 vars in 1177 bytes} [Mon Feb 28 10:19:42 2022] GET /identity/v3/users/21811013bdcf4d8b847a4d9ff90b1d32 => generated 285 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:19:42.330514 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a2ad6-c7e9-42b5-b750-601dc89e8203 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:42.352103 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d9c13-5723-45e4-b1fa-5da4b5a7ca58 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:42.383624 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca29fc-934b-4098-a7d5-034b7d7f4e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:42.384393 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca29fc-934b-4098-a7d5-034b7d7f4e5f None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:42.384670 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca29fc-934b-4098-a7d5-034b7d7f4e5f None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:42.384956 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca29fc-934b-4098-a7d5-034b7d7f4e5f None admin] PATH_INFO: `/v3/users/nova` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:42.392205 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca29fc-934b-4098-a7d5-034b7d7f4e5f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:42.393630 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca29fc-934b-4098-a7d5-034b7d7f4e5f None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:42.407314 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-c1ca29fc-934b-4098-a7d5-034b7d7f4e5f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 10:19:42.408470 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 549/1096] 10.222.0.21 () {56 vars in 1093 bytes} [Mon Feb 28 10:19:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:19:42.414040 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca29fc-934b-4098-a7d5-034b7d7f4e5f None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:42.424961 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a2ad6-c7e9-42b5-b750-601dc89e8203 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:42.456695 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f97de-1a5b-45a2-9a03-477397c071f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:42.457326 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f97de-1a5b-45a2-9a03-477397c071f8 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:42.457613 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f97de-1a5b-45a2-9a03-477397c071f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:42.457883 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f97de-1a5b-45a2-9a03-477397c071f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:42.506230 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca29fc-934b-4098-a7d5-034b7d7f4e5f None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:42.520458 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f97de-1a5b-45a2-9a03-477397c071f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:42.521896 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f97de-1a5b-45a2-9a03-477397c071f8 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:42.539882 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aed982-c080-4156-af59-9f653dad0692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:42.540530 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aed982-c080-4156-af59-9f653dad0692 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:42.540809 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aed982-c080-4156-af59-9f653dad0692 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:42.541129 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aed982-c080-4156-af59-9f653dad0692 None admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:42.541881 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aed982-c080-4156-af59-9f653dad0692 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:42.542182 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aed982-c080-4156-af59-9f653dad0692 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:42.544242 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aed982-c080-4156-af59-9f653dad0692 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:42.561056 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 550/1097] 10.222.0.21 () {56 vars in 1133 bytes} [Mon Feb 28 10:19:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:19:42.566683 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aed982-c080-4156-af59-9f653dad0692 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:42.623965 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 548/1098] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:19:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Feb 28 10:19:42.624907 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f97de-1a5b-45a2-9a03-477397c071f8 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:42.661022 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aed982-c080-4156-af59-9f653dad0692 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:42.692479 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef0820-2b0a-452d-b031-ea74673ce107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:42.693104 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef0820-2b0a-452d-b031-ea74673ce107 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:42.693380 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef0820-2b0a-452d-b031-ea74673ce107 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:42.693650 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef0820-2b0a-452d-b031-ea74673ce107 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:42.718182 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f97de-1a5b-45a2-9a03-477397c071f8 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:42.749883 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a062e-afd4-4bb3-9a56-73b3869ecea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:42.750742 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a062e-afd4-4bb3-9a56-73b3869ecea7 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:42.751022 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a062e-afd4-4bb3-9a56-73b3869ecea7 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:42.751292 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a062e-afd4-4bb3-9a56-73b3869ecea7 None admin] PATH_INFO: `/v3/projects/5d1a8371aac3476ebd566b1ac7b60729` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:42.752454 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a062e-afd4-4bb3-9a56-73b3869ecea7 None admin] RBAC: Authorizing `identity:get_project(project_id=5d1a8371aac3476ebd566b1ac7b60729)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:42.753865 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a062e-afd4-4bb3-9a56-73b3869ecea7 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:42.755575 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 549/1099] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:19:42 2022] GET /identity/v3/projects/5d1a8371aac3476ebd566b1ac7b60729 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:19:42.756699 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef0820-2b0a-452d-b031-ea74673ce107 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:42.758110 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef0820-2b0a-452d-b031-ea74673ce107 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:42.761597 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a062e-afd4-4bb3-9a56-73b3869ecea7 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:42.856086 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 551/1100] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:19:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Feb 28 10:19:42.856833 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a062e-afd4-4bb3-9a56-73b3869ecea7 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:42.861718 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef0820-2b0a-452d-b031-ea74673ce107 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:42.891215 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a561f67-7f4f-4c5f-8326-ccad17557d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:42.891786 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a561f67-7f4f-4c5f-8326-ccad17557d4b None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:42.892065 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a561f67-7f4f-4c5f-8326-ccad17557d4b None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:42.892333 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a561f67-7f4f-4c5f-8326-ccad17557d4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:42.893148 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a561f67-7f4f-4c5f-8326-ccad17557d4b None admin] RBAC: Adding query filter params (role.id=48e4608a7b3f4b87a20b10c4d1b45aa9, scope.project.id=5d1a8371aac3476ebd566b1ac7b60729, user.id=21811013bdcf4d8b847a4d9ff90b1d32) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:42.893451 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a561f67-7f4f-4c5f-8326-ccad17557d4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:42.894915 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a561f67-7f4f-4c5f-8326-ccad17557d4b None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:42.911542 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 550/1101] 10.222.0.21 () {56 vars in 1374 bytes} [Mon Feb 28 10:19:42 2022] GET /identity/v3/role_assignments?user.id=21811013bdcf4d8b847a4d9ff90b1d32&scope.project.id=5d1a8371aac3476ebd566b1ac7b60729&role.id=48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:19:42.959709 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef0820-2b0a-452d-b031-ea74673ce107 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:42.994102 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64667644-dbe9-4723-8b7f-38af7cb4d158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:42.994934 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64667644-dbe9-4723-8b7f-38af7cb4d158 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:42.995211 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64667644-dbe9-4723-8b7f-38af7cb4d158 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:42.995477 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64667644-dbe9-4723-8b7f-38af7cb4d158 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:43.006496 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64667644-dbe9-4723-8b7f-38af7cb4d158 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:43.007978 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64667644-dbe9-4723-8b7f-38af7cb4d158 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:43.025196 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-64667644-dbe9-4723-8b7f-38af7cb4d158 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:19:43.026449 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 552/1102] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:19:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:43.033111 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a561f67-7f4f-4c5f-8326-ccad17557d4b None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:43.132491 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a561f67-7f4f-4c5f-8326-ccad17557d4b None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:43.164821 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc89c6-dedc-4d83-9d7f-56cdffafad7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:43.165399 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc89c6-dedc-4d83-9d7f-56cdffafad7d None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:43.165678 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc89c6-dedc-4d83-9d7f-56cdffafad7d None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:43.165952 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc89c6-dedc-4d83-9d7f-56cdffafad7d None admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:43.166685 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc89c6-dedc-4d83-9d7f-56cdffafad7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:43.166996 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc89c6-dedc-4d83-9d7f-56cdffafad7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:43.169021 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc89c6-dedc-4d83-9d7f-56cdffafad7d None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:43.179815 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 551/1103] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:43.185491 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64667644-dbe9-4723-8b7f-38af7cb4d158 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:43.280598 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64667644-dbe9-4723-8b7f-38af7cb4d158 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:43.311969 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5972f7e-28a3-462a-ac43-f003c878b502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:43.312737 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5972f7e-28a3-462a-ac43-f003c878b502 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:43.313010 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5972f7e-28a3-462a-ac43-f003c878b502 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:43.313274 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5972f7e-28a3-462a-ac43-f003c878b502 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:43.319628 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5972f7e-28a3-462a-ac43-f003c878b502 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:43.321038 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5972f7e-28a3-462a-ac43-f003c878b502 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:43.334265 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-b5972f7e-28a3-462a-ac43-f003c878b502 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:19:43.335440 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 553/1104] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:19:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:19:43.341839 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc89c6-dedc-4d83-9d7f-56cdffafad7d None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:43.435904 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc89c6-dedc-4d83-9d7f-56cdffafad7d None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:43.467642 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2884bb0-4bee-4452-99e2-1f8caa7545f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:43.468287 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2884bb0-4bee-4452-99e2-1f8caa7545f7 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:43.468567 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2884bb0-4bee-4452-99e2-1f8caa7545f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:43.468841 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2884bb0-4bee-4452-99e2-1f8caa7545f7 None admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:43.469604 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2884bb0-4bee-4452-99e2-1f8caa7545f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:43.469908 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2884bb0-4bee-4452-99e2-1f8caa7545f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:43.471373 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2884bb0-4bee-4452-99e2-1f8caa7545f7 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:43.483477 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 552/1105] 10.222.0.21 () {56 vars in 1148 bytes} [Mon Feb 28 10:19:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:43.489519 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5972f7e-28a3-462a-ac43-f003c878b502 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:43.586218 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5972f7e-28a3-462a-ac43-f003c878b502 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:43.618068 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ea56a-6f84-4891-b5a4-dd66679423c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:43.618753 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ea56a-6f84-4891-b5a4-dd66679423c2 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:43.619037 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ea56a-6f84-4891-b5a4-dd66679423c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:43.619311 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ea56a-6f84-4891-b5a4-dd66679423c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:43.620126 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ea56a-6f84-4891-b5a4-dd66679423c2 None admin] RBAC: Adding query filter params (role.id=0abd451d1e894a6b8575ab7e6685f50a, scope.project.id=5d1d6f8141924b2d99b766f975a3d43b, user.id=ec202a34db8e47f4a6c18285245e3f5b) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:43.620434 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ea56a-6f84-4891-b5a4-dd66679423c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:43.622457 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ea56a-6f84-4891-b5a4-dd66679423c2 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:43.628097 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 554/1106] 10.222.0.21 () {56 vars in 1374 bytes} [Mon Feb 28 10:19:43 2022] GET /identity/v3/role_assignments?user.id=ec202a34db8e47f4a6c18285245e3f5b&scope.project.id=5d1d6f8141924b2d99b766f975a3d43b&role.id=0abd451d1e894a6b8575ab7e6685f50a => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:19:45.249561 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19844f5d-b284-4f47-8106-bbeea2fa8db2 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:45.250065 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19844f5d-b284-4f47-8106-bbeea2fa8db2 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:45.250065 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19844f5d-b284-4f47-8106-bbeea2fa8db2 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:45.251827 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 553/1107] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:19:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:19:45.257136 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ceed84-2601-4323-87e3-9a682b7f0f69 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:45.257535 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ceed84-2601-4323-87e3-9a682b7f0f69 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:45.257687 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ceed84-2601-4323-87e3-9a682b7f0f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:45.274584 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-a5ceed84-2601-4323-87e3-9a682b7f0f69 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:19:45.275800 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-a5ceed84-2601-4323-87e3-9a682b7f0f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:19:45.337139 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 555/1108] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:19:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:19:45.362629 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19844f5d-b284-4f47-8106-bbeea2fa8db2 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:45.456424 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19844f5d-b284-4f47-8106-bbeea2fa8db2 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:45.487986 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e6540-2f8b-47e6-a3e1-7a0e3fb54c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:45.488742 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e6540-2f8b-47e6-a3e1-7a0e3fb54c44 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:45.489016 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e6540-2f8b-47e6-a3e1-7a0e3fb54c44 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:45.489280 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e6540-2f8b-47e6-a3e1-7a0e3fb54c44 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:45.490433 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e6540-2f8b-47e6-a3e1-7a0e3fb54c44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:45.491882 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e6540-2f8b-47e6-a3e1-7a0e3fb54c44 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:45.493453 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 554/1109] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:19:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:45.499681 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ceed84-2601-4323-87e3-9a682b7f0f69 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:45.591036 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ceed84-2601-4323-87e3-9a682b7f0f69 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:45.623152 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e6db08-00e1-4097-8bfc-df9f3d131efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:45.623795 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6db08-00e1-4097-8bfc-df9f3d131efa None admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:45.624073 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6db08-00e1-4097-8bfc-df9f3d131efa None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:45.624344 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6db08-00e1-4097-8bfc-df9f3d131efa None admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:45.625036 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e6db08-00e1-4097-8bfc-df9f3d131efa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:45.626432 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e6db08-00e1-4097-8bfc-df9f3d131efa None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:45.644974 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 556/1110] 10.222.0.21 () {60 vars in 1132 bytes} [Mon Feb 28 10:19:45 2022] POST /identity/v3/users => generated 286 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:19:47.950235 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359eae22-2055-41cb-9af5-d3592c3ae965 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:47.950799 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359eae22-2055-41cb-9af5-d3592c3ae965 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:47.950799 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359eae22-2055-41cb-9af5-d3592c3ae965 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:47.952663 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 555/1111] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:19:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:19:47.957791 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf951a51-5ee0-40f8-af66-8446dcbe76b7 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:47.958196 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf951a51-5ee0-40f8-af66-8446dcbe76b7 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:47.958413 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf951a51-5ee0-40f8-af66-8446dcbe76b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:47.975623 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-cf951a51-5ee0-40f8-af66-8446dcbe76b7 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:19:47.976782 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-cf951a51-5ee0-40f8-af66-8446dcbe76b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:19:48.039891 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 557/1112] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:19:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 10:19:48.067643 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359eae22-2055-41cb-9af5-d3592c3ae965 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:48.163537 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359eae22-2055-41cb-9af5-d3592c3ae965 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:48.195707 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e7a39-8dd5-4772-81a2-45a746827cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:48.196511 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e7a39-8dd5-4772-81a2-45a746827cd7 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:48.196785 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e7a39-8dd5-4772-81a2-45a746827cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:48.197054 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e7a39-8dd5-4772-81a2-45a746827cd7 None admin] PATH_INFO: `/v3/roles/101ea48f12324cee9b597825e21f34b4` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:48.198483 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4e7a39-8dd5-4772-81a2-45a746827cd7 None admin] RBAC: Authorizing `identity:get_role(role_id=101ea48f12324cee9b597825e21f34b4)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:48.200561 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4e7a39-8dd5-4772-81a2-45a746827cd7 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:48.201884 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 556/1113] 10.222.0.21 () {56 vars in 1177 bytes} [Mon Feb 28 10:19:48 2022] GET /identity/v3/roles/101ea48f12324cee9b597825e21f34b4 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:48.207533 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf951a51-5ee0-40f8-af66-8446dcbe76b7 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:48.301228 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf951a51-5ee0-40f8-af66-8446dcbe76b7 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:48.333137 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47e80f-9d28-404c-ad18-297bbe092fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:48.333979 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47e80f-9d28-404c-ad18-297bbe092fb4 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:48.334258 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47e80f-9d28-404c-ad18-297bbe092fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:48.334528 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47e80f-9d28-404c-ad18-297bbe092fb4 None admin] PATH_INFO: `/v3/users/34441663a8f047d6b21beef3dd52d91b` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:48.347429 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b47e80f-9d28-404c-ad18-297bbe092fb4 None admin] RBAC: Authorizing `identity:get_user(user_id=34441663a8f047d6b21beef3dd52d91b)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:48.348843 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b47e80f-9d28-404c-ad18-297bbe092fb4 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:48.350459 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 558/1114] 10.222.0.21 () {56 vars in 1177 bytes} [Mon Feb 28 10:19:48 2022] GET /identity/v3/users/34441663a8f047d6b21beef3dd52d91b => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:48.356818 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e7a39-8dd5-4772-81a2-45a746827cd7 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:48.450483 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e7a39-8dd5-4772-81a2-45a746827cd7 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:48.482420 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434d0a6-ec1c-4928-ae92-b5093815e374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:48.483068 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434d0a6-ec1c-4928-ae92-b5093815e374 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:48.483346 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434d0a6-ec1c-4928-ae92-b5093815e374 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:48.483614 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434d0a6-ec1c-4928-ae92-b5093815e374 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:48.547850 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f434d0a6-ec1c-4928-ae92-b5093815e374 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:48.549271 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f434d0a6-ec1c-4928-ae92-b5093815e374 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:48.639857 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 557/1115] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:19:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 10:19:48.645608 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47e80f-9d28-404c-ad18-297bbe092fb4 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:48.738095 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47e80f-9d28-404c-ad18-297bbe092fb4 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:48.769438 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07aee1f-9735-41c2-9bf8-e05e1422f983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:48.770261 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07aee1f-9735-41c2-9bf8-e05e1422f983 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:48.770534 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07aee1f-9735-41c2-9bf8-e05e1422f983 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:48.770828 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07aee1f-9735-41c2-9bf8-e05e1422f983 None admin] PATH_INFO: `/v3/projects/5d1a8371aac3476ebd566b1ac7b60729` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:48.771958 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07aee1f-9735-41c2-9bf8-e05e1422f983 None admin] RBAC: Authorizing `identity:get_project(project_id=5d1a8371aac3476ebd566b1ac7b60729)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:48.773346 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07aee1f-9735-41c2-9bf8-e05e1422f983 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:48.775085 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 559/1116] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:19:48 2022] GET /identity/v3/projects/5d1a8371aac3476ebd566b1ac7b60729 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:48.781523 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434d0a6-ec1c-4928-ae92-b5093815e374 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:48.874938 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434d0a6-ec1c-4928-ae92-b5093815e374 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:48.906838 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed6d2f9-6df3-4886-aac6-edd98bf68b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:48.907477 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6d2f9-6df3-4886-aac6-edd98bf68b26 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:48.907755 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6d2f9-6df3-4886-aac6-edd98bf68b26 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:48.908026 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6d2f9-6df3-4886-aac6-edd98bf68b26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:48.908833 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed6d2f9-6df3-4886-aac6-edd98bf68b26 None admin] RBAC: Adding query filter params (role.id=101ea48f12324cee9b597825e21f34b4, scope.project.id=5d1a8371aac3476ebd566b1ac7b60729, user.id=34441663a8f047d6b21beef3dd52d91b) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:48.909137 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed6d2f9-6df3-4886-aac6-edd98bf68b26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:48.910582 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed6d2f9-6df3-4886-aac6-edd98bf68b26 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:48.915712 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 558/1117] 10.222.0.21 () {56 vars in 1374 bytes} [Mon Feb 28 10:19:48 2022] GET /identity/v3/role_assignments?user.id=34441663a8f047d6b21beef3dd52d91b&scope.project.id=5d1a8371aac3476ebd566b1ac7b60729&role.id=101ea48f12324cee9b597825e21f34b4 => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:51.225798 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba4d9e-a43b-4ccc-adda-98341c76853a None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:51.226319 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba4d9e-a43b-4ccc-adda-98341c76853a None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:51.226319 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba4d9e-a43b-4ccc-adda-98341c76853a None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:51.228322 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 560/1118] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:19:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:19:51.234017 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ea45e-deec-4040-802e-4af806d934fd None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:51.234425 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ea45e-deec-4040-802e-4af806d934fd None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:51.234569 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ea45e-deec-4040-802e-4af806d934fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:51.252220 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-b94ea45e-deec-4040-802e-4af806d934fd None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:19:51.253395 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-b94ea45e-deec-4040-802e-4af806d934fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:19:51.316006 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 559/1119] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:19:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:19:51.339049 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba4d9e-a43b-4ccc-adda-98341c76853a None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:51.434497 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba4d9e-a43b-4ccc-adda-98341c76853a None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:51.465606 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a76b1b-73ee-41ac-962c-4804ad76669d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:51.466426 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a76b1b-73ee-41ac-962c-4804ad76669d None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:51.466738 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a76b1b-73ee-41ac-962c-4804ad76669d None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:51.467001 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a76b1b-73ee-41ac-962c-4804ad76669d None admin] PATH_INFO: `/v3/roles/101ea48f12324cee9b597825e21f34b4` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:51.468433 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a76b1b-73ee-41ac-962c-4804ad76669d None admin] RBAC: Authorizing `identity:get_role(role_id=101ea48f12324cee9b597825e21f34b4)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:51.469763 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a76b1b-73ee-41ac-962c-4804ad76669d None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:51.471283 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 561/1120] 10.222.0.21 () {56 vars in 1177 bytes} [Mon Feb 28 10:19:51 2022] GET /identity/v3/roles/101ea48f12324cee9b597825e21f34b4 => generated 223 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:51.476932 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ea45e-deec-4040-802e-4af806d934fd None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:51.572132 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ea45e-deec-4040-802e-4af806d934fd None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:51.603600 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ecd847-ba4b-4db7-970c-cab1147f1a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:51.604432 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ecd847-ba4b-4db7-970c-cab1147f1a7a None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:51.604704 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ecd847-ba4b-4db7-970c-cab1147f1a7a None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:51.604972 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ecd847-ba4b-4db7-970c-cab1147f1a7a None admin] PATH_INFO: `/v3/users/34441663a8f047d6b21beef3dd52d91b` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:51.607257 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ecd847-ba4b-4db7-970c-cab1147f1a7a None admin] RBAC: Authorizing `identity:get_user(user_id=34441663a8f047d6b21beef3dd52d91b)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:51.608664 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ecd847-ba4b-4db7-970c-cab1147f1a7a None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:51.610264 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 560/1121] 10.222.0.21 () {56 vars in 1177 bytes} [Mon Feb 28 10:19:51 2022] GET /identity/v3/users/34441663a8f047d6b21beef3dd52d91b => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:51.616145 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a76b1b-73ee-41ac-962c-4804ad76669d None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:51.709680 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a76b1b-73ee-41ac-962c-4804ad76669d None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:51.741512 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a3f0a-6825-41ec-980b-8f8a5ff3a2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:51.742283 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a3f0a-6825-41ec-980b-8f8a5ff3a2df None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:51.742561 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a3f0a-6825-41ec-980b-8f8a5ff3a2df None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:51.742860 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a3f0a-6825-41ec-980b-8f8a5ff3a2df None admin] PATH_INFO: `/v3/projects/5d1a8371aac3476ebd566b1ac7b60729` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:51.744002 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a3f0a-6825-41ec-980b-8f8a5ff3a2df None admin] RBAC: Authorizing `identity:get_project(project_id=5d1a8371aac3476ebd566b1ac7b60729)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:51.745393 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a3f0a-6825-41ec-980b-8f8a5ff3a2df None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:51.747176 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 562/1122] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:19:51 2022] GET /identity/v3/projects/5d1a8371aac3476ebd566b1ac7b60729 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:51.752906 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ecd847-ba4b-4db7-970c-cab1147f1a7a None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:51.845378 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ecd847-ba4b-4db7-970c-cab1147f1a7a None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:51.877663 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeac756-dae7-41dc-9517-eae1b92a9d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:51.878525 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeac756-dae7-41dc-9517-eae1b92a9d37 None admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:51.878831 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeac756-dae7-41dc-9517-eae1b92a9d37 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:51.879101 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeac756-dae7-41dc-9517-eae1b92a9d37 None admin] PATH_INFO: `/v3/projects/5d1a8371aac3476ebd566b1ac7b60729/users/34441663a8f047d6b21beef3dd52d91b/roles/101ea48f12324cee9b597825e21f34b4` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:51.881268 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeac756-dae7-41dc-9517-eae1b92a9d37 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d1a8371aac3476ebd566b1ac7b60729, user_id=34441663a8f047d6b21beef3dd52d91b, role_id=101ea48f12324cee9b597825e21f34b4)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:51.882717 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeac756-dae7-41dc-9517-eae1b92a9d37 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:51.895012 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 561/1123] 10.222.0.21 () {58 vars in 1439 bytes} [Mon Feb 28 10:19:51 2022] PUT /identity/v3/projects/5d1a8371aac3476ebd566b1ac7b60729/users/34441663a8f047d6b21beef3dd52d91b/roles/101ea48f12324cee9b597825e21f34b4 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:19:54.181868 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06828449-2b2a-4610-be79-c251a3cd2b87 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:54.182373 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06828449-2b2a-4610-be79-c251a3cd2b87 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:54.182373 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06828449-2b2a-4610-be79-c251a3cd2b87 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:54.184675 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 563/1124] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:19:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:19:54.189866 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e210cbf-22db-4e33-89ae-05ec14c72cc5 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:54.190275 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e210cbf-22db-4e33-89ae-05ec14c72cc5 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:54.190417 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e210cbf-22db-4e33-89ae-05ec14c72cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:54.207686 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-4e210cbf-22db-4e33-89ae-05ec14c72cc5 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:19:54.208854 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-4e210cbf-22db-4e33-89ae-05ec14c72cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:19:54.271307 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 562/1125] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:19:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:19:54.295283 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06828449-2b2a-4610-be79-c251a3cd2b87 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:54.391316 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06828449-2b2a-4610-be79-c251a3cd2b87 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:54.423135 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a60a6-0a1a-448c-b40e-731570103065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:54.423960 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a60a6-0a1a-448c-b40e-731570103065 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:54.424239 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a60a6-0a1a-448c-b40e-731570103065 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:54.424512 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a60a6-0a1a-448c-b40e-731570103065 None admin] PATH_INFO: `/v3/roles/101ea48f12324cee9b597825e21f34b4` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:54.425973 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a60a6-0a1a-448c-b40e-731570103065 None admin] RBAC: Authorizing `identity:get_role(role_id=101ea48f12324cee9b597825e21f34b4)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:54.427370 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a60a6-0a1a-448c-b40e-731570103065 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:54.428713 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 564/1126] 10.222.0.21 () {56 vars in 1177 bytes} [Mon Feb 28 10:19:54 2022] GET /identity/v3/roles/101ea48f12324cee9b597825e21f34b4 => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:54.434894 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e210cbf-22db-4e33-89ae-05ec14c72cc5 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:54.528255 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e210cbf-22db-4e33-89ae-05ec14c72cc5 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:54.559443 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8e5f5-dbbb-4b74-b426-a88fb09f2cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:54.560281 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8e5f5-dbbb-4b74-b426-a88fb09f2cbb None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:54.560563 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8e5f5-dbbb-4b74-b426-a88fb09f2cbb None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:54.560837 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8e5f5-dbbb-4b74-b426-a88fb09f2cbb None admin] PATH_INFO: `/v3/users/34441663a8f047d6b21beef3dd52d91b` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:54.562014 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8e5f5-dbbb-4b74-b426-a88fb09f2cbb None admin] RBAC: Authorizing `identity:get_user(user_id=34441663a8f047d6b21beef3dd52d91b)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:54.563468 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8e5f5-dbbb-4b74-b426-a88fb09f2cbb None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:54.565067 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 563/1127] 10.222.0.21 () {56 vars in 1177 bytes} [Mon Feb 28 10:19:54 2022] GET /identity/v3/users/34441663a8f047d6b21beef3dd52d91b => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:54.570721 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a60a6-0a1a-448c-b40e-731570103065 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:54.663413 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a60a6-0a1a-448c-b40e-731570103065 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:54.695009 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad942e3-6a3b-46f1-af96-2d39119273ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:54.695573 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad942e3-6a3b-46f1-af96-2d39119273ff None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:54.695855 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad942e3-6a3b-46f1-af96-2d39119273ff None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:54.696130 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad942e3-6a3b-46f1-af96-2d39119273ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:54.758767 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad942e3-6a3b-46f1-af96-2d39119273ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:54.760179 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad942e3-6a3b-46f1-af96-2d39119273ff None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:54.851528 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 565/1128] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:19:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 10:19:54.858039 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8e5f5-dbbb-4b74-b426-a88fb09f2cbb None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:54.950903 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8e5f5-dbbb-4b74-b426-a88fb09f2cbb None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:54.982921 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df4c517-83ac-4545-b152-d26ee9d4a883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:54.983753 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4c517-83ac-4545-b152-d26ee9d4a883 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:54.984054 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4c517-83ac-4545-b152-d26ee9d4a883 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:54.984329 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4c517-83ac-4545-b152-d26ee9d4a883 None admin] PATH_INFO: `/v3/projects/5d1a8371aac3476ebd566b1ac7b60729` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:54.985490 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df4c517-83ac-4545-b152-d26ee9d4a883 None admin] RBAC: Authorizing `identity:get_project(project_id=5d1a8371aac3476ebd566b1ac7b60729)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:54.986945 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df4c517-83ac-4545-b152-d26ee9d4a883 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:54.988620 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 564/1129] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:19:54 2022] GET /identity/v3/projects/5d1a8371aac3476ebd566b1ac7b60729 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:19:54.994671 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad942e3-6a3b-46f1-af96-2d39119273ff None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:55.088512 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad942e3-6a3b-46f1-af96-2d39119273ff None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:55.120029 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28321461-25b0-4d9c-90da-21988918c462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:55.120662 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28321461-25b0-4d9c-90da-21988918c462 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:55.120943 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28321461-25b0-4d9c-90da-21988918c462 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:55.121817 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28321461-25b0-4d9c-90da-21988918c462 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:55.122745 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28321461-25b0-4d9c-90da-21988918c462 None admin] RBAC: Adding query filter params (role.id=101ea48f12324cee9b597825e21f34b4, scope.project.id=5d1a8371aac3476ebd566b1ac7b60729, user.id=34441663a8f047d6b21beef3dd52d91b) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:19:55.123059 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28321461-25b0-4d9c-90da-21988918c462 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:55.124498 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28321461-25b0-4d9c-90da-21988918c462 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:55.130025 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 566/1130] 10.222.0.21 () {56 vars in 1374 bytes} [Mon Feb 28 10:19:54 2022] GET /identity/v3/role_assignments?user.id=34441663a8f047d6b21beef3dd52d91b&scope.project.id=5d1a8371aac3476ebd566b1ac7b60729&role.id=101ea48f12324cee9b597825e21f34b4 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:19:57.420760 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a78774-2596-4cb5-96ba-87d58203d8a1 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:57.421323 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a78774-2596-4cb5-96ba-87d58203d8a1 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:57.421323 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a78774-2596-4cb5-96ba-87d58203d8a1 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:57.423119 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 565/1131] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:19:57.428368 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810080a4-f5b7-490c-9039-e1686793417c None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:57.428787 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810080a4-f5b7-490c-9039-e1686793417c None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:57.428909 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810080a4-f5b7-490c-9039-e1686793417c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:57.445612 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-810080a4-f5b7-490c-9039-e1686793417c None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:19:57.446807 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-810080a4-f5b7-490c-9039-e1686793417c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:19:57.508577 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 567/1132] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:19:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:19:57.531573 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a78774-2596-4cb5-96ba-87d58203d8a1 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:57.628702 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a78774-2596-4cb5-96ba-87d58203d8a1 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:57.660609 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88d52d-739c-43cb-a68f-57955d703423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:57.661376 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88d52d-739c-43cb-a68f-57955d703423 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:57.661658 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88d52d-739c-43cb-a68f-57955d703423 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:57.661927 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88d52d-739c-43cb-a68f-57955d703423 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:57.663106 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88d52d-739c-43cb-a68f-57955d703423 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:57.664530 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88d52d-739c-43cb-a68f-57955d703423 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:57.666112 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 566/1133] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:19:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:19:57.672595 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810080a4-f5b7-490c-9039-e1686793417c None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:19:57.763515 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810080a4-f5b7-490c-9039-e1686793417c None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:19:57.795766 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0cf2a6-dc6a-4618-8c90-eff8ede5b9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:19:57.796400 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0cf2a6-dc6a-4618-8c90-eff8ede5b9b0 None admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:19:57.796676 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0cf2a6-dc6a-4618-8c90-eff8ede5b9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:19:57.796946 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0cf2a6-dc6a-4618-8c90-eff8ede5b9b0 None admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:19:57.797639 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0cf2a6-dc6a-4618-8c90-eff8ede5b9b0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:19:57.799069 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0cf2a6-dc6a-4618-8c90-eff8ede5b9b0 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:19:57.823565 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 568/1134] 10.222.0.21 () {60 vars in 1141 bytes} [Mon Feb 28 10:19:57 2022] POST /identity/v3/projects => generated 311 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:20:00.122943 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03366d10-d967-4549-9045-e93d99d973ce None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:00.123450 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03366d10-d967-4549-9045-e93d99d973ce None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:00.123450 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03366d10-d967-4549-9045-e93d99d973ce None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:00.125177 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 567/1135] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:20:00.130352 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460afebd-a3c6-4fcb-bf49-b074ebc42df9 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:00.130763 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460afebd-a3c6-4fcb-bf49-b074ebc42df9 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:00.130927 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460afebd-a3c6-4fcb-bf49-b074ebc42df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:00.147192 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-460afebd-a3c6-4fcb-bf49-b074ebc42df9 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:20:00.148363 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-460afebd-a3c6-4fcb-bf49-b074ebc42df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:20:00.210163 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 569/1136] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:20:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 10:20:00.234842 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03366d10-d967-4549-9045-e93d99d973ce None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:20:00.329021 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03366d10-d967-4549-9045-e93d99d973ce None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:20:00.360418 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec90f4-ea9b-4b2b-9592-376252426a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:20:00.361185 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec90f4-ea9b-4b2b-9592-376252426a88 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:00.361460 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec90f4-ea9b-4b2b-9592-376252426a88 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:00.361726 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec90f4-ea9b-4b2b-9592-376252426a88 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:00.362894 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec90f4-ea9b-4b2b-9592-376252426a88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:20:00.364298 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec90f4-ea9b-4b2b-9592-376252426a88 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:20:00.365876 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 568/1137] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:20:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:20:00.372291 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460afebd-a3c6-4fcb-bf49-b074ebc42df9 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:20:00.463903 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460afebd-a3c6-4fcb-bf49-b074ebc42df9 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:20:00.495019 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d100abb-5967-4cbf-8854-db03e4b01ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:20:00.495663 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d100abb-5967-4cbf-8854-db03e4b01ac8 None admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:00.495945 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d100abb-5967-4cbf-8854-db03e4b01ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:00.496298 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d100abb-5967-4cbf-8854-db03e4b01ac8 None admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:00.497170 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d100abb-5967-4cbf-8854-db03e4b01ac8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:20:00.498578 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d100abb-5967-4cbf-8854-db03e4b01ac8 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:20:00.517701 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 570/1138] 10.222.0.21 () {60 vars in 1132 bytes} [Mon Feb 28 10:20:00 2022] POST /identity/v3/users => generated 286 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:20:02.843438 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423a4a6-8f1c-4828-aca1-7816f2321563 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:02.843965 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423a4a6-8f1c-4828-aca1-7816f2321563 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:02.843965 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423a4a6-8f1c-4828-aca1-7816f2321563 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:02.845771 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 569/1139] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:20:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:20:02.851233 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5b54b-0d5d-4569-a656-57b6b9c118d0 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:02.851605 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5b54b-0d5d-4569-a656-57b6b9c118d0 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:02.851780 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5b54b-0d5d-4569-a656-57b6b9c118d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:02.868912 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-c8f5b54b-0d5d-4569-a656-57b6b9c118d0 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:20:02.870086 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-c8f5b54b-0d5d-4569-a656-57b6b9c118d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:20:02.934538 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 571/1140] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:20:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:20:02.960085 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423a4a6-8f1c-4828-aca1-7816f2321563 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:20:03.058868 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423a4a6-8f1c-4828-aca1-7816f2321563 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:20:03.090465 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4af8a4-49b1-4a2e-bd2b-e1fce07636de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:20:03.091429 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4af8a4-49b1-4a2e-bd2b-e1fce07636de None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:03.091710 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4af8a4-49b1-4a2e-bd2b-e1fce07636de None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:03.091979 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4af8a4-49b1-4a2e-bd2b-e1fce07636de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:03.101517 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4af8a4-49b1-4a2e-bd2b-e1fce07636de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:20:03.108878 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-bb4af8a4-49b1-4a2e-bd2b-e1fce07636de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:20:03.110021 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 570/1141] 10.222.0.21 () {56 vars in 1096 bytes} [Mon Feb 28 10:20:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:20:03.116099 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5b54b-0d5d-4569-a656-57b6b9c118d0 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:20:03.208204 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5b54b-0d5d-4569-a656-57b6b9c118d0 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:20:03.239891 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e00573-3d69-466f-9ae7-5a150d0d8c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:20:03.240532 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e00573-3d69-466f-9ae7-5a150d0d8c7f None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:03.240808 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e00573-3d69-466f-9ae7-5a150d0d8c7f None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:03.241077 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e00573-3d69-466f-9ae7-5a150d0d8c7f None admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:03.241798 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e00573-3d69-466f-9ae7-5a150d0d8c7f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:20:03.242094 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e00573-3d69-466f-9ae7-5a150d0d8c7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:20:03.243468 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e00573-3d69-466f-9ae7-5a150d0d8c7f None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:20:03.251091 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 572/1142] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:20:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:20:03.256667 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4af8a4-49b1-4a2e-bd2b-e1fce07636de None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:20:03.350190 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4af8a4-49b1-4a2e-bd2b-e1fce07636de None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:20:03.380925 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32850184-9448-4211-964d-d82eeac6385b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:20:03.381701 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32850184-9448-4211-964d-d82eeac6385b None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:03.381979 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32850184-9448-4211-964d-d82eeac6385b None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:03.382250 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32850184-9448-4211-964d-d82eeac6385b None admin] PATH_INFO: `/v3/users/8f8385ee0834478d82cbe46c7b55654f` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:03.395036 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32850184-9448-4211-964d-d82eeac6385b None admin] RBAC: Authorizing `identity:get_user(user_id=8f8385ee0834478d82cbe46c7b55654f)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:20:03.396452 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32850184-9448-4211-964d-d82eeac6385b None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:20:03.398040 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 571/1143] 10.222.0.21 () {56 vars in 1177 bytes} [Mon Feb 28 10:20:03 2022] GET /identity/v3/users/8f8385ee0834478d82cbe46c7b55654f => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:20:03.404103 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e00573-3d69-466f-9ae7-5a150d0d8c7f None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:20:03.496343 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e00573-3d69-466f-9ae7-5a150d0d8c7f None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:20:03.528032 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be5e79-308b-4dd5-ac0a-73ec7477c6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:20:03.528661 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be5e79-308b-4dd5-ac0a-73ec7477c6db None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:03.528938 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be5e79-308b-4dd5-ac0a-73ec7477c6db None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:03.529205 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be5e79-308b-4dd5-ac0a-73ec7477c6db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:03.590707 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be5e79-308b-4dd5-ac0a-73ec7477c6db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:20:03.592111 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be5e79-308b-4dd5-ac0a-73ec7477c6db None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:20:03.684129 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 573/1144] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:20:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 10:20:03.689888 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32850184-9448-4211-964d-d82eeac6385b None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:20:03.782823 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32850184-9448-4211-964d-d82eeac6385b None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:20:03.814203 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda0856-917d-4936-b521-5c1e483c29a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:20:03.815055 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda0856-917d-4936-b521-5c1e483c29a6 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:03.815332 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda0856-917d-4936-b521-5c1e483c29a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:03.815601 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda0856-917d-4936-b521-5c1e483c29a6 None admin] PATH_INFO: `/v3/projects/1694ecd3465042b1b70d29565e733fb4` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:03.816749 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bda0856-917d-4936-b521-5c1e483c29a6 None admin] RBAC: Authorizing `identity:get_project(project_id=1694ecd3465042b1b70d29565e733fb4)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:20:03.818157 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bda0856-917d-4936-b521-5c1e483c29a6 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:20:03.819835 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 572/1145] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:20:03 2022] GET /identity/v3/projects/1694ecd3465042b1b70d29565e733fb4 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:20:03.825973 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be5e79-308b-4dd5-ac0a-73ec7477c6db None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:20:03.919056 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be5e79-308b-4dd5-ac0a-73ec7477c6db None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:20:03.950635 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd999f7-a276-481b-b956-4e33435a619d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:20:03.951232 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd999f7-a276-481b-b956-4e33435a619d None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:03.951512 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd999f7-a276-481b-b956-4e33435a619d None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:03.951784 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd999f7-a276-481b-b956-4e33435a619d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:03.952590 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd999f7-a276-481b-b956-4e33435a619d None admin] RBAC: Adding query filter params (role.id=48e4608a7b3f4b87a20b10c4d1b45aa9, scope.project.id=1694ecd3465042b1b70d29565e733fb4, user.id=8f8385ee0834478d82cbe46c7b55654f) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:20:03.952898 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd999f7-a276-481b-b956-4e33435a619d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:20:03.954300 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd999f7-a276-481b-b956-4e33435a619d None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:20:03.959449 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 574/1146] 10.222.0.21 () {56 vars in 1374 bytes} [Mon Feb 28 10:20:03 2022] GET /identity/v3/role_assignments?user.id=8f8385ee0834478d82cbe46c7b55654f&scope.project.id=1694ecd3465042b1b70d29565e733fb4&role.id=48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:20:06.241213 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b27752-4bff-4a86-9d6e-894cc8af2444 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:06.241716 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b27752-4bff-4a86-9d6e-894cc8af2444 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:06.241716 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b27752-4bff-4a86-9d6e-894cc8af2444 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:06.243473 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 573/1147] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:20:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:20:06.249128 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc38d8-ab15-4bc3-b6c6-f479739f5089 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:06.249560 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc38d8-ab15-4bc3-b6c6-f479739f5089 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:06.249679 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc38d8-ab15-4bc3-b6c6-f479739f5089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:06.266725 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-75fc38d8-ab15-4bc3-b6c6-f479739f5089 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:20:06.267912 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-75fc38d8-ab15-4bc3-b6c6-f479739f5089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:20:06.333346 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 575/1148] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:20:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:20:06.356740 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b27752-4bff-4a86-9d6e-894cc8af2444 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:20:06.467958 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b27752-4bff-4a86-9d6e-894cc8af2444 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:20:06.500646 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aeae52-d4d2-4056-ae02-9a682320432b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:20:06.501345 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aeae52-d4d2-4056-ae02-9a682320432b None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:06.501625 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aeae52-d4d2-4056-ae02-9a682320432b None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:06.501896 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aeae52-d4d2-4056-ae02-9a682320432b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:06.511383 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aeae52-d4d2-4056-ae02-9a682320432b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:20:06.518114 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-69aeae52-d4d2-4056-ae02-9a682320432b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:20:06.519283 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 574/1149] 10.222.0.21 () {56 vars in 1096 bytes} [Mon Feb 28 10:20:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:20:06.525155 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc38d8-ab15-4bc3-b6c6-f479739f5089 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:20:06.616904 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc38d8-ab15-4bc3-b6c6-f479739f5089 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:20:06.648979 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07bb73d-b5de-4e6f-aa35-665a45b1cbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:20:06.649618 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07bb73d-b5de-4e6f-aa35-665a45b1cbec None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:06.649893 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07bb73d-b5de-4e6f-aa35-665a45b1cbec None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:06.650161 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07bb73d-b5de-4e6f-aa35-665a45b1cbec None admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:06.650914 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07bb73d-b5de-4e6f-aa35-665a45b1cbec None admin] RBAC: Adding query filter params (name=admin) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:20:06.651211 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07bb73d-b5de-4e6f-aa35-665a45b1cbec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:20:06.653250 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07bb73d-b5de-4e6f-aa35-665a45b1cbec None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:20:06.660802 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 576/1150] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:20:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:20:06.666351 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aeae52-d4d2-4056-ae02-9a682320432b None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:20:06.760500 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aeae52-d4d2-4056-ae02-9a682320432b None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:20:06.791488 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5a129-f0e1-4d03-9f3b-ee4702696113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:20:06.792320 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5a129-f0e1-4d03-9f3b-ee4702696113 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:06.792598 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5a129-f0e1-4d03-9f3b-ee4702696113 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:06.792899 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5a129-f0e1-4d03-9f3b-ee4702696113 None admin] PATH_INFO: `/v3/users/8f8385ee0834478d82cbe46c7b55654f` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:06.794076 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad5a129-f0e1-4d03-9f3b-ee4702696113 None admin] RBAC: Authorizing `identity:get_user(user_id=8f8385ee0834478d82cbe46c7b55654f)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:20:06.795510 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad5a129-f0e1-4d03-9f3b-ee4702696113 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:20:06.797103 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 575/1151] 10.222.0.21 () {56 vars in 1177 bytes} [Mon Feb 28 10:20:06 2022] GET /identity/v3/users/8f8385ee0834478d82cbe46c7b55654f => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:20:06.802738 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07bb73d-b5de-4e6f-aa35-665a45b1cbec None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:20:06.897397 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07bb73d-b5de-4e6f-aa35-665a45b1cbec None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:20:06.927857 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed61cd2-e73e-4d25-aee6-531f28ce7508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:20:06.928686 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed61cd2-e73e-4d25-aee6-531f28ce7508 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:06.928966 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed61cd2-e73e-4d25-aee6-531f28ce7508 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:06.929236 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed61cd2-e73e-4d25-aee6-531f28ce7508 None admin] PATH_INFO: `/v3/projects/1694ecd3465042b1b70d29565e733fb4` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:06.930394 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed61cd2-e73e-4d25-aee6-531f28ce7508 None admin] RBAC: Authorizing `identity:get_project(project_id=1694ecd3465042b1b70d29565e733fb4)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:20:06.931835 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed61cd2-e73e-4d25-aee6-531f28ce7508 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:20:06.934039 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 577/1152] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:20:06 2022] GET /identity/v3/projects/1694ecd3465042b1b70d29565e733fb4 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:20:06.939888 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5a129-f0e1-4d03-9f3b-ee4702696113 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:20:07.033344 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5a129-f0e1-4d03-9f3b-ee4702696113 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:20:07.065008 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86bba7-06c9-4e5d-8676-b32765fccf22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:20:07.065867 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86bba7-06c9-4e5d-8676-b32765fccf22 None admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:07.066145 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86bba7-06c9-4e5d-8676-b32765fccf22 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:07.066414 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86bba7-06c9-4e5d-8676-b32765fccf22 None admin] PATH_INFO: `/v3/projects/1694ecd3465042b1b70d29565e733fb4/users/8f8385ee0834478d82cbe46c7b55654f/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:07.068383 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c86bba7-06c9-4e5d-8676-b32765fccf22 None admin] RBAC: Authorizing `identity:create_grant(project_id=1694ecd3465042b1b70d29565e733fb4, user_id=8f8385ee0834478d82cbe46c7b55654f, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:20:07.069793 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c86bba7-06c9-4e5d-8676-b32765fccf22 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:20:07.082255 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 576/1153] 10.222.0.21 () {58 vars in 1439 bytes} [Mon Feb 28 10:20:06 2022] PUT /identity/v3/projects/1694ecd3465042b1b70d29565e733fb4/users/8f8385ee0834478d82cbe46c7b55654f/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:20:09.372284 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26782c13-4aba-4165-9554-55d00565e57b None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:09.372912 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26782c13-4aba-4165-9554-55d00565e57b None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:09.372912 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26782c13-4aba-4165-9554-55d00565e57b None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:09.374943 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 578/1154] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:20:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:20:09.380554 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f466c4d-e608-4b50-9961-aa53c4feb589 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:09.381000 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f466c4d-e608-4b50-9961-aa53c4feb589 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:09.381117 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f466c4d-e608-4b50-9961-aa53c4feb589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:09.397584 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-1f466c4d-e608-4b50-9961-aa53c4feb589 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:20:09.398784 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-1f466c4d-e608-4b50-9961-aa53c4feb589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:20:09.461235 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 577/1155] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:20:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:20:09.485305 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26782c13-4aba-4165-9554-55d00565e57b None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:20:09.582175 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26782c13-4aba-4165-9554-55d00565e57b None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:20:09.614146 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909aefa-2e4f-4d09-9402-edd1a0fd8279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:20:09.614944 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909aefa-2e4f-4d09-9402-edd1a0fd8279 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:09.615223 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909aefa-2e4f-4d09-9402-edd1a0fd8279 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:09.615493 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909aefa-2e4f-4d09-9402-edd1a0fd8279 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:09.625794 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909aefa-2e4f-4d09-9402-edd1a0fd8279 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:20:09.632501 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-0909aefa-2e4f-4d09-9402-edd1a0fd8279 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:20:09.633637 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 579/1156] 10.222.0.21 () {56 vars in 1096 bytes} [Mon Feb 28 10:20:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:20:09.640361 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f466c4d-e608-4b50-9961-aa53c4feb589 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:20:09.733212 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f466c4d-e608-4b50-9961-aa53c4feb589 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:20:09.764860 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4aa16d-55b1-4088-9aba-9cc36938a4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:20:09.765503 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4aa16d-55b1-4088-9aba-9cc36938a4b4 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:09.765781 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4aa16d-55b1-4088-9aba-9cc36938a4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:09.766055 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4aa16d-55b1-4088-9aba-9cc36938a4b4 None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:09.766813 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4aa16d-55b1-4088-9aba-9cc36938a4b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:20:09.767117 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4aa16d-55b1-4088-9aba-9cc36938a4b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:20:09.768464 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4aa16d-55b1-4088-9aba-9cc36938a4b4 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:20:09.776016 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 578/1157] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:20:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:20:09.782170 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909aefa-2e4f-4d09-9402-edd1a0fd8279 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:20:09.875258 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909aefa-2e4f-4d09-9402-edd1a0fd8279 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:20:09.906726 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f55a26-4c4e-4c56-bca3-490abed1dc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:20:09.907510 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f55a26-4c4e-4c56-bca3-490abed1dc32 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:09.907789 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f55a26-4c4e-4c56-bca3-490abed1dc32 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:09.908060 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f55a26-4c4e-4c56-bca3-490abed1dc32 None admin] PATH_INFO: `/v3/users/8f8385ee0834478d82cbe46c7b55654f` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:09.909221 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f55a26-4c4e-4c56-bca3-490abed1dc32 None admin] RBAC: Authorizing `identity:get_user(user_id=8f8385ee0834478d82cbe46c7b55654f)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:20:09.910660 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f55a26-4c4e-4c56-bca3-490abed1dc32 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:20:09.912256 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 580/1158] 10.222.0.21 () {56 vars in 1177 bytes} [Mon Feb 28 10:20:09 2022] GET /identity/v3/users/8f8385ee0834478d82cbe46c7b55654f => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:20:09.917941 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4aa16d-55b1-4088-9aba-9cc36938a4b4 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:20:10.011492 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4aa16d-55b1-4088-9aba-9cc36938a4b4 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:20:10.042718 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445cfe1-b7bd-47cd-8d32-0198e2f1db9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:20:10.043436 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445cfe1-b7bd-47cd-8d32-0198e2f1db9a None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:10.043711 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445cfe1-b7bd-47cd-8d32-0198e2f1db9a None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:10.043979 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445cfe1-b7bd-47cd-8d32-0198e2f1db9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:10.106912 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b445cfe1-b7bd-47cd-8d32-0198e2f1db9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:20:10.108357 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b445cfe1-b7bd-47cd-8d32-0198e2f1db9a None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:20:10.199717 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 579/1159] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:20:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 10:20:10.205887 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f55a26-4c4e-4c56-bca3-490abed1dc32 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:20:10.299449 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f55a26-4c4e-4c56-bca3-490abed1dc32 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:20:10.331061 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883668ef-c83a-4c8b-9e3d-8db54930a656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:20:10.331892 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883668ef-c83a-4c8b-9e3d-8db54930a656 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:10.332174 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883668ef-c83a-4c8b-9e3d-8db54930a656 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:10.332447 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883668ef-c83a-4c8b-9e3d-8db54930a656 None admin] PATH_INFO: `/v3/projects/1694ecd3465042b1b70d29565e733fb4` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:10.333611 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883668ef-c83a-4c8b-9e3d-8db54930a656 None admin] RBAC: Authorizing `identity:get_project(project_id=1694ecd3465042b1b70d29565e733fb4)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:20:10.335055 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883668ef-c83a-4c8b-9e3d-8db54930a656 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:20:10.336711 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 581/1160] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:20:10 2022] GET /identity/v3/projects/1694ecd3465042b1b70d29565e733fb4 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:20:10.343228 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445cfe1-b7bd-47cd-8d32-0198e2f1db9a None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:20:10.436689 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445cfe1-b7bd-47cd-8d32-0198e2f1db9a None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:20:10.469531 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f72a9e-1e36-4ce3-b9f7-e2e771b69c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:20:10.470103 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f72a9e-1e36-4ce3-b9f7-e2e771b69c7b None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:10.470431 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f72a9e-1e36-4ce3-b9f7-e2e771b69c7b None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:10.470728 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f72a9e-1e36-4ce3-b9f7-e2e771b69c7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:10.471530 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f72a9e-1e36-4ce3-b9f7-e2e771b69c7b None admin] RBAC: Adding query filter params (role.id=48e4608a7b3f4b87a20b10c4d1b45aa9, scope.project.id=1694ecd3465042b1b70d29565e733fb4, user.id=8f8385ee0834478d82cbe46c7b55654f) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:20:10.471831 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f72a9e-1e36-4ce3-b9f7-e2e771b69c7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:20:10.473244 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f72a9e-1e36-4ce3-b9f7-e2e771b69c7b None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:20:10.478750 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 580/1161] 10.222.0.21 () {56 vars in 1374 bytes} [Mon Feb 28 10:20:10 2022] GET /identity/v3/role_assignments?user.id=8f8385ee0834478d82cbe46c7b55654f&scope.project.id=1694ecd3465042b1b70d29565e733fb4&role.id=48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:20:12.787185 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb45a04-4b5d-4042-a440-6fa8edfde21d None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:12.787766 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb45a04-4b5d-4042-a440-6fa8edfde21d None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:12.787766 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb45a04-4b5d-4042-a440-6fa8edfde21d None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:12.789517 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 582/1162] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:20:12.794852 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae284f0b-0ff1-4199-853e-5501c516ffdc None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:12.795252 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae284f0b-0ff1-4199-853e-5501c516ffdc None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:12.795400 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae284f0b-0ff1-4199-853e-5501c516ffdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:12.812097 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-ae284f0b-0ff1-4199-853e-5501c516ffdc None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:20:12.813277 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-ae284f0b-0ff1-4199-853e-5501c516ffdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:20:12.878142 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 581/1163] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:20:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:20:12.901171 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb45a04-4b5d-4042-a440-6fa8edfde21d None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:20:12.997332 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb45a04-4b5d-4042-a440-6fa8edfde21d None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:20:13.029215 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa8e4d9-17a3-4292-b6b4-6a31d40b73c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:20:13.029839 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8e4d9-17a3-4292-b6b4-6a31d40b73c0 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:13.030119 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8e4d9-17a3-4292-b6b4-6a31d40b73c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:13.030392 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8e4d9-17a3-4292-b6b4-6a31d40b73c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:13.094591 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa8e4d9-17a3-4292-b6b4-6a31d40b73c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:20:13.096054 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa8e4d9-17a3-4292-b6b4-6a31d40b73c0 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:20:13.187006 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 583/1164] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:20:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 10:20:13.192947 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae284f0b-0ff1-4199-853e-5501c516ffdc None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:20:13.285785 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae284f0b-0ff1-4199-853e-5501c516ffdc None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:20:13.316866 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d736eff5-bfcc-4bd1-bdc2-eaa4cb295bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:20:13.317640 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736eff5-bfcc-4bd1-bdc2-eaa4cb295bba None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:13.317920 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736eff5-bfcc-4bd1-bdc2-eaa4cb295bba None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:13.318190 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736eff5-bfcc-4bd1-bdc2-eaa4cb295bba None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:13.325301 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d736eff5-bfcc-4bd1-bdc2-eaa4cb295bba None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:20:13.326742 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d736eff5-bfcc-4bd1-bdc2-eaa4cb295bba None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:20:13.340985 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-d736eff5-bfcc-4bd1-bdc2-eaa4cb295bba None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Feb 28 10:20:13.342121 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 582/1165] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Feb 28 10:20:13 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:20:13.348150 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa8e4d9-17a3-4292-b6b4-6a31d40b73c0 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:20:13.440792 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa8e4d9-17a3-4292-b6b4-6a31d40b73c0 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:20:13.472824 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6d2e2-209a-4139-88bf-f04821e3bba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:20:13.473528 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6d2e2-209a-4139-88bf-f04821e3bba7 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:13.473737 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6d2e2-209a-4139-88bf-f04821e3bba7 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:13.474007 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6d2e2-209a-4139-88bf-f04821e3bba7 None admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:13.474725 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6d2e2-209a-4139-88bf-f04821e3bba7 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:20:13.475025 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6d2e2-209a-4139-88bf-f04821e3bba7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:20:13.476352 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6d2e2-209a-4139-88bf-f04821e3bba7 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:20:13.483131 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 584/1166] 10.222.0.21 () {56 vars in 1115 bytes} [Mon Feb 28 10:20:13 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:20:15.759934 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f406f-302d-4403-b34a-167dde35631f None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:15.760920 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f406f-302d-4403-b34a-167dde35631f None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:15.760920 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f406f-302d-4403-b34a-167dde35631f None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:15.762866 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 583/1167] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:20:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:20:15.768083 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa5e13-0b93-4b6a-b7c4-c60b346fdda7 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:15.768486 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa5e13-0b93-4b6a-b7c4-c60b346fdda7 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:15.768643 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa5e13-0b93-4b6a-b7c4-c60b346fdda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:15.785105 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-85aa5e13-0b93-4b6a-b7c4-c60b346fdda7 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:20:15.786276 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-85aa5e13-0b93-4b6a-b7c4-c60b346fdda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:20:15.848788 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 585/1168] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:20:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:20:15.872462 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f406f-302d-4403-b34a-167dde35631f None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:20:15.969550 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f406f-302d-4403-b34a-167dde35631f None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:20:16.001103 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb11c9c-6d96-4902-aa75-5caadb54ca17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:20:16.001744 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb11c9c-6d96-4902-aa75-5caadb54ca17 None admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:16.002021 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb11c9c-6d96-4902-aa75-5caadb54ca17 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:16.002292 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb11c9c-6d96-4902-aa75-5caadb54ca17 None admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:16.003051 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb11c9c-6d96-4902-aa75-5caadb54ca17 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:20:16.004419 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb11c9c-6d96-4902-aa75-5caadb54ca17 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:20:16.019601 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 584/1169] 10.222.0.21 () {60 vars in 1138 bytes} [Mon Feb 28 10:20:15 2022] POST /identity/v3/domains => generated 267 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:20:18.327914 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91471a-c9e1-4bf6-a07f-4d0ecb767716 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:18.328434 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91471a-c9e1-4bf6-a07f-4d0ecb767716 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:18.328527 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91471a-c9e1-4bf6-a07f-4d0ecb767716 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:18.330245 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 586/1170] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:20:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:20:18.335485 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e26f8-7312-4361-bfb3-65915e4b4e27 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:18.335879 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e26f8-7312-4361-bfb3-65915e4b4e27 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:18.336039 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e26f8-7312-4361-bfb3-65915e4b4e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:18.353021 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-505e26f8-7312-4361-bfb3-65915e4b4e27 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:20:18.354193 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-505e26f8-7312-4361-bfb3-65915e4b4e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:20:18.416394 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 585/1171] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:20:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 10:20:18.441222 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d91471a-c9e1-4bf6-a07f-4d0ecb767716 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:20:18.539715 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d91471a-c9e1-4bf6-a07f-4d0ecb767716 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:20:18.571507 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003a444-7df5-48c2-ad45-8c0897b51084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:20:18.572340 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003a444-7df5-48c2-ad45-8c0897b51084 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:18.572616 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003a444-7df5-48c2-ad45-8c0897b51084 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:18.572882 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003a444-7df5-48c2-ad45-8c0897b51084 None admin] PATH_INFO: `/v3/domains/29f574bf3c4041f6a156aa86cb0926bc` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:18.584082 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003a444-7df5-48c2-ad45-8c0897b51084 None admin] RBAC: Authorizing `identity:get_domain(domain_id=29f574bf3c4041f6a156aa86cb0926bc)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:20:18.585434 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003a444-7df5-48c2-ad45-8c0897b51084 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:20:18.587060 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 587/1172] 10.222.0.21 () {56 vars in 1183 bytes} [Mon Feb 28 10:20:18 2022] GET /identity/v3/domains/29f574bf3c4041f6a156aa86cb0926bc => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:20:18.593457 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e26f8-7312-4361-bfb3-65915e4b4e27 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:20:18.685850 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e26f8-7312-4361-bfb3-65915e4b4e27 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:20:18.717364 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1818bd-d426-467e-acbc-cdd08b020899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:20:18.717987 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1818bd-d426-467e-acbc-cdd08b020899 None admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:18.718262 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1818bd-d426-467e-acbc-cdd08b020899 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:18.718529 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1818bd-d426-467e-acbc-cdd08b020899 None admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:18.719310 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1818bd-d426-467e-acbc-cdd08b020899 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:20:18.720716 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1818bd-d426-467e-acbc-cdd08b020899 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:20:18.744277 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 586/1173] 10.222.0.21 () {60 vars in 1141 bytes} [Mon Feb 28 10:20:18 2022] POST /identity/v3/projects => generated 361 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:20:21.056314 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b614c98-ed9d-4067-8b89-5452259d0861 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:21.056890 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b614c98-ed9d-4067-8b89-5452259d0861 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:21.056890 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b614c98-ed9d-4067-8b89-5452259d0861 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:21.059222 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 588/1174] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:20:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:20:21.064445 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2ee99-4364-447e-bfdd-be1e0eb5692d None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:21.064854 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2ee99-4364-447e-bfdd-be1e0eb5692d None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:21.064996 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2ee99-4364-447e-bfdd-be1e0eb5692d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:21.082347 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-96e2ee99-4364-447e-bfdd-be1e0eb5692d None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:20:21.083583 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-96e2ee99-4364-447e-bfdd-be1e0eb5692d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:20:21.145970 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 587/1175] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:20:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:20:21.170721 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b614c98-ed9d-4067-8b89-5452259d0861 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:20:21.267354 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b614c98-ed9d-4067-8b89-5452259d0861 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:20:21.298911 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d165dd4-d9c5-494b-9cdd-cdf54b838131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:20:21.299743 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d165dd4-d9c5-494b-9cdd-cdf54b838131 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:21.300024 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d165dd4-d9c5-494b-9cdd-cdf54b838131 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:21.300296 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d165dd4-d9c5-494b-9cdd-cdf54b838131 None admin] PATH_INFO: `/v3/domains/29f574bf3c4041f6a156aa86cb0926bc` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:21.301454 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d165dd4-d9c5-494b-9cdd-cdf54b838131 None admin] RBAC: Authorizing `identity:get_domain(domain_id=29f574bf3c4041f6a156aa86cb0926bc)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:20:21.302895 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d165dd4-d9c5-494b-9cdd-cdf54b838131 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:20:21.304494 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 589/1176] 10.222.0.21 () {56 vars in 1183 bytes} [Mon Feb 28 10:20:21 2022] GET /identity/v3/domains/29f574bf3c4041f6a156aa86cb0926bc => generated 267 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:20:21.310875 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e2ee99-4364-447e-bfdd-be1e0eb5692d None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:20:21.402914 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e2ee99-4364-447e-bfdd-be1e0eb5692d None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:20:21.435037 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d785a32-2bc1-4229-9274-b45308624633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:20:21.435681 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d785a32-2bc1-4229-9274-b45308624633 None admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:21.435958 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d785a32-2bc1-4229-9274-b45308624633 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:21.436232 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d785a32-2bc1-4229-9274-b45308624633 None admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:21.436934 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d785a32-2bc1-4229-9274-b45308624633 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:20:21.438351 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d785a32-2bc1-4229-9274-b45308624633 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:20:21.457534 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 588/1177] 10.222.0.21 () {60 vars in 1132 bytes} [Mon Feb 28 10:20:21 2022] POST /identity/v3/users => generated 311 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:20:23.772512 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68caa3ef-0438-45c0-a60e-137cb2d5be66 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:23.773051 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68caa3ef-0438-45c0-a60e-137cb2d5be66 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:23.773051 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68caa3ef-0438-45c0-a60e-137cb2d5be66 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:23.774989 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 590/1178] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:20:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:20:23.780861 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9908b48-652a-4169-84fb-659133295468 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:23.781245 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9908b48-652a-4169-84fb-659133295468 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:23.781407 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9908b48-652a-4169-84fb-659133295468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:23.797666 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-e9908b48-652a-4169-84fb-659133295468 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:20:23.798855 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-e9908b48-652a-4169-84fb-659133295468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:20:23.862765 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 589/1179] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:20:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:20:23.885517 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68caa3ef-0438-45c0-a60e-137cb2d5be66 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:20:23.981499 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68caa3ef-0438-45c0-a60e-137cb2d5be66 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:20:24.136345 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7d1f4-759c-419c-ad7c-69547823f8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:20:24.137313 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7d1f4-759c-419c-ad7c-69547823f8ea None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:24.137591 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7d1f4-759c-419c-ad7c-69547823f8ea None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:24.137864 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7d1f4-759c-419c-ad7c-69547823f8ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:24.147496 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f7d1f4-759c-419c-ad7c-69547823f8ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:20:24.154763 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-c3f7d1f4-759c-419c-ad7c-69547823f8ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:20:24.155917 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 591/1180] 10.222.0.21 () {56 vars in 1096 bytes} [Mon Feb 28 10:20:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:20:24.162048 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9908b48-652a-4169-84fb-659133295468 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:20:24.254890 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9908b48-652a-4169-84fb-659133295468 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:20:24.286234 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f29a9-ea53-4d77-b7ce-e5ce4e6e9920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:20:24.286923 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f29a9-ea53-4d77-b7ce-e5ce4e6e9920 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:24.287197 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f29a9-ea53-4d77-b7ce-e5ce4e6e9920 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:24.287461 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f29a9-ea53-4d77-b7ce-e5ce4e6e9920 None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:24.288180 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9f29a9-ea53-4d77-b7ce-e5ce4e6e9920 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:20:24.288474 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9f29a9-ea53-4d77-b7ce-e5ce4e6e9920 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:20:24.289895 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9f29a9-ea53-4d77-b7ce-e5ce4e6e9920 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:20:24.298036 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 590/1181] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:20:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:20:24.303630 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7d1f4-759c-419c-ad7c-69547823f8ea None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:20:24.396377 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7d1f4-759c-419c-ad7c-69547823f8ea None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:20:24.427631 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da198968-13af-4d88-8532-5b5603fb6e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:20:24.428467 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da198968-13af-4d88-8532-5b5603fb6e9b None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:24.428744 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da198968-13af-4d88-8532-5b5603fb6e9b None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:24.429014 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da198968-13af-4d88-8532-5b5603fb6e9b None admin] PATH_INFO: `/v3/users/c0d102fd1c294a2aa32cb5fad7b2eff3` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:24.441429 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da198968-13af-4d88-8532-5b5603fb6e9b None admin] RBAC: Authorizing `identity:get_user(user_id=c0d102fd1c294a2aa32cb5fad7b2eff3)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:20:24.442867 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da198968-13af-4d88-8532-5b5603fb6e9b None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:20:24.444486 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 592/1182] 10.222.0.21 () {56 vars in 1177 bytes} [Mon Feb 28 10:20:24 2022] GET /identity/v3/users/c0d102fd1c294a2aa32cb5fad7b2eff3 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:20:24.450934 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f29a9-ea53-4d77-b7ce-e5ce4e6e9920 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:20:24.549284 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f29a9-ea53-4d77-b7ce-e5ce4e6e9920 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:20:24.581274 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b54ab-ce42-486b-8d6b-4353c73ef794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:20:24.581899 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b54ab-ce42-486b-8d6b-4353c73ef794 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:24.582183 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b54ab-ce42-486b-8d6b-4353c73ef794 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:24.582457 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b54ab-ce42-486b-8d6b-4353c73ef794 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:24.657166 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b54ab-ce42-486b-8d6b-4353c73ef794 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:20:24.658553 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b54ab-ce42-486b-8d6b-4353c73ef794 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:20:24.910999 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 591/1183] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:20:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 10:20:24.917458 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da198968-13af-4d88-8532-5b5603fb6e9b None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:20:25.020452 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da198968-13af-4d88-8532-5b5603fb6e9b None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:20:25.055854 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe67ff-e427-433f-9747-dfdb7de493e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:20:25.056715 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe67ff-e427-433f-9747-dfdb7de493e4 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:25.056992 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe67ff-e427-433f-9747-dfdb7de493e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:25.057259 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe67ff-e427-433f-9747-dfdb7de493e4 None admin] PATH_INFO: `/v3/projects/dd2630a8692943ef816061e60a087c3a` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:25.058420 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebe67ff-e427-433f-9747-dfdb7de493e4 None admin] RBAC: Authorizing `identity:get_project(project_id=dd2630a8692943ef816061e60a087c3a)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:20:25.060067 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebe67ff-e427-433f-9747-dfdb7de493e4 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:20:25.062073 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 593/1184] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:20:24 2022] GET /identity/v3/projects/dd2630a8692943ef816061e60a087c3a => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:20:25.070102 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b54ab-ce42-486b-8d6b-4353c73ef794 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:20:25.179872 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b54ab-ce42-486b-8d6b-4353c73ef794 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:20:25.221567 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15480129-7bfb-41bf-ae0f-8d65983479ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:20:25.222555 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15480129-7bfb-41bf-ae0f-8d65983479ae None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:25.222860 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15480129-7bfb-41bf-ae0f-8d65983479ae None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:25.223128 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15480129-7bfb-41bf-ae0f-8d65983479ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:25.223938 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15480129-7bfb-41bf-ae0f-8d65983479ae None admin] RBAC: Adding query filter params (role.id=48e4608a7b3f4b87a20b10c4d1b45aa9, scope.project.id=dd2630a8692943ef816061e60a087c3a, user.id=c0d102fd1c294a2aa32cb5fad7b2eff3) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:20:25.224240 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15480129-7bfb-41bf-ae0f-8d65983479ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:20:25.225653 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15480129-7bfb-41bf-ae0f-8d65983479ae None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:20:25.231292 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 592/1185] 10.222.0.21 () {56 vars in 1374 bytes} [Mon Feb 28 10:20:25 2022] GET /identity/v3/role_assignments?user.id=c0d102fd1c294a2aa32cb5fad7b2eff3&scope.project.id=dd2630a8692943ef816061e60a087c3a&role.id=48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:20:27.514735 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d987a7-e94a-4eb0-ab2b-57eb86093f2f None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:27.515270 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d987a7-e94a-4eb0-ab2b-57eb86093f2f None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:27.515270 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d987a7-e94a-4eb0-ab2b-57eb86093f2f None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:27.517041 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 594/1186] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:20:27.522257 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158866ec-f057-4d8b-8464-1b142a412099 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:27.522676 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158866ec-f057-4d8b-8464-1b142a412099 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:27.522841 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158866ec-f057-4d8b-8464-1b142a412099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:27.539547 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-158866ec-f057-4d8b-8464-1b142a412099 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:20:27.540716 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-158866ec-f057-4d8b-8464-1b142a412099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:20:27.602382 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 593/1187] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:20:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:20:27.625108 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d987a7-e94a-4eb0-ab2b-57eb86093f2f None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:20:27.720639 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d987a7-e94a-4eb0-ab2b-57eb86093f2f None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:20:27.752117 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567119f4-1262-49f1-afee-b5eecf0eb207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:20:27.752885 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567119f4-1262-49f1-afee-b5eecf0eb207 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:27.753163 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567119f4-1262-49f1-afee-b5eecf0eb207 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:27.753431 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567119f4-1262-49f1-afee-b5eecf0eb207 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:27.763051 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567119f4-1262-49f1-afee-b5eecf0eb207 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:20:27.769712 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-567119f4-1262-49f1-afee-b5eecf0eb207 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:20:27.770828 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 595/1188] 10.222.0.21 () {56 vars in 1096 bytes} [Mon Feb 28 10:20:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:20:27.776835 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158866ec-f057-4d8b-8464-1b142a412099 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:20:27.871002 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158866ec-f057-4d8b-8464-1b142a412099 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:20:27.903787 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65938f66-0a6f-4884-8c10-ce0695fa2201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:20:27.904423 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65938f66-0a6f-4884-8c10-ce0695fa2201 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:27.904699 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65938f66-0a6f-4884-8c10-ce0695fa2201 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:27.904967 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65938f66-0a6f-4884-8c10-ce0695fa2201 None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:27.905685 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65938f66-0a6f-4884-8c10-ce0695fa2201 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:20:27.905983 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65938f66-0a6f-4884-8c10-ce0695fa2201 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:20:27.907347 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65938f66-0a6f-4884-8c10-ce0695fa2201 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:20:27.914844 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 594/1189] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:20:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:20:27.920904 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567119f4-1262-49f1-afee-b5eecf0eb207 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:20:28.014306 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567119f4-1262-49f1-afee-b5eecf0eb207 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:20:28.045907 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fefd87-9312-4401-afdd-3331eac73a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:20:28.046770 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fefd87-9312-4401-afdd-3331eac73a50 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:28.047074 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fefd87-9312-4401-afdd-3331eac73a50 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:28.047339 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fefd87-9312-4401-afdd-3331eac73a50 None admin] PATH_INFO: `/v3/users/c0d102fd1c294a2aa32cb5fad7b2eff3` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:28.048497 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fefd87-9312-4401-afdd-3331eac73a50 None admin] RBAC: Authorizing `identity:get_user(user_id=c0d102fd1c294a2aa32cb5fad7b2eff3)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:20:28.049888 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fefd87-9312-4401-afdd-3331eac73a50 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:20:28.051495 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 596/1190] 10.222.0.21 () {56 vars in 1177 bytes} [Mon Feb 28 10:20:27 2022] GET /identity/v3/users/c0d102fd1c294a2aa32cb5fad7b2eff3 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:20:28.057068 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65938f66-0a6f-4884-8c10-ce0695fa2201 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:20:28.149325 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65938f66-0a6f-4884-8c10-ce0695fa2201 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:20:28.180065 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4940a22-ec1e-4e9f-93d5-fb8a1a3b5d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:20:28.180886 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4940a22-ec1e-4e9f-93d5-fb8a1a3b5d42 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:28.181161 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4940a22-ec1e-4e9f-93d5-fb8a1a3b5d42 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:28.181428 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4940a22-ec1e-4e9f-93d5-fb8a1a3b5d42 None admin] PATH_INFO: `/v3/projects/dd2630a8692943ef816061e60a087c3a` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:28.182564 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4940a22-ec1e-4e9f-93d5-fb8a1a3b5d42 None admin] RBAC: Authorizing `identity:get_project(project_id=dd2630a8692943ef816061e60a087c3a)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:20:28.184049 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4940a22-ec1e-4e9f-93d5-fb8a1a3b5d42 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:20:28.185679 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 595/1191] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:20:28 2022] GET /identity/v3/projects/dd2630a8692943ef816061e60a087c3a => generated 361 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:20:28.191408 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fefd87-9312-4401-afdd-3331eac73a50 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:20:28.284676 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fefd87-9312-4401-afdd-3331eac73a50 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:20:28.315806 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d498924c-4ad2-41b2-892b-6beb56df762e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:20:28.316606 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498924c-4ad2-41b2-892b-6beb56df762e None admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:28.316882 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498924c-4ad2-41b2-892b-6beb56df762e None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:28.317152 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498924c-4ad2-41b2-892b-6beb56df762e None admin] PATH_INFO: `/v3/projects/dd2630a8692943ef816061e60a087c3a/users/c0d102fd1c294a2aa32cb5fad7b2eff3/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:28.319091 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d498924c-4ad2-41b2-892b-6beb56df762e None admin] RBAC: Authorizing `identity:create_grant(project_id=dd2630a8692943ef816061e60a087c3a, user_id=c0d102fd1c294a2aa32cb5fad7b2eff3, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:20:28.320489 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d498924c-4ad2-41b2-892b-6beb56df762e None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:20:28.333918 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 597/1192] 10.222.0.21 () {58 vars in 1439 bytes} [Mon Feb 28 10:20:28 2022] PUT /identity/v3/projects/dd2630a8692943ef816061e60a087c3a/users/c0d102fd1c294a2aa32cb5fad7b2eff3/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:20:30.609564 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77783da-189b-4021-9cf4-7edcfd149f93 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:30.610099 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77783da-189b-4021-9cf4-7edcfd149f93 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:30.610214 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77783da-189b-4021-9cf4-7edcfd149f93 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:30.612043 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 596/1193] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:20:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:20:30.617502 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff41ce5-18b8-43de-8e3d-e10325f9a923 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:30.617926 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff41ce5-18b8-43de-8e3d-e10325f9a923 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:30.618046 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff41ce5-18b8-43de-8e3d-e10325f9a923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:30.634674 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-9ff41ce5-18b8-43de-8e3d-e10325f9a923 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:20:30.635825 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-9ff41ce5-18b8-43de-8e3d-e10325f9a923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:20:30.698901 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 598/1194] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:20:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:20:30.723716 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77783da-189b-4021-9cf4-7edcfd149f93 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:20:30.822105 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77783da-189b-4021-9cf4-7edcfd149f93 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:20:30.853137 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d646b-1059-44f9-8e21-1e9e52335a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:20:30.853908 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d646b-1059-44f9-8e21-1e9e52335a52 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:30.854183 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d646b-1059-44f9-8e21-1e9e52335a52 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:30.854450 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d646b-1059-44f9-8e21-1e9e52335a52 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:30.865149 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2d646b-1059-44f9-8e21-1e9e52335a52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:20:30.872036 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-ab2d646b-1059-44f9-8e21-1e9e52335a52 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:20:30.873182 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 597/1195] 10.222.0.21 () {56 vars in 1096 bytes} [Mon Feb 28 10:20:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:20:30.879283 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff41ce5-18b8-43de-8e3d-e10325f9a923 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:20:30.971443 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff41ce5-18b8-43de-8e3d-e10325f9a923 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:20:31.002797 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea98d12b-b53f-4188-8bfb-5ce88a70c3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:20:31.003438 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98d12b-b53f-4188-8bfb-5ce88a70c3d2 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:31.003715 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98d12b-b53f-4188-8bfb-5ce88a70c3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:31.003988 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98d12b-b53f-4188-8bfb-5ce88a70c3d2 None admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:31.004716 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea98d12b-b53f-4188-8bfb-5ce88a70c3d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:20:31.005021 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea98d12b-b53f-4188-8bfb-5ce88a70c3d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:20:31.006365 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea98d12b-b53f-4188-8bfb-5ce88a70c3d2 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:20:31.014479 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 599/1196] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:20:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:20:31.020092 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d646b-1059-44f9-8e21-1e9e52335a52 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:20:31.113450 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d646b-1059-44f9-8e21-1e9e52335a52 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:20:31.144670 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02db086-e994-49ef-a3ad-5fff25e72db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:20:31.145452 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02db086-e994-49ef-a3ad-5fff25e72db3 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:31.145724 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02db086-e994-49ef-a3ad-5fff25e72db3 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:31.145987 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02db086-e994-49ef-a3ad-5fff25e72db3 None admin] PATH_INFO: `/v3/users/c0d102fd1c294a2aa32cb5fad7b2eff3` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:31.147160 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02db086-e994-49ef-a3ad-5fff25e72db3 None admin] RBAC: Authorizing `identity:get_user(user_id=c0d102fd1c294a2aa32cb5fad7b2eff3)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:20:31.148556 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02db086-e994-49ef-a3ad-5fff25e72db3 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:20:31.150137 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 598/1197] 10.222.0.21 () {56 vars in 1177 bytes} [Mon Feb 28 10:20:31 2022] GET /identity/v3/users/c0d102fd1c294a2aa32cb5fad7b2eff3 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:20:31.156002 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea98d12b-b53f-4188-8bfb-5ce88a70c3d2 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:20:31.248130 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea98d12b-b53f-4188-8bfb-5ce88a70c3d2 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:20:31.278761 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a53418-8470-4251-bb5b-0a610e66e2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:20:31.279377 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a53418-8470-4251-bb5b-0a610e66e2bf None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:31.279651 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a53418-8470-4251-bb5b-0a610e66e2bf None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:31.279919 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a53418-8470-4251-bb5b-0a610e66e2bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:31.341271 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a53418-8470-4251-bb5b-0a610e66e2bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:20:31.342705 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a53418-8470-4251-bb5b-0a610e66e2bf None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:20:31.432369 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 600/1198] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:20:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 10:20:31.438149 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02db086-e994-49ef-a3ad-5fff25e72db3 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:20:31.529483 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02db086-e994-49ef-a3ad-5fff25e72db3 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:20:31.560794 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d3c12-adc4-4245-882d-6c0868333ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:20:31.561635 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d3c12-adc4-4245-882d-6c0868333ed7 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:31.561910 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d3c12-adc4-4245-882d-6c0868333ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:31.562179 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d3c12-adc4-4245-882d-6c0868333ed7 None admin] PATH_INFO: `/v3/projects/dd2630a8692943ef816061e60a087c3a` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:31.563400 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d3c12-adc4-4245-882d-6c0868333ed7 None admin] RBAC: Authorizing `identity:get_project(project_id=dd2630a8692943ef816061e60a087c3a)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:20:31.564816 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d3c12-adc4-4245-882d-6c0868333ed7 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:20:31.566497 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 599/1199] 10.222.0.21 () {56 vars in 1186 bytes} [Mon Feb 28 10:20:31 2022] GET /identity/v3/projects/dd2630a8692943ef816061e60a087c3a => generated 361 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:20:31.572429 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a53418-8470-4251-bb5b-0a610e66e2bf None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:20:31.664354 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a53418-8470-4251-bb5b-0a610e66e2bf None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:20:31.696444 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13eeff5-9132-4524-8054-f6d9fa084552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:20:31.697013 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13eeff5-9132-4524-8054-f6d9fa084552 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:20:31.697292 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13eeff5-9132-4524-8054-f6d9fa084552 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:20:31.697559 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13eeff5-9132-4524-8054-f6d9fa084552 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:20:31.698361 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13eeff5-9132-4524-8054-f6d9fa084552 None admin] RBAC: Adding query filter params (role.id=48e4608a7b3f4b87a20b10c4d1b45aa9, scope.project.id=dd2630a8692943ef816061e60a087c3a, user.id=c0d102fd1c294a2aa32cb5fad7b2eff3) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:20:31.698691 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13eeff5-9132-4524-8054-f6d9fa084552 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:20:31.700199 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13eeff5-9132-4524-8054-f6d9fa084552 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:20:31.705888 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 601/1200] 10.222.0.21 () {56 vars in 1374 bytes} [Mon Feb 28 10:20:31 2022] GET /identity/v3/role_assignments?user.id=c0d102fd1c294a2aa32cb5fad7b2eff3&scope.project.id=dd2630a8692943ef816061e60a087c3a&role.id=48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:21:33.516964 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa4edf-42c8-4b1c-bb88-741a6c6863d6 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:33.517826 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa4edf-42c8-4b1c-bb88-741a6c6863d6 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:33.517826 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa4edf-42c8-4b1c-bb88-741a6c6863d6 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:33.522935 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 600/1201] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:21:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:21:33.526047 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd76bd8-f623-47df-a35d-12356ddf1883 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:33.526683 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd76bd8-f623-47df-a35d-12356ddf1883 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:33.526785 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd76bd8-f623-47df-a35d-12356ddf1883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:33.545999 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-8fd76bd8-f623-47df-a35d-12356ddf1883 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:21:33.547334 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-8fd76bd8-f623-47df-a35d-12356ddf1883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:21:33.623996 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 602/1202] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:21:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:21:33.650804 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa4edf-42c8-4b1c-bb88-741a6c6863d6 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:33.760700 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa4edf-42c8-4b1c-bb88-741a6c6863d6 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:33.796572 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f67c6-b8d5-4760-b2a8-316f8d021ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:33.797349 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f67c6-b8d5-4760-b2a8-316f8d021ce7 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:33.797659 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f67c6-b8d5-4760-b2a8-316f8d021ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:33.797902 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f67c6-b8d5-4760-b2a8-316f8d021ce7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:33.809860 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f67c6-b8d5-4760-b2a8-316f8d021ce7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:33.811358 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f67c6-b8d5-4760-b2a8-316f8d021ce7 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:33.831119 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-b43f67c6-b8d5-4760-b2a8-316f8d021ce7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:21:33.832528 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 601/1203] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:21:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:21:33.838410 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd76bd8-f623-47df-a35d-12356ddf1883 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:33.946473 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd76bd8-f623-47df-a35d-12356ddf1883 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:33.987421 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095f218-9f6a-4f24-9087-15b91d1e9a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:33.988092 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095f218-9f6a-4f24-9087-15b91d1e9a09 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:33.988373 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095f218-9f6a-4f24-9087-15b91d1e9a09 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:33.988648 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095f218-9f6a-4f24-9087-15b91d1e9a09 None admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:33.989366 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5095f218-9f6a-4f24-9087-15b91d1e9a09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:21:33.989671 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5095f218-9f6a-4f24-9087-15b91d1e9a09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:33.991088 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5095f218-9f6a-4f24-9087-15b91d1e9a09 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:34.004453 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 603/1204] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:21:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:21:34.010694 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f67c6-b8d5-4760-b2a8-316f8d021ce7 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:34.142722 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f67c6-b8d5-4760-b2a8-316f8d021ce7 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:34.192423 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c999f5-5fcf-4d8d-9b7a-ed1684171c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:34.192423 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c999f5-5fcf-4d8d-9b7a-ed1684171c2d None admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:34.192423 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c999f5-5fcf-4d8d-9b7a-ed1684171c2d None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:34.192423 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c999f5-5fcf-4d8d-9b7a-ed1684171c2d None admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:34.192869 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c999f5-5fcf-4d8d-9b7a-ed1684171c2d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:34.192984 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c999f5-5fcf-4d8d-9b7a-ed1684171c2d None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:34.222655 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 602/1205] 10.222.0.21 () {60 vars in 1132 bytes} [Mon Feb 28 10:21:34 2022] POST /identity/v3/users => generated 251 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:21:36.845480 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d03b5-59ce-49ab-a150-c2044546b6d3 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:36.846024 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d03b5-59ce-49ab-a150-c2044546b6d3 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:36.846024 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d03b5-59ce-49ab-a150-c2044546b6d3 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:36.848143 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 604/1206] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:21:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:21:36.853743 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a33b07-5dff-4316-98f4-220e529e8537 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:36.854202 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a33b07-5dff-4316-98f4-220e529e8537 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:36.854329 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a33b07-5dff-4316-98f4-220e529e8537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:36.876387 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-77a33b07-5dff-4316-98f4-220e529e8537 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:21:36.878061 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-77a33b07-5dff-4316-98f4-220e529e8537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:21:36.961481 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 603/1207] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:21:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:21:36.987858 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d03b5-59ce-49ab-a150-c2044546b6d3 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:37.109207 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d03b5-59ce-49ab-a150-c2044546b6d3 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:37.151447 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3b382-9379-4d34-9709-05e94bf320ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:37.152493 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3b382-9379-4d34-9709-05e94bf320ea None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:37.153423 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3b382-9379-4d34-9709-05e94bf320ea None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:37.154133 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3b382-9379-4d34-9709-05e94bf320ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:37.167448 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3b382-9379-4d34-9709-05e94bf320ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:21:37.176827 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-5cd3b382-9379-4d34-9709-05e94bf320ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 10:21:37.183442 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 605/1208] 10.222.0.21 () {56 vars in 1102 bytes} [Mon Feb 28 10:21:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:21:37.185356 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a33b07-5dff-4316-98f4-220e529e8537 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:37.301172 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a33b07-5dff-4316-98f4-220e529e8537 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:37.345251 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a06e56-dc3d-4289-9fb5-bbd4c38c3f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:37.346093 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a06e56-dc3d-4289-9fb5-bbd4c38c3f4d None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:37.346376 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a06e56-dc3d-4289-9fb5-bbd4c38c3f4d None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:37.346837 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a06e56-dc3d-4289-9fb5-bbd4c38c3f4d None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:37.347671 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a06e56-dc3d-4289-9fb5-bbd4c38c3f4d None admin] RBAC: Adding query filter params (name=service) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:21:37.347977 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a06e56-dc3d-4289-9fb5-bbd4c38c3f4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:37.349962 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a06e56-dc3d-4289-9fb5-bbd4c38c3f4d None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:37.360853 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 604/1209] 10.222.0.21 () {56 vars in 1103 bytes} [Mon Feb 28 10:21:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:21:37.369414 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3b382-9379-4d34-9709-05e94bf320ea None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:37.491214 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3b382-9379-4d34-9709-05e94bf320ea None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:37.528829 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247965d-9d33-45cd-b7a3-1050dcc3674d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:37.529897 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247965d-9d33-45cd-b7a3-1050dcc3674d None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:37.530201 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247965d-9d33-45cd-b7a3-1050dcc3674d None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:37.530540 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247965d-9d33-45cd-b7a3-1050dcc3674d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:37.542188 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f247965d-9d33-45cd-b7a3-1050dcc3674d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:37.544186 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f247965d-9d33-45cd-b7a3-1050dcc3674d None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:37.565882 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-f247965d-9d33-45cd-b7a3-1050dcc3674d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:21:37.572103 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 606/1210] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:21:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:21:37.573802 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a06e56-dc3d-4289-9fb5-bbd4c38c3f4d None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:37.688337 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a06e56-dc3d-4289-9fb5-bbd4c38c3f4d None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:37.728998 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1efc25e-6b94-4cdf-a655-05b2e132ecc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:37.729662 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efc25e-6b94-4cdf-a655-05b2e132ecc0 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:37.729944 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efc25e-6b94-4cdf-a655-05b2e132ecc0 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:37.730209 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efc25e-6b94-4cdf-a655-05b2e132ecc0 None admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:37.731504 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1efc25e-6b94-4cdf-a655-05b2e132ecc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:21:37.732007 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1efc25e-6b94-4cdf-a655-05b2e132ecc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:37.733412 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1efc25e-6b94-4cdf-a655-05b2e132ecc0 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:37.750650 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 605/1211] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:21:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:21:37.753242 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247965d-9d33-45cd-b7a3-1050dcc3674d None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:37.872458 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247965d-9d33-45cd-b7a3-1050dcc3674d None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:37.909185 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06649c8-da1e-464b-bb18-9c9dae00577e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:37.909997 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06649c8-da1e-464b-bb18-9c9dae00577e None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:37.910340 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06649c8-da1e-464b-bb18-9c9dae00577e None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:37.910619 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06649c8-da1e-464b-bb18-9c9dae00577e None admin] PATH_INFO: `/v3/users/placement` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:37.921317 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06649c8-da1e-464b-bb18-9c9dae00577e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:37.922843 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06649c8-da1e-464b-bb18-9c9dae00577e None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:37.937403 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-c06649c8-da1e-464b-bb18-9c9dae00577e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 28 10:21:37.938921 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 607/1212] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:21:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:21:37.944705 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1efc25e-6b94-4cdf-a655-05b2e132ecc0 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:38.053088 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1efc25e-6b94-4cdf-a655-05b2e132ecc0 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:38.094851 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a48af-d196-4831-b03c-7c5ed5d3bc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:38.095864 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a48af-d196-4831-b03c-7c5ed5d3bc45 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:38.096155 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a48af-d196-4831-b03c-7c5ed5d3bc45 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:38.096528 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a48af-d196-4831-b03c-7c5ed5d3bc45 None admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:38.097682 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a48af-d196-4831-b03c-7c5ed5d3bc45 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:21:38.098164 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a48af-d196-4831-b03c-7c5ed5d3bc45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:38.100259 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a48af-d196-4831-b03c-7c5ed5d3bc45 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:38.121384 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 606/1213] 10.222.0.21 () {56 vars in 1143 bytes} [Mon Feb 28 10:21:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:21:38.127703 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06649c8-da1e-464b-bb18-9c9dae00577e None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:38.245184 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06649c8-da1e-464b-bb18-9c9dae00577e None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:38.283376 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f0f76-7d1b-49bd-8c23-0d5c75594123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:38.284138 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f0f76-7d1b-49bd-8c23-0d5c75594123 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:38.284537 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f0f76-7d1b-49bd-8c23-0d5c75594123 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:38.284898 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f0f76-7d1b-49bd-8c23-0d5c75594123 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:38.365000 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f0f76-7d1b-49bd-8c23-0d5c75594123 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:38.366431 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f0f76-7d1b-49bd-8c23-0d5c75594123 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:38.484107 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 608/1214] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:21:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Feb 28 10:21:38.490750 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a48af-d196-4831-b03c-7c5ed5d3bc45 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:38.614180 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a48af-d196-4831-b03c-7c5ed5d3bc45 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:38.657418 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30bac38-b535-4e78-849d-98e2624b534c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:38.658297 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bac38-b535-4e78-849d-98e2624b534c None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:38.658574 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bac38-b535-4e78-849d-98e2624b534c None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:38.658949 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bac38-b535-4e78-849d-98e2624b534c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:38.669590 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30bac38-b535-4e78-849d-98e2624b534c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:38.671083 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30bac38-b535-4e78-849d-98e2624b534c None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:38.687930 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-f30bac38-b535-4e78-849d-98e2624b534c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:21:38.689374 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 607/1215] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:21:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:21:38.695045 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f0f76-7d1b-49bd-8c23-0d5c75594123 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:38.800632 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f0f76-7d1b-49bd-8c23-0d5c75594123 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:38.838317 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c530cb4d-a3d3-4327-8b1a-410be0dedaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:38.839157 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530cb4d-a3d3-4327-8b1a-410be0dedaea None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:38.839534 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530cb4d-a3d3-4327-8b1a-410be0dedaea None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:38.839920 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530cb4d-a3d3-4327-8b1a-410be0dedaea None admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:38.845047 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c530cb4d-a3d3-4327-8b1a-410be0dedaea None admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:21:38.845047 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c530cb4d-a3d3-4327-8b1a-410be0dedaea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:38.845047 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c530cb4d-a3d3-4327-8b1a-410be0dedaea None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:38.856195 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 609/1216] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:21:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:21:38.861779 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30bac38-b535-4e78-849d-98e2624b534c None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:38.974741 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30bac38-b535-4e78-849d-98e2624b534c None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:39.010300 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13f9fc-74d9-4829-834c-e3b8affd1c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:39.011114 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13f9fc-74d9-4829-834c-e3b8affd1c58 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:39.011411 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13f9fc-74d9-4829-834c-e3b8affd1c58 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:39.011765 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13f9fc-74d9-4829-834c-e3b8affd1c58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:39.018943 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee13f9fc-74d9-4829-834c-e3b8affd1c58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:39.020420 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee13f9fc-74d9-4829-834c-e3b8affd1c58 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:39.035202 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-ee13f9fc-74d9-4829-834c-e3b8affd1c58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:21:39.036631 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 608/1217] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:21:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:21:39.042562 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c530cb4d-a3d3-4327-8b1a-410be0dedaea None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:39.149289 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c530cb4d-a3d3-4327-8b1a-410be0dedaea None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:39.189497 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd297f7-23a4-41ca-96aa-eaa9a8289c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:39.190203 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd297f7-23a4-41ca-96aa-eaa9a8289c3b None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:39.190483 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd297f7-23a4-41ca-96aa-eaa9a8289c3b None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:39.190785 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd297f7-23a4-41ca-96aa-eaa9a8289c3b None admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:39.191576 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd297f7-23a4-41ca-96aa-eaa9a8289c3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:21:39.191876 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd297f7-23a4-41ca-96aa-eaa9a8289c3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:39.193330 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd297f7-23a4-41ca-96aa-eaa9a8289c3b None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:39.207099 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 610/1218] 10.222.0.21 () {56 vars in 1148 bytes} [Mon Feb 28 10:21:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:21:39.212861 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13f9fc-74d9-4829-834c-e3b8affd1c58 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:39.320969 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13f9fc-74d9-4829-834c-e3b8affd1c58 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:39.357336 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf3b51-235a-4937-8ad5-f1bfdf374055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:39.357982 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf3b51-235a-4937-8ad5-f1bfdf374055 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:39.358369 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf3b51-235a-4937-8ad5-f1bfdf374055 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:39.358679 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf3b51-235a-4937-8ad5-f1bfdf374055 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:39.359495 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf3b51-235a-4937-8ad5-f1bfdf374055 None admin] RBAC: Adding query filter params (role.id=060d4a1eef7a45858664a42696ff4a19, scope.project.id=5d1d6f8141924b2d99b766f975a3d43b, user.id=1b2346e4de5d45a79d4bb2abb01d4827) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:21:39.359874 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf3b51-235a-4937-8ad5-f1bfdf374055 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:39.361235 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf3b51-235a-4937-8ad5-f1bfdf374055 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:39.366833 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 609/1219] 10.222.0.21 () {56 vars in 1374 bytes} [Mon Feb 28 10:21:39 2022] GET /identity/v3/role_assignments?user.id=1b2346e4de5d45a79d4bb2abb01d4827&scope.project.id=5d1d6f8141924b2d99b766f975a3d43b&role.id=060d4a1eef7a45858664a42696ff4a19 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:21:41.855983 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf33abf-3fe4-4b84-bd05-0ffe7f40c7d0 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:41.856601 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf33abf-3fe4-4b84-bd05-0ffe7f40c7d0 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:41.856783 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf33abf-3fe4-4b84-bd05-0ffe7f40c7d0 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:41.858761 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 611/1220] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:21:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:21:41.863795 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f416c1-0eab-455a-9696-2e4850ca9b32 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:41.864212 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f416c1-0eab-455a-9696-2e4850ca9b32 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:41.864353 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f416c1-0eab-455a-9696-2e4850ca9b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:41.881498 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-41f416c1-0eab-455a-9696-2e4850ca9b32 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:21:41.882718 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-41f416c1-0eab-455a-9696-2e4850ca9b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:21:41.958883 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 610/1221] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:21:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:21:41.979742 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf33abf-3fe4-4b84-bd05-0ffe7f40c7d0 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:42.089575 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf33abf-3fe4-4b84-bd05-0ffe7f40c7d0 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:42.127660 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ab4d9-6ec9-4c39-9f97-0275ad8c5308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:42.128378 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ab4d9-6ec9-4c39-9f97-0275ad8c5308 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:42.128661 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ab4d9-6ec9-4c39-9f97-0275ad8c5308 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:42.128922 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ab4d9-6ec9-4c39-9f97-0275ad8c5308 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:42.140482 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ab4d9-6ec9-4c39-9f97-0275ad8c5308 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:21:42.147416 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-e80ab4d9-6ec9-4c39-9f97-0275ad8c5308 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 10:21:42.148596 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 612/1222] 10.222.0.21 () {56 vars in 1102 bytes} [Mon Feb 28 10:21:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:21:42.155185 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f416c1-0eab-455a-9696-2e4850ca9b32 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:42.252082 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f416c1-0eab-455a-9696-2e4850ca9b32 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:42.286022 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928e9d5-acd5-4380-80d0-8ee7479c45fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:42.286716 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928e9d5-acd5-4380-80d0-8ee7479c45fe None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:42.286999 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928e9d5-acd5-4380-80d0-8ee7479c45fe None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:42.287276 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928e9d5-acd5-4380-80d0-8ee7479c45fe None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:42.288015 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a928e9d5-acd5-4380-80d0-8ee7479c45fe None admin] RBAC: Adding query filter params (name=service) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:21:42.288318 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a928e9d5-acd5-4380-80d0-8ee7479c45fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:42.289670 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a928e9d5-acd5-4380-80d0-8ee7479c45fe None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:42.299109 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 611/1223] 10.222.0.21 () {56 vars in 1103 bytes} [Mon Feb 28 10:21:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:21:42.304973 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ab4d9-6ec9-4c39-9f97-0275ad8c5308 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:42.407749 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ab4d9-6ec9-4c39-9f97-0275ad8c5308 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:42.442563 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de486303-0568-4c76-8a76-25151e905605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:42.444037 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de486303-0568-4c76-8a76-25151e905605 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:42.444324 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de486303-0568-4c76-8a76-25151e905605 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:42.444597 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de486303-0568-4c76-8a76-25151e905605 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:42.457055 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de486303-0568-4c76-8a76-25151e905605 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:42.458795 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de486303-0568-4c76-8a76-25151e905605 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:42.476200 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-de486303-0568-4c76-8a76-25151e905605 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:21:42.477367 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 613/1224] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:21:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:21:42.483786 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928e9d5-acd5-4380-80d0-8ee7479c45fe None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:42.592685 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928e9d5-acd5-4380-80d0-8ee7479c45fe None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:42.630439 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb602f65-50d7-4648-9ece-1a9f24e3a950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:42.631123 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb602f65-50d7-4648-9ece-1a9f24e3a950 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:42.631433 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb602f65-50d7-4648-9ece-1a9f24e3a950 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:42.631727 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb602f65-50d7-4648-9ece-1a9f24e3a950 None admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:42.632485 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb602f65-50d7-4648-9ece-1a9f24e3a950 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:21:42.632817 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb602f65-50d7-4648-9ece-1a9f24e3a950 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:42.634158 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb602f65-50d7-4648-9ece-1a9f24e3a950 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:42.646310 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 612/1225] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:21:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:21:42.652561 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de486303-0568-4c76-8a76-25151e905605 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:42.755895 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de486303-0568-4c76-8a76-25151e905605 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:42.791030 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce11318-4bf3-4546-8908-506f7919120a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:42.791926 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce11318-4bf3-4546-8908-506f7919120a None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:42.792246 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce11318-4bf3-4546-8908-506f7919120a None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:42.792518 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce11318-4bf3-4546-8908-506f7919120a None admin] PATH_INFO: `/v3/users/placement` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:42.800800 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce11318-4bf3-4546-8908-506f7919120a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:42.802224 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce11318-4bf3-4546-8908-506f7919120a None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:42.816911 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-0ce11318-4bf3-4546-8908-506f7919120a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 28 10:21:42.818093 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 614/1226] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:21:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:21:42.824236 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb602f65-50d7-4648-9ece-1a9f24e3a950 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:42.933480 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb602f65-50d7-4648-9ece-1a9f24e3a950 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:42.968889 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78af54-016c-4266-849c-7f346e1048b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:42.969552 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78af54-016c-4266-849c-7f346e1048b6 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:42.969829 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78af54-016c-4266-849c-7f346e1048b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:42.970099 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78af54-016c-4266-849c-7f346e1048b6 None admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:42.970979 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab78af54-016c-4266-849c-7f346e1048b6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:21:42.971279 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab78af54-016c-4266-849c-7f346e1048b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:42.973007 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab78af54-016c-4266-849c-7f346e1048b6 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:42.991705 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 613/1227] 10.222.0.21 () {56 vars in 1143 bytes} [Mon Feb 28 10:21:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:21:42.998085 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce11318-4bf3-4546-8908-506f7919120a None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:43.102091 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce11318-4bf3-4546-8908-506f7919120a None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:43.136477 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1c7bc-c293-4164-9a1c-09f01187670d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:43.137868 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1c7bc-c293-4164-9a1c-09f01187670d None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:43.138188 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1c7bc-c293-4164-9a1c-09f01187670d None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:43.138465 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1c7bc-c293-4164-9a1c-09f01187670d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:43.149482 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e1c7bc-c293-4164-9a1c-09f01187670d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:43.151125 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e1c7bc-c293-4164-9a1c-09f01187670d None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:43.167863 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-28e1c7bc-c293-4164-9a1c-09f01187670d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:21:43.169845 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 615/1228] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:21:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:21:43.175758 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78af54-016c-4266-849c-7f346e1048b6 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:43.277776 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78af54-016c-4266-849c-7f346e1048b6 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:43.310827 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d732b4f-74e4-4d8c-871e-969d76e1347b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:43.311539 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d732b4f-74e4-4d8c-871e-969d76e1347b None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:43.311833 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d732b4f-74e4-4d8c-871e-969d76e1347b None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:43.312102 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d732b4f-74e4-4d8c-871e-969d76e1347b None admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:43.312861 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d732b4f-74e4-4d8c-871e-969d76e1347b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:21:43.313166 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d732b4f-74e4-4d8c-871e-969d76e1347b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:43.314662 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d732b4f-74e4-4d8c-871e-969d76e1347b None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:43.326693 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 614/1229] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:21:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:21:43.333162 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1c7bc-c293-4164-9a1c-09f01187670d None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:43.438453 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1c7bc-c293-4164-9a1c-09f01187670d None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:43.474377 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923e088-fcee-40f3-a347-7cdb72df5e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:43.475187 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923e088-fcee-40f3-a347-7cdb72df5e99 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:43.475508 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923e088-fcee-40f3-a347-7cdb72df5e99 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:43.475744 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923e088-fcee-40f3-a347-7cdb72df5e99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:43.482783 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e923e088-fcee-40f3-a347-7cdb72df5e99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:43.484199 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e923e088-fcee-40f3-a347-7cdb72df5e99 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:43.498954 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-e923e088-fcee-40f3-a347-7cdb72df5e99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:21:43.500121 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 616/1230] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:21:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:21:43.506430 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d732b4f-74e4-4d8c-871e-969d76e1347b None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:43.619782 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d732b4f-74e4-4d8c-871e-969d76e1347b None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:43.655008 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ab2e7-59c2-4c9c-93e7-02ab27908c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:43.655752 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ab2e7-59c2-4c9c-93e7-02ab27908c5a None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:43.656222 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ab2e7-59c2-4c9c-93e7-02ab27908c5a None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:43.656478 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ab2e7-59c2-4c9c-93e7-02ab27908c5a None admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:43.657631 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ab2e7-59c2-4c9c-93e7-02ab27908c5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:21:43.658061 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ab2e7-59c2-4c9c-93e7-02ab27908c5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:43.659809 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ab2e7-59c2-4c9c-93e7-02ab27908c5a None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:43.674613 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 615/1231] 10.222.0.21 () {56 vars in 1148 bytes} [Mon Feb 28 10:21:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:21:43.680734 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923e088-fcee-40f3-a347-7cdb72df5e99 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:43.783161 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923e088-fcee-40f3-a347-7cdb72df5e99 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:43.819629 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e82371-2f6e-4ac7-a7b2-05b74e040dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:43.820700 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e82371-2f6e-4ac7-a7b2-05b74e040dad None admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:43.820983 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e82371-2f6e-4ac7-a7b2-05b74e040dad None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:43.821258 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e82371-2f6e-4ac7-a7b2-05b74e040dad None admin] PATH_INFO: `/v3/projects/5d1d6f8141924b2d99b766f975a3d43b/users/1b2346e4de5d45a79d4bb2abb01d4827/roles/060d4a1eef7a45858664a42696ff4a19` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:43.837315 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e82371-2f6e-4ac7-a7b2-05b74e040dad None admin] RBAC: Authorizing `identity:create_grant(project_id=5d1d6f8141924b2d99b766f975a3d43b, user_id=1b2346e4de5d45a79d4bb2abb01d4827, role_id=060d4a1eef7a45858664a42696ff4a19)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:43.838765 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e82371-2f6e-4ac7-a7b2-05b74e040dad None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:43.852464 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 617/1232] 10.222.0.21 () {58 vars in 1439 bytes} [Mon Feb 28 10:21:43 2022] PUT /identity/v3/projects/5d1d6f8141924b2d99b766f975a3d43b/users/1b2346e4de5d45a79d4bb2abb01d4827/roles/060d4a1eef7a45858664a42696ff4a19 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:21:46.505019 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6884e70-09db-4cf0-a212-503b340ba86f None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:46.505601 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6884e70-09db-4cf0-a212-503b340ba86f None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:46.505601 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6884e70-09db-4cf0-a212-503b340ba86f None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:46.508165 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 616/1233] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:21:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:21:46.513825 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830cad7a-36c9-4efa-95eb-9e9c8d7dc17c None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:46.514287 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830cad7a-36c9-4efa-95eb-9e9c8d7dc17c None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:46.514413 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830cad7a-36c9-4efa-95eb-9e9c8d7dc17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:46.532434 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-830cad7a-36c9-4efa-95eb-9e9c8d7dc17c None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:21:46.533632 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-830cad7a-36c9-4efa-95eb-9e9c8d7dc17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:21:46.610752 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 618/1234] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:21:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 10:21:46.635554 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6884e70-09db-4cf0-a212-503b340ba86f None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:46.739564 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6884e70-09db-4cf0-a212-503b340ba86f None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:46.777067 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d88e7-347e-4db1-95bc-82303203fedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:46.778206 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d88e7-347e-4db1-95bc-82303203fedf None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:46.778713 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d88e7-347e-4db1-95bc-82303203fedf None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:46.779016 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d88e7-347e-4db1-95bc-82303203fedf None admin] PATH_INFO: `/v3/roles/service` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:46.789943 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d88e7-347e-4db1-95bc-82303203fedf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:21:46.798070 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-645d88e7-347e-4db1-95bc-82303203fedf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 10:21:46.799299 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 617/1235] 10.222.0.21 () {56 vars in 1102 bytes} [Mon Feb 28 10:21:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:21:46.805464 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830cad7a-36c9-4efa-95eb-9e9c8d7dc17c None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:46.920056 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830cad7a-36c9-4efa-95eb-9e9c8d7dc17c None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:46.962435 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630fdf8c-e499-4acd-8450-bb4b1a3baecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:46.963157 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fdf8c-e499-4acd-8450-bb4b1a3baecb None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:46.963483 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fdf8c-e499-4acd-8450-bb4b1a3baecb None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:46.963701 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fdf8c-e499-4acd-8450-bb4b1a3baecb None admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:46.964446 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630fdf8c-e499-4acd-8450-bb4b1a3baecb None admin] RBAC: Adding query filter params (name=service) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:21:46.964750 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630fdf8c-e499-4acd-8450-bb4b1a3baecb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:46.966771 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630fdf8c-e499-4acd-8450-bb4b1a3baecb None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:46.975096 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 619/1236] 10.222.0.21 () {56 vars in 1103 bytes} [Mon Feb 28 10:21:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:21:46.981082 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d88e7-347e-4db1-95bc-82303203fedf None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:47.084608 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d88e7-347e-4db1-95bc-82303203fedf None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:47.121053 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f35db-a966-4b09-861b-6678a315704b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:47.122080 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f35db-a966-4b09-861b-6678a315704b None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:47.122365 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f35db-a966-4b09-861b-6678a315704b None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:47.122665 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f35db-a966-4b09-861b-6678a315704b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:47.134511 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f35db-a966-4b09-861b-6678a315704b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:47.135982 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f35db-a966-4b09-861b-6678a315704b None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:47.152523 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-422f35db-a966-4b09-861b-6678a315704b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:21:47.154307 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 618/1237] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:21:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:21:47.160345 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630fdf8c-e499-4acd-8450-bb4b1a3baecb None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:47.268538 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630fdf8c-e499-4acd-8450-bb4b1a3baecb None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:47.301222 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466d7af-88f2-4a89-9a8d-4e5ac1a7a9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:47.301872 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466d7af-88f2-4a89-9a8d-4e5ac1a7a9a1 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:47.302155 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466d7af-88f2-4a89-9a8d-4e5ac1a7a9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:47.302429 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466d7af-88f2-4a89-9a8d-4e5ac1a7a9a1 None admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:47.303169 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0466d7af-88f2-4a89-9a8d-4e5ac1a7a9a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:21:47.303471 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0466d7af-88f2-4a89-9a8d-4e5ac1a7a9a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:47.304819 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0466d7af-88f2-4a89-9a8d-4e5ac1a7a9a1 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:47.317040 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 620/1238] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:21:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:21:47.323446 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f35db-a966-4b09-861b-6678a315704b None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:47.424599 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f35db-a966-4b09-861b-6678a315704b None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:47.460652 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70011cc2-4882-47d6-9fad-d189f6b3c449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:47.461458 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70011cc2-4882-47d6-9fad-d189f6b3c449 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:47.461726 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70011cc2-4882-47d6-9fad-d189f6b3c449 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:47.462004 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70011cc2-4882-47d6-9fad-d189f6b3c449 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:47.469908 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70011cc2-4882-47d6-9fad-d189f6b3c449 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:47.471526 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70011cc2-4882-47d6-9fad-d189f6b3c449 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:47.486501 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-70011cc2-4882-47d6-9fad-d189f6b3c449 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 28 10:21:47.487905 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 619/1239] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:21:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:21:47.494085 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466d7af-88f2-4a89-9a8d-4e5ac1a7a9a1 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:47.607808 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466d7af-88f2-4a89-9a8d-4e5ac1a7a9a1 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:47.643969 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e0138-c1a0-41c2-8d90-ebea3a2e2a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:47.644670 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e0138-c1a0-41c2-8d90-ebea3a2e2a40 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:47.644950 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e0138-c1a0-41c2-8d90-ebea3a2e2a40 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:47.645223 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e0138-c1a0-41c2-8d90-ebea3a2e2a40 None admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:47.646123 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e0138-c1a0-41c2-8d90-ebea3a2e2a40 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:21:47.646484 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e0138-c1a0-41c2-8d90-ebea3a2e2a40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:47.648087 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e0138-c1a0-41c2-8d90-ebea3a2e2a40 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:47.667641 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 621/1240] 10.222.0.21 () {56 vars in 1143 bytes} [Mon Feb 28 10:21:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:21:47.674192 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70011cc2-4882-47d6-9fad-d189f6b3c449 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:47.777237 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70011cc2-4882-47d6-9fad-d189f6b3c449 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:47.813578 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313857c-ef44-4baf-92d9-a83b3ec929e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:47.814296 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313857c-ef44-4baf-92d9-a83b3ec929e7 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:47.814576 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313857c-ef44-4baf-92d9-a83b3ec929e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:47.814876 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313857c-ef44-4baf-92d9-a83b3ec929e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:47.889764 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4313857c-ef44-4baf-92d9-a83b3ec929e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:47.891455 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4313857c-ef44-4baf-92d9-a83b3ec929e7 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:47.999139 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 620/1241] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:21:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 10:21:48.004942 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e0138-c1a0-41c2-8d90-ebea3a2e2a40 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:48.110812 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e0138-c1a0-41c2-8d90-ebea3a2e2a40 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:48.147231 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c41be-e379-4099-ad8f-c8f1ebe3afe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:48.148013 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c41be-e379-4099-ad8f-c8f1ebe3afe9 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:48.148287 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c41be-e379-4099-ad8f-c8f1ebe3afe9 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:48.148559 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c41be-e379-4099-ad8f-c8f1ebe3afe9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:48.159478 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c41be-e379-4099-ad8f-c8f1ebe3afe9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:48.160894 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c41be-e379-4099-ad8f-c8f1ebe3afe9 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:48.178274 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-cc0c41be-e379-4099-ad8f-c8f1ebe3afe9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:21:48.179491 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 622/1242] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:21:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:21:48.185748 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313857c-ef44-4baf-92d9-a83b3ec929e7 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:48.290482 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313857c-ef44-4baf-92d9-a83b3ec929e7 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:48.327007 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a29744-639c-47db-8b52-36f5ff2a9c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:48.327666 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a29744-639c-47db-8b52-36f5ff2a9c20 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:48.327941 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a29744-639c-47db-8b52-36f5ff2a9c20 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:48.328213 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a29744-639c-47db-8b52-36f5ff2a9c20 None admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:48.329237 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a29744-639c-47db-8b52-36f5ff2a9c20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:21:48.329578 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a29744-639c-47db-8b52-36f5ff2a9c20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:48.331097 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a29744-639c-47db-8b52-36f5ff2a9c20 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:48.343501 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 621/1243] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:21:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:21:48.349174 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c41be-e379-4099-ad8f-c8f1ebe3afe9 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:48.459382 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c41be-e379-4099-ad8f-c8f1ebe3afe9 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:48.496264 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c791c-112a-4fcd-88b6-8d483c57c6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:48.497118 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c791c-112a-4fcd-88b6-8d483c57c6fb None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:48.497372 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c791c-112a-4fcd-88b6-8d483c57c6fb None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:48.497668 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c791c-112a-4fcd-88b6-8d483c57c6fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:48.506503 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c791c-112a-4fcd-88b6-8d483c57c6fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:48.508254 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c791c-112a-4fcd-88b6-8d483c57c6fb None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:48.525327 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-0c2c791c-112a-4fcd-88b6-8d483c57c6fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:21:48.526939 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 623/1244] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:21:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:21:48.534654 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a29744-639c-47db-8b52-36f5ff2a9c20 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:48.662815 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a29744-639c-47db-8b52-36f5ff2a9c20 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:48.700899 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c782d40-a714-44ea-8cc2-69ecedf7281e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:48.701643 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c782d40-a714-44ea-8cc2-69ecedf7281e None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:48.701963 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c782d40-a714-44ea-8cc2-69ecedf7281e None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:48.702338 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c782d40-a714-44ea-8cc2-69ecedf7281e None admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:48.703198 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c782d40-a714-44ea-8cc2-69ecedf7281e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:21:48.703499 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c782d40-a714-44ea-8cc2-69ecedf7281e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:48.705172 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c782d40-a714-44ea-8cc2-69ecedf7281e None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:48.718562 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 622/1245] 10.222.0.21 () {56 vars in 1148 bytes} [Mon Feb 28 10:21:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:21:48.724983 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c791c-112a-4fcd-88b6-8d483c57c6fb None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:48.830406 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c791c-112a-4fcd-88b6-8d483c57c6fb None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:48.867478 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856e0f43-7ad3-4452-8033-5835d5659957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:48.868238 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e0f43-7ad3-4452-8033-5835d5659957 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:48.868552 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e0f43-7ad3-4452-8033-5835d5659957 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:48.868838 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e0f43-7ad3-4452-8033-5835d5659957 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:48.869878 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856e0f43-7ad3-4452-8033-5835d5659957 None admin] RBAC: Adding query filter params (role.id=060d4a1eef7a45858664a42696ff4a19, scope.project.id=5d1d6f8141924b2d99b766f975a3d43b, user.id=1b2346e4de5d45a79d4bb2abb01d4827) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:21:48.870226 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856e0f43-7ad3-4452-8033-5835d5659957 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:48.872215 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856e0f43-7ad3-4452-8033-5835d5659957 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:48.878282 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 624/1246] 10.222.0.21 () {56 vars in 1374 bytes} [Mon Feb 28 10:21:48 2022] GET /identity/v3/role_assignments?user.id=1b2346e4de5d45a79d4bb2abb01d4827&scope.project.id=5d1d6f8141924b2d99b766f975a3d43b&role.id=060d4a1eef7a45858664a42696ff4a19 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:21:51.592492 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15637db8-1d39-4298-9a1a-d3ad484d5c93 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:51.593059 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15637db8-1d39-4298-9a1a-d3ad484d5c93 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:51.593059 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15637db8-1d39-4298-9a1a-d3ad484d5c93 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:51.595094 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 623/1247] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:21:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:21:51.600772 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808d09a-ac5e-4042-a366-e940f933c7b3 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:51.601246 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808d09a-ac5e-4042-a366-e940f933c7b3 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:51.601443 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808d09a-ac5e-4042-a366-e940f933c7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:51.623215 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-3808d09a-ac5e-4042-a366-e940f933c7b3 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:21:51.624326 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-3808d09a-ac5e-4042-a366-e940f933c7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:21:51.695255 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 625/1248] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:21:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:21:51.724953 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15637db8-1d39-4298-9a1a-d3ad484d5c93 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:51.828506 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15637db8-1d39-4298-9a1a-d3ad484d5c93 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:51.865545 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2564546-cab0-4bee-b533-e783f008647f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:51.866346 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2564546-cab0-4bee-b533-e783f008647f None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:51.866643 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2564546-cab0-4bee-b533-e783f008647f None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:51.866914 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2564546-cab0-4bee-b533-e783f008647f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:51.878974 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2564546-cab0-4bee-b533-e783f008647f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:21:51.885928 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-a2564546-cab0-4bee-b533-e783f008647f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:21:51.887345 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 624/1249] 10.222.0.21 () {56 vars in 1096 bytes} [Mon Feb 28 10:21:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:21:51.894646 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3808d09a-ac5e-4042-a366-e940f933c7b3 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:52.000555 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3808d09a-ac5e-4042-a366-e940f933c7b3 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:52.036914 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da183908-4b76-4b0a-885f-9adc1b6db9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:52.037587 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da183908-4b76-4b0a-885f-9adc1b6db9e6 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:52.037866 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da183908-4b76-4b0a-885f-9adc1b6db9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:52.038135 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da183908-4b76-4b0a-885f-9adc1b6db9e6 None admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:52.038915 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da183908-4b76-4b0a-885f-9adc1b6db9e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:21:52.039214 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da183908-4b76-4b0a-885f-9adc1b6db9e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:52.040608 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da183908-4b76-4b0a-885f-9adc1b6db9e6 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:52.050703 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 626/1250] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:21:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:21:52.056442 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2564546-cab0-4bee-b533-e783f008647f None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:52.156591 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2564546-cab0-4bee-b533-e783f008647f None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:52.189137 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9500a64-f5ab-451a-a8e0-cf9a00c80897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:52.189917 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9500a64-f5ab-451a-a8e0-cf9a00c80897 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:52.190193 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9500a64-f5ab-451a-a8e0-cf9a00c80897 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:52.190464 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9500a64-f5ab-451a-a8e0-cf9a00c80897 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:52.201990 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9500a64-f5ab-451a-a8e0-cf9a00c80897 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:52.203451 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9500a64-f5ab-451a-a8e0-cf9a00c80897 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:52.219937 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-c9500a64-f5ab-451a-a8e0-cf9a00c80897 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:21:52.221104 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 625/1251] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:21:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:21:52.226860 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da183908-4b76-4b0a-885f-9adc1b6db9e6 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:52.323821 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da183908-4b76-4b0a-885f-9adc1b6db9e6 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:52.356492 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a6408-63de-4999-aff5-e100855cfb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:52.357301 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a6408-63de-4999-aff5-e100855cfb21 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:52.357577 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a6408-63de-4999-aff5-e100855cfb21 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:52.357844 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a6408-63de-4999-aff5-e100855cfb21 None admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:52.358546 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4a6408-63de-4999-aff5-e100855cfb21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:21:52.358880 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4a6408-63de-4999-aff5-e100855cfb21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:52.360219 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4a6408-63de-4999-aff5-e100855cfb21 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:52.372130 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 627/1252] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:21:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:21:52.377763 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9500a64-f5ab-451a-a8e0-cf9a00c80897 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:52.474258 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9500a64-f5ab-451a-a8e0-cf9a00c80897 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:52.505538 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2a490-b09f-424d-9dff-94e1f385ef67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:52.506318 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2a490-b09f-424d-9dff-94e1f385ef67 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:52.506628 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2a490-b09f-424d-9dff-94e1f385ef67 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:52.506909 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2a490-b09f-424d-9dff-94e1f385ef67 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:52.514617 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d2a490-b09f-424d-9dff-94e1f385ef67 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:52.516062 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d2a490-b09f-424d-9dff-94e1f385ef67 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:52.529182 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-f0d2a490-b09f-424d-9dff-94e1f385ef67 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 28 10:21:52.530325 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 626/1253] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:21:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:21:52.536159 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a6408-63de-4999-aff5-e100855cfb21 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:52.638283 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a6408-63de-4999-aff5-e100855cfb21 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:52.669968 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9093002-333e-446e-ab63-8047bcf55f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:52.670641 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9093002-333e-446e-ab63-8047bcf55f0e None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:52.670943 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9093002-333e-446e-ab63-8047bcf55f0e None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:52.671216 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9093002-333e-446e-ab63-8047bcf55f0e None admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:52.672032 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9093002-333e-446e-ab63-8047bcf55f0e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:21:52.672333 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9093002-333e-446e-ab63-8047bcf55f0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:52.673737 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9093002-333e-446e-ab63-8047bcf55f0e None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:52.690452 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 628/1254] 10.222.0.21 () {56 vars in 1143 bytes} [Mon Feb 28 10:21:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:21:52.696143 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2a490-b09f-424d-9dff-94e1f385ef67 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:52.790893 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2a490-b09f-424d-9dff-94e1f385ef67 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:52.823243 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2f81b-c8fd-40da-a3b0-71a1b5b5f289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:52.823860 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2f81b-c8fd-40da-a3b0-71a1b5b5f289 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:52.824136 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2f81b-c8fd-40da-a3b0-71a1b5b5f289 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:52.824404 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2f81b-c8fd-40da-a3b0-71a1b5b5f289 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:52.889420 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2f81b-c8fd-40da-a3b0-71a1b5b5f289 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:52.890863 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2f81b-c8fd-40da-a3b0-71a1b5b5f289 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:52.983872 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 627/1255] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:21:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 10:21:52.989565 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9093002-333e-446e-ab63-8047bcf55f0e None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:53.084145 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9093002-333e-446e-ab63-8047bcf55f0e None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:53.115393 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e3111c-9529-4b68-afc9-9331e234897c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:53.116152 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3111c-9529-4b68-afc9-9331e234897c None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:53.116430 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3111c-9529-4b68-afc9-9331e234897c None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:53.116701 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3111c-9529-4b68-afc9-9331e234897c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:53.126717 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e3111c-9529-4b68-afc9-9331e234897c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:53.128127 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e3111c-9529-4b68-afc9-9331e234897c None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:53.143952 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-a8e3111c-9529-4b68-afc9-9331e234897c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:21:53.145082 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 629/1256] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:21:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:21:53.150682 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2f81b-c8fd-40da-a3b0-71a1b5b5f289 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:53.243209 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2f81b-c8fd-40da-a3b0-71a1b5b5f289 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:53.274133 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ad2c9-914e-4770-891f-1a8ebc0b36b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:53.274798 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ad2c9-914e-4770-891f-1a8ebc0b36b8 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:53.275081 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ad2c9-914e-4770-891f-1a8ebc0b36b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:53.275355 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ad2c9-914e-4770-891f-1a8ebc0b36b8 None admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:53.276055 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4ad2c9-914e-4770-891f-1a8ebc0b36b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:21:53.276358 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4ad2c9-914e-4770-891f-1a8ebc0b36b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:53.278223 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4ad2c9-914e-4770-891f-1a8ebc0b36b8 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:53.288985 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 628/1257] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:21:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:21:53.294477 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e3111c-9529-4b68-afc9-9331e234897c None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:53.387165 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e3111c-9529-4b68-afc9-9331e234897c None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:53.418868 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed7a9a8-3069-4039-b5a0-1b8609d5368d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:53.419634 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7a9a8-3069-4039-b5a0-1b8609d5368d None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:53.419925 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7a9a8-3069-4039-b5a0-1b8609d5368d None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:53.420200 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7a9a8-3069-4039-b5a0-1b8609d5368d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:53.426486 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed7a9a8-3069-4039-b5a0-1b8609d5368d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:53.427926 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed7a9a8-3069-4039-b5a0-1b8609d5368d None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:53.440946 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-bed7a9a8-3069-4039-b5a0-1b8609d5368d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:21:53.442064 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 630/1258] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:21:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:21:53.447694 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ad2c9-914e-4770-891f-1a8ebc0b36b8 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:53.541130 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ad2c9-914e-4770-891f-1a8ebc0b36b8 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:53.578146 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c76d6-7d79-420b-a203-8a51d8ef9d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:53.578964 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c76d6-7d79-420b-a203-8a51d8ef9d78 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:53.579495 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c76d6-7d79-420b-a203-8a51d8ef9d78 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:53.579766 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c76d6-7d79-420b-a203-8a51d8ef9d78 None admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:53.580642 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c76d6-7d79-420b-a203-8a51d8ef9d78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:21:53.581017 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c76d6-7d79-420b-a203-8a51d8ef9d78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:53.582639 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c76d6-7d79-420b-a203-8a51d8ef9d78 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:53.595846 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 629/1259] 10.222.0.21 () {56 vars in 1148 bytes} [Mon Feb 28 10:21:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:21:53.601931 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed7a9a8-3069-4039-b5a0-1b8609d5368d None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:53.697104 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed7a9a8-3069-4039-b5a0-1b8609d5368d None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:53.728322 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4244547-bd60-4b64-81b2-ab1088b2aafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:53.728960 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4244547-bd60-4b64-81b2-ab1088b2aafd None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:53.729235 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4244547-bd60-4b64-81b2-ab1088b2aafd None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:53.729506 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4244547-bd60-4b64-81b2-ab1088b2aafd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:53.730341 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4244547-bd60-4b64-81b2-ab1088b2aafd None admin] RBAC: Adding query filter params (role.id=48e4608a7b3f4b87a20b10c4d1b45aa9, scope.project.id=5d1d6f8141924b2d99b766f975a3d43b, user.id=1b2346e4de5d45a79d4bb2abb01d4827) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:21:53.730679 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4244547-bd60-4b64-81b2-ab1088b2aafd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:53.732826 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4244547-bd60-4b64-81b2-ab1088b2aafd None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:53.737987 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 631/1260] 10.222.0.21 () {56 vars in 1374 bytes} [Mon Feb 28 10:21:53 2022] GET /identity/v3/role_assignments?user.id=1b2346e4de5d45a79d4bb2abb01d4827&scope.project.id=5d1d6f8141924b2d99b766f975a3d43b&role.id=48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:21:55.992410 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20906a-fef4-47a9-a5ec-df2f111d0752 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:55.992959 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20906a-fef4-47a9-a5ec-df2f111d0752 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:55.992959 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20906a-fef4-47a9-a5ec-df2f111d0752 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:55.994717 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 630/1261] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:21:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:21:56.000240 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7447c3-e809-4464-bf69-8c2c3fc2cd27 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:56.000662 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7447c3-e809-4464-bf69-8c2c3fc2cd27 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:56.000783 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7447c3-e809-4464-bf69-8c2c3fc2cd27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:56.017712 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-8e7447c3-e809-4464-bf69-8c2c3fc2cd27 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:21:56.018900 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-8e7447c3-e809-4464-bf69-8c2c3fc2cd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:21:56.080620 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 632/1262] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:21:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:21:56.103167 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20906a-fef4-47a9-a5ec-df2f111d0752 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:56.198662 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20906a-fef4-47a9-a5ec-df2f111d0752 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:56.230671 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b36cc-04ec-4ae3-9ad8-76a5be6b3ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:56.231913 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b36cc-04ec-4ae3-9ad8-76a5be6b3ed1 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:56.232190 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b36cc-04ec-4ae3-9ad8-76a5be6b3ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:56.232454 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b36cc-04ec-4ae3-9ad8-76a5be6b3ed1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:56.241847 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570b36cc-04ec-4ae3-9ad8-76a5be6b3ed1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:21:56.249548 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-570b36cc-04ec-4ae3-9ad8-76a5be6b3ed1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:21:56.250705 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 631/1263] 10.222.0.21 () {56 vars in 1096 bytes} [Mon Feb 28 10:21:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:21:56.256631 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7447c3-e809-4464-bf69-8c2c3fc2cd27 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:56.348917 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7447c3-e809-4464-bf69-8c2c3fc2cd27 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:56.380438 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57639ff-7a9b-460d-8c59-939ac45de779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:56.381026 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57639ff-7a9b-460d-8c59-939ac45de779 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:56.381304 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57639ff-7a9b-460d-8c59-939ac45de779 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:56.381576 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57639ff-7a9b-460d-8c59-939ac45de779 None admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:56.382303 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57639ff-7a9b-460d-8c59-939ac45de779 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:21:56.382693 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57639ff-7a9b-460d-8c59-939ac45de779 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:56.384029 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57639ff-7a9b-460d-8c59-939ac45de779 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:56.391704 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 633/1264] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:21:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:21:56.397157 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b36cc-04ec-4ae3-9ad8-76a5be6b3ed1 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:56.492555 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b36cc-04ec-4ae3-9ad8-76a5be6b3ed1 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:56.524051 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff2cc77-d168-45a6-badb-0f7c0c435f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:56.524812 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2cc77-d168-45a6-badb-0f7c0c435f94 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:56.525092 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2cc77-d168-45a6-badb-0f7c0c435f94 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:56.525364 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2cc77-d168-45a6-badb-0f7c0c435f94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:56.536097 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff2cc77-d168-45a6-badb-0f7c0c435f94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:56.537515 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff2cc77-d168-45a6-badb-0f7c0c435f94 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:56.554253 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-2ff2cc77-d168-45a6-badb-0f7c0c435f94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:21:56.555610 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 632/1265] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:21:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:21:56.562340 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57639ff-7a9b-460d-8c59-939ac45de779 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:56.668424 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57639ff-7a9b-460d-8c59-939ac45de779 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:56.699529 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846c53e-c9a8-4e1c-9ef4-0ff7b6ab7c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:56.701200 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846c53e-c9a8-4e1c-9ef4-0ff7b6ab7c8c None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:56.701476 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846c53e-c9a8-4e1c-9ef4-0ff7b6ab7c8c None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:56.701748 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846c53e-c9a8-4e1c-9ef4-0ff7b6ab7c8c None admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:56.702446 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846c53e-c9a8-4e1c-9ef4-0ff7b6ab7c8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:21:56.702775 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846c53e-c9a8-4e1c-9ef4-0ff7b6ab7c8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:56.704108 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846c53e-c9a8-4e1c-9ef4-0ff7b6ab7c8c None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:56.715277 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 634/1266] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:21:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:21:56.721359 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff2cc77-d168-45a6-badb-0f7c0c435f94 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:56.815801 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff2cc77-d168-45a6-badb-0f7c0c435f94 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:56.847923 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e50e9-0151-4c58-9277-faccd0598122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:56.848704 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e50e9-0151-4c58-9277-faccd0598122 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:56.848983 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e50e9-0151-4c58-9277-faccd0598122 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:56.849757 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e50e9-0151-4c58-9277-faccd0598122 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:56.856768 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697e50e9-0151-4c58-9277-faccd0598122 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:56.858188 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697e50e9-0151-4c58-9277-faccd0598122 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:56.871882 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-697e50e9-0151-4c58-9277-faccd0598122 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 28 10:21:56.873366 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 633/1267] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:21:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:21:56.879079 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846c53e-c9a8-4e1c-9ef4-0ff7b6ab7c8c None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:56.972635 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846c53e-c9a8-4e1c-9ef4-0ff7b6ab7c8c None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:57.004453 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c26ad90-f697-4a58-ba99-0f5a4b911198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:57.005094 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26ad90-f697-4a58-ba99-0f5a4b911198 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:57.005370 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26ad90-f697-4a58-ba99-0f5a4b911198 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:57.005639 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26ad90-f697-4a58-ba99-0f5a4b911198 None admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:57.006444 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c26ad90-f697-4a58-ba99-0f5a4b911198 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:21:57.006763 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c26ad90-f697-4a58-ba99-0f5a4b911198 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:57.008159 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c26ad90-f697-4a58-ba99-0f5a4b911198 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:57.024928 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 635/1268] 10.222.0.21 () {56 vars in 1143 bytes} [Mon Feb 28 10:21:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:21:57.030419 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e50e9-0151-4c58-9277-faccd0598122 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:57.123430 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e50e9-0151-4c58-9277-faccd0598122 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:57.154739 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf7d67b-0091-43a1-829c-c4c1cafe0c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:57.155487 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7d67b-0091-43a1-829c-c4c1cafe0c79 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:57.155760 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7d67b-0091-43a1-829c-c4c1cafe0c79 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:57.156024 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7d67b-0091-43a1-829c-c4c1cafe0c79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:57.165759 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf7d67b-0091-43a1-829c-c4c1cafe0c79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:57.167215 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf7d67b-0091-43a1-829c-c4c1cafe0c79 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:57.183108 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-baf7d67b-0091-43a1-829c-c4c1cafe0c79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:21:57.184348 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 634/1269] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:21:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:21:57.189975 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c26ad90-f697-4a58-ba99-0f5a4b911198 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:57.284363 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c26ad90-f697-4a58-ba99-0f5a4b911198 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:57.315749 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814ad07-fff3-42f3-92f9-fca79b41ac7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:57.316387 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814ad07-fff3-42f3-92f9-fca79b41ac7a None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:57.316668 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814ad07-fff3-42f3-92f9-fca79b41ac7a None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:57.316941 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814ad07-fff3-42f3-92f9-fca79b41ac7a None admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:57.317641 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4814ad07-fff3-42f3-92f9-fca79b41ac7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:21:57.317941 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4814ad07-fff3-42f3-92f9-fca79b41ac7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:57.319308 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4814ad07-fff3-42f3-92f9-fca79b41ac7a None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:57.330574 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 636/1270] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:21:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:21:57.335960 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf7d67b-0091-43a1-829c-c4c1cafe0c79 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:57.429464 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf7d67b-0091-43a1-829c-c4c1cafe0c79 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:57.461333 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49334010-a999-4a80-88a2-13385d3c897b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:57.462088 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49334010-a999-4a80-88a2-13385d3c897b None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:57.462367 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49334010-a999-4a80-88a2-13385d3c897b None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:57.462661 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49334010-a999-4a80-88a2-13385d3c897b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:57.469880 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49334010-a999-4a80-88a2-13385d3c897b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:57.471341 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49334010-a999-4a80-88a2-13385d3c897b None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:57.484431 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-49334010-a999-4a80-88a2-13385d3c897b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:21:57.485555 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 635/1271] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:21:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:21:57.491166 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814ad07-fff3-42f3-92f9-fca79b41ac7a None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:57.588077 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814ad07-fff3-42f3-92f9-fca79b41ac7a None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:57.619488 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8822a60-55c3-41a9-9ac7-e64b4d3a8f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:57.620130 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8822a60-55c3-41a9-9ac7-e64b4d3a8f20 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:57.620408 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8822a60-55c3-41a9-9ac7-e64b4d3a8f20 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:57.620677 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8822a60-55c3-41a9-9ac7-e64b4d3a8f20 None admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:57.621439 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8822a60-55c3-41a9-9ac7-e64b4d3a8f20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:21:57.621770 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8822a60-55c3-41a9-9ac7-e64b4d3a8f20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:57.623211 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8822a60-55c3-41a9-9ac7-e64b4d3a8f20 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:57.634464 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 637/1272] 10.222.0.21 () {56 vars in 1148 bytes} [Mon Feb 28 10:21:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:21:57.641030 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49334010-a999-4a80-88a2-13385d3c897b None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:21:57.740506 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49334010-a999-4a80-88a2-13385d3c897b None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:21:57.773383 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752c3ae-b9d5-4b47-8ce5-1afc6faf07bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:21:57.774237 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752c3ae-b9d5-4b47-8ce5-1afc6faf07bb None admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:21:57.774511 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752c3ae-b9d5-4b47-8ce5-1afc6faf07bb None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:21:57.774807 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752c3ae-b9d5-4b47-8ce5-1afc6faf07bb None admin] PATH_INFO: `/v3/projects/5d1d6f8141924b2d99b766f975a3d43b/users/1b2346e4de5d45a79d4bb2abb01d4827/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:21:57.778947 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1752c3ae-b9d5-4b47-8ce5-1afc6faf07bb None admin] RBAC: Authorizing `identity:create_grant(project_id=5d1d6f8141924b2d99b766f975a3d43b, user_id=1b2346e4de5d45a79d4bb2abb01d4827, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:21:57.780442 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1752c3ae-b9d5-4b47-8ce5-1afc6faf07bb None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:21:57.792440 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 636/1273] 10.222.0.21 () {58 vars in 1439 bytes} [Mon Feb 28 10:21:57 2022] PUT /identity/v3/projects/5d1d6f8141924b2d99b766f975a3d43b/users/1b2346e4de5d45a79d4bb2abb01d4827/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:22:00.076876 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfbd01a-addb-459c-93e9-7586d8f5a856 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:22:00.077401 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfbd01a-addb-459c-93e9-7586d8f5a856 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:22:00.077401 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfbd01a-addb-459c-93e9-7586d8f5a856 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:22:00.079238 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 638/1274] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:22:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:22:00.084639 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2af05-1d0e-423e-a37c-ff843820f902 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:22:00.085065 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2af05-1d0e-423e-a37c-ff843820f902 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:22:00.085175 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2af05-1d0e-423e-a37c-ff843820f902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:22:00.102328 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-21b2af05-1d0e-423e-a37c-ff843820f902 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:22:00.103462 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-21b2af05-1d0e-423e-a37c-ff843820f902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:22:00.166822 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 637/1275] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:22:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:22:00.190964 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfbd01a-addb-459c-93e9-7586d8f5a856 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:22:00.285228 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfbd01a-addb-459c-93e9-7586d8f5a856 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:22:00.316948 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe8d78-1be2-42a9-8252-4312e17debc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:22:00.317714 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe8d78-1be2-42a9-8252-4312e17debc6 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:22:00.317994 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe8d78-1be2-42a9-8252-4312e17debc6 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:22:00.318265 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe8d78-1be2-42a9-8252-4312e17debc6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:22:00.328339 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe8d78-1be2-42a9-8252-4312e17debc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 10:22:00.335247 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-4fbe8d78-1be2-42a9-8252-4312e17debc6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 10:22:00.336390 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 639/1276] 10.222.0.21 () {56 vars in 1096 bytes} [Mon Feb 28 10:22:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:22:00.343265 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2af05-1d0e-423e-a37c-ff843820f902 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:22:00.436969 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2af05-1d0e-423e-a37c-ff843820f902 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:22:00.469099 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5944a-cc83-4693-98e3-c1cf38d8f702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:22:00.469734 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5944a-cc83-4693-98e3-c1cf38d8f702 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:22:00.470009 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5944a-cc83-4693-98e3-c1cf38d8f702 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:22:00.470277 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5944a-cc83-4693-98e3-c1cf38d8f702 None admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:22:00.471031 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5944a-cc83-4693-98e3-c1cf38d8f702 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:22:00.471328 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5944a-cc83-4693-98e3-c1cf38d8f702 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:22:00.472664 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5944a-cc83-4693-98e3-c1cf38d8f702 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:22:00.480144 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 638/1277] 10.222.0.21 () {56 vars in 1099 bytes} [Mon Feb 28 10:22:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:22:00.486232 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe8d78-1be2-42a9-8252-4312e17debc6 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:22:00.585053 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe8d78-1be2-42a9-8252-4312e17debc6 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:22:00.622651 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812342d6-873f-4007-9d3c-e5d8f36ff362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:22:00.623501 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812342d6-873f-4007-9d3c-e5d8f36ff362 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:22:00.623783 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812342d6-873f-4007-9d3c-e5d8f36ff362 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:22:00.624085 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812342d6-873f-4007-9d3c-e5d8f36ff362 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:22:00.634834 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812342d6-873f-4007-9d3c-e5d8f36ff362 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:22:00.636253 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812342d6-873f-4007-9d3c-e5d8f36ff362 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:22:00.652075 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-812342d6-873f-4007-9d3c-e5d8f36ff362 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:22:00.653927 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 640/1278] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:22:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:22:00.659576 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5944a-cc83-4693-98e3-c1cf38d8f702 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:22:00.752607 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5944a-cc83-4693-98e3-c1cf38d8f702 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:22:00.784109 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47a74e-32cc-48af-9f1f-4e6a5c186ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:22:00.784578 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47a74e-32cc-48af-9f1f-4e6a5c186ec4 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:22:00.784758 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47a74e-32cc-48af-9f1f-4e6a5c186ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:22:00.785149 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47a74e-32cc-48af-9f1f-4e6a5c186ec4 None admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:22:00.785904 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f47a74e-32cc-48af-9f1f-4e6a5c186ec4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:22:00.786206 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f47a74e-32cc-48af-9f1f-4e6a5c186ec4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:22:00.787581 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f47a74e-32cc-48af-9f1f-4e6a5c186ec4 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:22:00.798837 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 639/1279] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:22:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:22:00.804432 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812342d6-873f-4007-9d3c-e5d8f36ff362 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:22:00.901294 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812342d6-873f-4007-9d3c-e5d8f36ff362 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:22:00.931970 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a93e757-115b-4858-9c46-0ac9307c2750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:22:00.932746 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a93e757-115b-4858-9c46-0ac9307c2750 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:22:00.933024 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a93e757-115b-4858-9c46-0ac9307c2750 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:22:00.933294 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a93e757-115b-4858-9c46-0ac9307c2750 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:22:00.941866 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a93e757-115b-4858-9c46-0ac9307c2750 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:22:00.943305 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a93e757-115b-4858-9c46-0ac9307c2750 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:22:00.957088 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-7a93e757-115b-4858-9c46-0ac9307c2750 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 28 10:22:00.959247 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 641/1280] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:22:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:22:00.963949 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47a74e-32cc-48af-9f1f-4e6a5c186ec4 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:22:01.055470 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47a74e-32cc-48af-9f1f-4e6a5c186ec4 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:22:01.087292 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e6a4d-9650-4b4e-bec3-216c3998e54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:22:01.087935 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e6a4d-9650-4b4e-bec3-216c3998e54e None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:22:01.088213 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e6a4d-9650-4b4e-bec3-216c3998e54e None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:22:01.088484 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e6a4d-9650-4b4e-bec3-216c3998e54e None admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:22:01.089291 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e6a4d-9650-4b4e-bec3-216c3998e54e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:22:01.089593 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e6a4d-9650-4b4e-bec3-216c3998e54e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:22:01.091109 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e6a4d-9650-4b4e-bec3-216c3998e54e None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:22:01.107592 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 640/1281] 10.222.0.21 () {56 vars in 1143 bytes} [Mon Feb 28 10:22:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:22:01.113304 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a93e757-115b-4858-9c46-0ac9307c2750 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:22:01.206991 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a93e757-115b-4858-9c46-0ac9307c2750 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:22:01.238226 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0809dc9-97dd-4387-880c-361dfa2c9e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:22:01.238874 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0809dc9-97dd-4387-880c-361dfa2c9e52 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:22:01.239162 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0809dc9-97dd-4387-880c-361dfa2c9e52 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:22:01.239434 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0809dc9-97dd-4387-880c-361dfa2c9e52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:22:01.301562 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0809dc9-97dd-4387-880c-361dfa2c9e52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:22:01.303014 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0809dc9-97dd-4387-880c-361dfa2c9e52 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:22:01.393843 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 642/1282] 10.222.0.21 () {58 vars in 1282 bytes} [Mon Feb 28 10:22:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 10:22:01.399617 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e6a4d-9650-4b4e-bec3-216c3998e54e None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:22:01.492021 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e6a4d-9650-4b4e-bec3-216c3998e54e None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:22:01.524123 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68165378-7e03-467a-8b1a-5689de78da59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:22:01.524883 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68165378-7e03-467a-8b1a-5689de78da59 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:22:01.525160 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68165378-7e03-467a-8b1a-5689de78da59 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:22:01.525430 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68165378-7e03-467a-8b1a-5689de78da59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:22:01.534928 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68165378-7e03-467a-8b1a-5689de78da59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:22:01.536344 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68165378-7e03-467a-8b1a-5689de78da59 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:22:01.552580 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-68165378-7e03-467a-8b1a-5689de78da59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 10:22:01.553721 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 641/1283] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:22:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:22:01.560525 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0809dc9-97dd-4387-880c-361dfa2c9e52 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:22:01.656622 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0809dc9-97dd-4387-880c-361dfa2c9e52 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:22:01.689239 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71591d80-be84-458d-9f9b-967e3f0fb97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:22:01.689894 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71591d80-be84-458d-9f9b-967e3f0fb97a None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:22:01.690175 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71591d80-be84-458d-9f9b-967e3f0fb97a None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:22:01.690447 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71591d80-be84-458d-9f9b-967e3f0fb97a None admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:22:01.691184 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71591d80-be84-458d-9f9b-967e3f0fb97a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:22:01.691484 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71591d80-be84-458d-9f9b-967e3f0fb97a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:22:01.692823 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71591d80-be84-458d-9f9b-967e3f0fb97a None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:22:01.704292 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 643/1284] 10.222.0.21 () {56 vars in 1109 bytes} [Mon Feb 28 10:22:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:22:01.710226 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68165378-7e03-467a-8b1a-5689de78da59 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:22:01.804349 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68165378-7e03-467a-8b1a-5689de78da59 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:22:01.836359 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2de6bc-6633-4d69-b972-26a3686808e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:22:01.837113 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2de6bc-6633-4d69-b972-26a3686808e6 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:22:01.837391 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2de6bc-6633-4d69-b972-26a3686808e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:22:01.837663 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2de6bc-6633-4d69-b972-26a3686808e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:22:01.844099 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2de6bc-6633-4d69-b972-26a3686808e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:22:01.845528 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2de6bc-6633-4d69-b972-26a3686808e6 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:22:01.858697 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING keystone.server.flask.application [None req-ba2de6bc-6633-4d69-b972-26a3686808e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 10:22:01.859855 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 642/1285] 10.222.0.21 () {56 vars in 1111 bytes} [Mon Feb 28 10:22:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:22:01.865503 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71591d80-be84-458d-9f9b-967e3f0fb97a None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:22:01.960198 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71591d80-be84-458d-9f9b-967e3f0fb97a None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:22:01.991691 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd476c-021e-416b-bea4-ba41219c8ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:22:01.992325 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd476c-021e-416b-bea4-ba41219c8ed1 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:22:01.992601 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd476c-021e-416b-bea4-ba41219c8ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:22:01.992869 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd476c-021e-416b-bea4-ba41219c8ed1 None admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:22:01.993622 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd476c-021e-416b-bea4-ba41219c8ed1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:22:01.993923 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd476c-021e-416b-bea4-ba41219c8ed1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:22:01.995340 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd476c-021e-416b-bea4-ba41219c8ed1 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:22:02.006905 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 644/1286] 10.222.0.21 () {56 vars in 1148 bytes} [Mon Feb 28 10:22:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:22:02.013403 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2de6bc-6633-4d69-b972-26a3686808e6 None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:22:02.107352 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2de6bc-6633-4d69-b972-26a3686808e6 None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:22:02.139013 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00136e-ed59-49a3-9cd4-204b0713dc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:22:02.139634 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00136e-ed59-49a3-9cd4-204b0713dc71 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:22:02.139917 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00136e-ed59-49a3-9cd4-204b0713dc71 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:22:02.140192 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00136e-ed59-49a3-9cd4-204b0713dc71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:22:02.140992 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc00136e-ed59-49a3-9cd4-204b0713dc71 None admin] RBAC: Adding query filter params (role.id=48e4608a7b3f4b87a20b10c4d1b45aa9, scope.project.id=5d1d6f8141924b2d99b766f975a3d43b, user.id=1b2346e4de5d45a79d4bb2abb01d4827) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:22:02.141299 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc00136e-ed59-49a3-9cd4-204b0713dc71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:22:02.142719 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc00136e-ed59-49a3-9cd4-204b0713dc71 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:22:02.148226 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 643/1287] 10.222.0.21 () {56 vars in 1374 bytes} [Mon Feb 28 10:22:02 2022] GET /identity/v3/role_assignments?user.id=1b2346e4de5d45a79d4bb2abb01d4827&scope.project.id=5d1d6f8141924b2d99b766f975a3d43b&role.id=48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:22:04.439427 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516914a-0446-4798-875d-088cdd75f04b None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:22:04.439967 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516914a-0446-4798-875d-088cdd75f04b None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:22:04.439967 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516914a-0446-4798-875d-088cdd75f04b None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:22:04.441753 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 645/1288] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:22:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:22:04.446924 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783b65d-5ee1-43b5-9100-bbab71cf9f38 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:22:04.447339 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783b65d-5ee1-43b5-9100-bbab71cf9f38 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:22:04.447467 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783b65d-5ee1-43b5-9100-bbab71cf9f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:22:04.464964 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-4783b65d-5ee1-43b5-9100-bbab71cf9f38 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:22:04.466569 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-4783b65d-5ee1-43b5-9100-bbab71cf9f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:22:04.528910 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 644/1289] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:22:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:22:04.550801 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516914a-0446-4798-875d-088cdd75f04b None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:22:04.661745 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516914a-0446-4798-875d-088cdd75f04b None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:22:04.695268 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cddb7ab-ff41-4645-aa53-6e42fae6a1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:22:04.695967 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cddb7ab-ff41-4645-aa53-6e42fae6a1e2 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:22:04.696243 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cddb7ab-ff41-4645-aa53-6e42fae6a1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:22:04.696511 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cddb7ab-ff41-4645-aa53-6e42fae6a1e2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:22:04.697141 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cddb7ab-ff41-4645-aa53-6e42fae6a1e2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:22:04.698476 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cddb7ab-ff41-4645-aa53-6e42fae6a1e2 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:22:04.710114 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-9cddb7ab-ff41-4645-aa53-6e42fae6a1e2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 28 10:22:04.711459 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 646/1290] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Feb 28 10:22:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:22:04.717320 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783b65d-5ee1-43b5-9100-bbab71cf9f38 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:22:04.815779 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783b65d-5ee1-43b5-9100-bbab71cf9f38 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:22:04.852477 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e187d-c414-479a-8767-982c435d9952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:22:04.853137 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e187d-c414-479a-8767-982c435d9952 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:22:04.853413 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e187d-c414-479a-8767-982c435d9952 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:22:04.853685 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e187d-c414-479a-8767-982c435d9952 None admin] PATH_INFO: `/v3/services` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:22:04.854381 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e187d-c414-479a-8767-982c435d9952 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:22:04.854712 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e187d-c414-479a-8767-982c435d9952 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:22:04.856593 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e187d-c414-479a-8767-982c435d9952 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:22:04.866098 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 645/1291] 10.222.0.21 () {56 vars in 1116 bytes} [Mon Feb 28 10:22:04 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:22:04.867317 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cddb7ab-ff41-4645-aa53-6e42fae6a1e2 None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:22:04.962292 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cddb7ab-ff41-4645-aa53-6e42fae6a1e2 None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:22:04.993252 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b2a7e-c61d-4f5a-9d7a-e70760850fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:22:04.993890 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b2a7e-c61d-4f5a-9d7a-e70760850fb6 None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:22:04.994166 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b2a7e-c61d-4f5a-9d7a-e70760850fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:22:04.994434 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b2a7e-c61d-4f5a-9d7a-e70760850fb6 None admin] PATH_INFO: `/v3/services` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:22:04.995146 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b2a7e-c61d-4f5a-9d7a-e70760850fb6 None admin] RBAC: Adding query filter params (type=placement) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:22:04.995450 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b2a7e-c61d-4f5a-9d7a-e70760850fb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:22:04.997532 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b2a7e-c61d-4f5a-9d7a-e70760850fb6 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:22:05.001686 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 647/1292] 10.222.0.21 () {56 vars in 1116 bytes} [Mon Feb 28 10:22:04 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:22:07.259418 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791bfb1-deb3-4efb-9773-7464e63d2184 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:22:07.259952 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791bfb1-deb3-4efb-9773-7464e63d2184 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:22:07.259952 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791bfb1-deb3-4efb-9773-7464e63d2184 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:22:07.261636 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 646/1293] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:22:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:22:07.267275 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9d86b-4a42-493e-8200-0500e7d704da None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:22:07.267696 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9d86b-4a42-493e-8200-0500e7d704da None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:22:07.267803 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9d86b-4a42-493e-8200-0500e7d704da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:22:07.284636 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-08f9d86b-4a42-493e-8200-0500e7d704da None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:22:07.285794 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-08f9d86b-4a42-493e-8200-0500e7d704da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:22:07.348159 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 648/1294] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:22:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:22:07.370330 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0791bfb1-deb3-4efb-9773-7464e63d2184 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:22:07.466489 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0791bfb1-deb3-4efb-9773-7464e63d2184 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:22:07.498226 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893e9d7-adce-44c7-9ad3-dc8d28e43cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:22:07.498881 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893e9d7-adce-44c7-9ad3-dc8d28e43cea None admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:22:07.499159 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893e9d7-adce-44c7-9ad3-dc8d28e43cea None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:22:07.499425 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893e9d7-adce-44c7-9ad3-dc8d28e43cea None admin] PATH_INFO: `/v3/services` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:22:07.500131 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a893e9d7-adce-44c7-9ad3-dc8d28e43cea None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:22:07.501470 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a893e9d7-adce-44c7-9ad3-dc8d28e43cea None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:22:07.514879 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 647/1295] 10.222.0.21 () {60 vars in 1141 bytes} [Mon Feb 28 10:22:07 2022] POST /identity/v3/services => generated 246 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:22:09.830898 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90282de4-e7e2-4cb5-9727-504fc4397ff9 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:22:09.831469 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90282de4-e7e2-4cb5-9727-504fc4397ff9 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:22:09.831469 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90282de4-e7e2-4cb5-9727-504fc4397ff9 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:22:09.833213 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 649/1296] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:22:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:22:09.838614 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135ec7e-7d7e-4db6-a799-bd12499ac913 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:22:09.839040 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135ec7e-7d7e-4db6-a799-bd12499ac913 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:22:09.839185 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135ec7e-7d7e-4db6-a799-bd12499ac913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:22:09.855809 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-3135ec7e-7d7e-4db6-a799-bd12499ac913 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:22:09.856987 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-3135ec7e-7d7e-4db6-a799-bd12499ac913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:22:09.932336 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 648/1297] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:22:09 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:22:09.956604 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90282de4-e7e2-4cb5-9727-504fc4397ff9 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:22:10.050954 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90282de4-e7e2-4cb5-9727-504fc4397ff9 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:22:10.082923 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd23e1-5e27-42ef-b754-e8833505f18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:22:10.083637 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd23e1-5e27-42ef-b754-e8833505f18e None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:22:10.083913 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd23e1-5e27-42ef-b754-e8833505f18e None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:22:10.084182 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd23e1-5e27-42ef-b754-e8833505f18e None admin] PATH_INFO: `/v3/services/placement` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:22:10.084813 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd23e1-5e27-42ef-b754-e8833505f18e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:22:10.086154 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd23e1-5e27-42ef-b754-e8833505f18e None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:22:10.096866 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-41bd23e1-5e27-42ef-b754-e8833505f18e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 28 10:22:10.097989 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 650/1298] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Feb 28 10:22:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 10:22:10.103924 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135ec7e-7d7e-4db6-a799-bd12499ac913 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:22:10.197403 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135ec7e-7d7e-4db6-a799-bd12499ac913 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:22:10.230785 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebbf840-836f-486b-b390-626fd3a1e96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:22:10.231966 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbf840-836f-486b-b390-626fd3a1e96b None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:22:10.232271 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbf840-836f-486b-b390-626fd3a1e96b None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:22:10.232542 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbf840-836f-486b-b390-626fd3a1e96b None admin] PATH_INFO: `/v3/services` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:22:10.233232 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebbf840-836f-486b-b390-626fd3a1e96b None admin] RBAC: Adding query filter params (name=placement) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:22:10.233531 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebbf840-836f-486b-b390-626fd3a1e96b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:22:10.234911 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebbf840-836f-486b-b390-626fd3a1e96b None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:22:10.239860 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 649/1299] 10.222.0.21 () {56 vars in 1116 bytes} [Mon Feb 28 10:22:10 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:22:10.245677 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd23e1-5e27-42ef-b754-e8833505f18e None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:22:10.339067 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd23e1-5e27-42ef-b754-e8833505f18e None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:22:10.370098 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19cf80b-3643-4d7c-94d5-0ae1e30a3dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:22:10.370756 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cf80b-3643-4d7c-94d5-0ae1e30a3dbf None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:22:10.371039 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cf80b-3643-4d7c-94d5-0ae1e30a3dbf None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:22:10.371313 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cf80b-3643-4d7c-94d5-0ae1e30a3dbf None admin] PATH_INFO: `/v3/endpoints` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:22:10.372297 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19cf80b-3643-4d7c-94d5-0ae1e30a3dbf None admin] RBAC: Adding query filter params (interface=public, service_id=3dede9e5bb9e4b88815af956b3cbe38b, region_id=RegionOne) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:22:10.372622 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19cf80b-3643-4d7c-94d5-0ae1e30a3dbf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:22:10.373967 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19cf80b-3643-4d7c-94d5-0ae1e30a3dbf None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:22:10.378747 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 651/1300] 10.222.0.21 () {56 vars in 1251 bytes} [Mon Feb 28 10:22:10 2022] GET /identity/v3/endpoints?service_id=3dede9e5bb9e4b88815af956b3cbe38b&interface=public®ion_id=RegionOne => generated 194 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:22:10.384072 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebbf840-836f-486b-b390-626fd3a1e96b None admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:22:10.478019 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebbf840-836f-486b-b390-626fd3a1e96b None admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:22:10.509509 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9158d-f68a-4080-a6dd-dad7a364c717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:22:10.510147 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9158d-f68a-4080-a6dd-dad7a364c717 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:22:10.510427 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9158d-f68a-4080-a6dd-dad7a364c717 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:22:10.510729 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9158d-f68a-4080-a6dd-dad7a364c717 None admin] PATH_INFO: `/v3/services` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:22:10.511394 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb9158d-f68a-4080-a6dd-dad7a364c717 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:22:10.513384 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb9158d-f68a-4080-a6dd-dad7a364c717 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:22:10.520057 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 650/1301] 10.222.0.21 () {56 vars in 1087 bytes} [Mon Feb 28 10:22:10 2022] GET /identity/v3/services => generated 2191 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:22:12.767381 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ab2c8-ebfb-4ec7-a3d3-2fdee9020bf6 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:22:12.768019 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ab2c8-ebfb-4ec7-a3d3-2fdee9020bf6 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:22:12.768019 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ab2c8-ebfb-4ec7-a3d3-2fdee9020bf6 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:22:12.769682 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 652/1302] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:22:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:22:12.774795 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd1079-d4dd-4842-a59f-55019d3639d1 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:22:12.775213 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd1079-d4dd-4842-a59f-55019d3639d1 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:22:12.775346 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd1079-d4dd-4842-a59f-55019d3639d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:22:12.791482 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-67bd1079-d4dd-4842-a59f-55019d3639d1 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:22:12.792638 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-67bd1079-d4dd-4842-a59f-55019d3639d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:22:12.855834 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 651/1303] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:22:12 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 10:22:12.879610 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ab2c8-ebfb-4ec7-a3d3-2fdee9020bf6 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:22:12.974808 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ab2c8-ebfb-4ec7-a3d3-2fdee9020bf6 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:22:13.005757 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f984f-6038-485a-9480-5e9e34e41dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:22:13.006531 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f984f-6038-485a-9480-5e9e34e41dff None admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:22:13.006834 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f984f-6038-485a-9480-5e9e34e41dff None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:22:13.007106 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f984f-6038-485a-9480-5e9e34e41dff None admin] PATH_INFO: `/v3/services/placement` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:22:13.007741 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f984f-6038-485a-9480-5e9e34e41dff None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:22:13.009108 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f984f-6038-485a-9480-5e9e34e41dff None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:22:13.019934 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING keystone.server.flask.application [None req-662f984f-6038-485a-9480-5e9e34e41dff None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 28 10:22:13.021003 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 653/1304] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Feb 28 10:22:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 10:22:13.026984 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd1079-d4dd-4842-a59f-55019d3639d1 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:22:13.119723 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd1079-d4dd-4842-a59f-55019d3639d1 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:22:13.151410 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcdf562-2ea8-49d6-980f-a9ffc4307e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:22:13.152043 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdf562-2ea8-49d6-980f-a9ffc4307e79 None admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:22:13.152318 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdf562-2ea8-49d6-980f-a9ffc4307e79 None admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:22:13.152586 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdf562-2ea8-49d6-980f-a9ffc4307e79 None admin] PATH_INFO: `/v3/services` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:22:13.154225 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcdf562-2ea8-49d6-980f-a9ffc4307e79 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:22:13.154520 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcdf562-2ea8-49d6-980f-a9ffc4307e79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:22:13.155886 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcdf562-2ea8-49d6-980f-a9ffc4307e79 None admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:22:13.160734 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 652/1305] 10.222.0.21 () {56 vars in 1116 bytes} [Mon Feb 28 10:22:13 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:22:13.166211 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f984f-6038-485a-9480-5e9e34e41dff None admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:22:13.260431 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f984f-6038-485a-9480-5e9e34e41dff None admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:22:13.292070 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3db089-e843-49bf-b736-900cfffe9004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:22:13.292695 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3db089-e843-49bf-b736-900cfffe9004 None admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:22:13.292969 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3db089-e843-49bf-b736-900cfffe9004 None admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:22:13.293235 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3db089-e843-49bf-b736-900cfffe9004 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:22:13.294914 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3db089-e843-49bf-b736-900cfffe9004 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:22:13.296255 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3db089-e843-49bf-b736-900cfffe9004 None admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:22:13.314311 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 654/1306] 10.222.0.21 () {60 vars in 1144 bytes} [Mon Feb 28 10:22:13 2022] POST /identity/v3/endpoints => generated 331 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:23:16.681964 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c023d-40e9-41e2-ad99-b1b4d8275915 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:16.683049 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c023d-40e9-41e2-ad99-b1b4d8275915 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:16.683534 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c023d-40e9-41e2-ad99-b1b4d8275915 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:16.695531 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295c0e0-4f1b-4533-90a8-523d386cbeb9 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:16.697463 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295c0e0-4f1b-4533-90a8-523d386cbeb9 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:16.698275 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295c0e0-4f1b-4533-90a8-523d386cbeb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:16.707217 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 653/1307] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:23:16 2022] GET /identity => generated 270 bytes in 26 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:23:16.806433 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-4295c0e0-4f1b-4533-90a8-523d386cbeb9 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:23:16.808043 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-4295c0e0-4f1b-4533-90a8-523d386cbeb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:23:16.967187 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 655/1308] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:23:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:23:16.975877 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c023d-40e9-41e2-ad99-b1b4d8275915 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:23:16.978020 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-391c023d-40e9-41e2-ad99-b1b4d8275915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:23:17.132967 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c023d-40e9-41e2-ad99-b1b4d8275915 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:23:17.227881 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45baca7-2589-470c-a6a8-68667c68c678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:23:17.228542 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45baca7-2589-470c-a6a8-68667c68c678 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:17.228818 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45baca7-2589-470c-a6a8-68667c68c678 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:17.229083 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45baca7-2589-470c-a6a8-68667c68c678 admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:17.229796 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45baca7-2589-470c-a6a8-68667c68c678 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:23:17.231627 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING py.warnings [None req-c45baca7-2589-470c-a6a8-68667c68c678 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 10:23:17.231627 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: warnings.warn(msg) Feb 28 10:23:17.231627 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: Feb 28 10:23:17.233310 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45baca7-2589-470c-a6a8-68667c68c678 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:23:17.256535 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 654/1309] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:23:16 2022] GET /identity/v3/projects => generated 2553 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:23:19.609275 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b46a8-237f-4b8c-866f-d11eb8d427f9 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:19.609847 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b46a8-237f-4b8c-866f-d11eb8d427f9 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:19.609847 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b46a8-237f-4b8c-866f-d11eb8d427f9 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:19.611624 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 656/1310] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:23:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:23:19.616830 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db327b2e-bfe1-4e43-8063-ae604c2fc6eb None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:19.617222 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db327b2e-bfe1-4e43-8063-ae604c2fc6eb None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:19.617387 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db327b2e-bfe1-4e43-8063-ae604c2fc6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:19.685504 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-db327b2e-bfe1-4e43-8063-ae604c2fc6eb None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:23:19.686734 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-db327b2e-bfe1-4e43-8063-ae604c2fc6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:23:19.781430 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 655/1311] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:23:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:23:19.836276 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143096d2-1f8d-4aa5-9c40-6bc250551cf7 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:19.836569 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143096d2-1f8d-4aa5-9c40-6bc250551cf7 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:19.836848 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143096d2-1f8d-4aa5-9c40-6bc250551cf7 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:19.838667 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 657/1312] 10.222.0.21 () {54 vars in 964 bytes} [Mon Feb 28 10:23:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:23:19.845955 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084365b-7401-4c30-b8b5-c7adf8dfe21c None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:19.846633 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084365b-7401-4c30-b8b5-c7adf8dfe21c None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:19.847110 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084365b-7401-4c30-b8b5-c7adf8dfe21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:19.930946 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-c084365b-7401-4c30-b8b5-c7adf8dfe21c None None] MFA Rules not processed for user `abaa12b94c834676bb17bf997dace5d1`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:23:19.932158 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-c084365b-7401-4c30-b8b5-c7adf8dfe21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:23:20.010053 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 656/1313] 10.222.0.21 () {58 vars in 1061 bytes} [Mon Feb 28 10:23:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:23:20.019804 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143096d2-1f8d-4aa5-9c40-6bc250551cf7 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:23:20.021285 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-143096d2-1f8d-4aa5-9c40-6bc250551cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:23:20.125340 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143096d2-1f8d-4aa5-9c40-6bc250551cf7 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:23:20.205284 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e3f4c-e14e-4d54-a761-dcffdf36c10f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:23:20.205972 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e3f4c-e14e-4d54-a761-dcffdf36c10f service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:20.206322 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e3f4c-e14e-4d54-a761-dcffdf36c10f service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:20.206713 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e3f4c-e14e-4d54-a761-dcffdf36c10f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:20.208678 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-0d4e3f4c-e14e-4d54-a761-dcffdf36c10f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:23:20.317596 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4e3f4c-e14e-4d54-a761-dcffdf36c10f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:23:20.319063 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4e3f4c-e14e-4d54-a761-dcffdf36c10f service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:23:20.337833 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 658/1314] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:23:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:23:22.961314 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928150e-854f-4ee5-94da-6c9fd14483e7 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:22.961839 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928150e-854f-4ee5-94da-6c9fd14483e7 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:22.961965 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928150e-854f-4ee5-94da-6c9fd14483e7 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:22.963724 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 657/1315] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:23:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:23:22.969199 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d1c34-7446-4beb-8dd6-b3da4a92c0ac None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:22.969628 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d1c34-7446-4beb-8dd6-b3da4a92c0ac None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:22.969723 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d1c34-7446-4beb-8dd6-b3da4a92c0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:23.032334 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-522d1c34-7446-4beb-8dd6-b3da4a92c0ac None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:23:23.033518 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-522d1c34-7446-4beb-8dd6-b3da4a92c0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:23:23.131100 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 659/1316] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:23:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:23:23.182514 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0ca7d-895f-4c8d-a982-5efd51866861 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:23.182830 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0ca7d-895f-4c8d-a982-5efd51866861 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:23.183104 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0ca7d-895f-4c8d-a982-5efd51866861 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:23.185432 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 658/1317] 10.222.0.21 () {54 vars in 964 bytes} [Mon Feb 28 10:23:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:23:23.191215 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ff877-cfbd-448a-896d-ec77cfdf7615 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:23.191505 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ff877-cfbd-448a-896d-ec77cfdf7615 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:23.191777 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ff877-cfbd-448a-896d-ec77cfdf7615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:23.265107 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-f62ff877-cfbd-448a-896d-ec77cfdf7615 None None] MFA Rules not processed for user `abaa12b94c834676bb17bf997dace5d1`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:23:23.266292 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-f62ff877-cfbd-448a-896d-ec77cfdf7615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:23:23.337274 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 660/1318] 10.222.0.21 () {58 vars in 1061 bytes} [Mon Feb 28 10:23:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:23:23.347331 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0ca7d-895f-4c8d-a982-5efd51866861 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:23:23.348853 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-53c0ca7d-895f-4c8d-a982-5efd51866861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:23:23.446136 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0ca7d-895f-4c8d-a982-5efd51866861 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:23:23.519230 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9e6f5-fbb6-463b-be64-dc2dc2b96260 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:23:23.519873 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9e6f5-fbb6-463b-be64-dc2dc2b96260 service neutron] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:23.520152 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9e6f5-fbb6-463b-be64-dc2dc2b96260 service neutron] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:23.520424 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9e6f5-fbb6-463b-be64-dc2dc2b96260 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:23.522049 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-6ac9e6f5-fbb6-463b-be64-dc2dc2b96260 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:23:23.625842 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac9e6f5-fbb6-463b-be64-dc2dc2b96260 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:23:23.627301 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac9e6f5-fbb6-463b-be64-dc2dc2b96260 service neutron] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:23:23.644374 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 659/1319] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:23:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:23:26.459738 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33648c-950f-4c3a-a97d-baae8c391bdf None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:26.460300 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33648c-950f-4c3a-a97d-baae8c391bdf None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:26.460300 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33648c-950f-4c3a-a97d-baae8c391bdf None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:26.462066 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 661/1320] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:23:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:23:26.467754 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c56f35-c2f3-4444-b8eb-183b324c2bbb None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:26.468144 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c56f35-c2f3-4444-b8eb-183b324c2bbb None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:26.468292 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c56f35-c2f3-4444-b8eb-183b324c2bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:26.531685 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-a0c56f35-c2f3-4444-b8eb-183b324c2bbb None None] MFA Rules not processed for user `65bb7dc9a10b405e9a58441897d664c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:23:26.532872 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-a0c56f35-c2f3-4444-b8eb-183b324c2bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:23:26.626160 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 660/1321] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:23:26 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:23:26.670202 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33648c-950f-4c3a-a97d-baae8c391bdf None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:23:26.671758 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-3b33648c-950f-4c3a-a97d-baae8c391bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:23:26.781786 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33648c-950f-4c3a-a97d-baae8c391bdf None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:23:26.862083 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702cd9d-0ae1-4f3f-815d-496dabc1109d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:23:26.862740 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702cd9d-0ae1-4f3f-815d-496dabc1109d service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:26.863019 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702cd9d-0ae1-4f3f-815d-496dabc1109d service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:26.863288 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702cd9d-0ae1-4f3f-815d-496dabc1109d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:26.864925 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-2702cd9d-0ae1-4f3f-815d-496dabc1109d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:23:26.983549 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2702cd9d-0ae1-4f3f-815d-496dabc1109d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:23:26.984973 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2702cd9d-0ae1-4f3f-815d-496dabc1109d service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:23:27.006890 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 662/1322] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:23:26 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:23:29.878341 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47ebd4-1069-4ccd-9758-b4d6b5da0efa None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:29.878834 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47ebd4-1069-4ccd-9758-b4d6b5da0efa None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:29.878950 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47ebd4-1069-4ccd-9758-b4d6b5da0efa None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:29.880672 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 661/1323] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:23:29.885808 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c751db-82b9-4374-8251-395b8bf41638 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:29.886192 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c751db-82b9-4374-8251-395b8bf41638 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:29.886380 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c751db-82b9-4374-8251-395b8bf41638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:29.949016 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-02c751db-82b9-4374-8251-395b8bf41638 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:23:29.950208 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-02c751db-82b9-4374-8251-395b8bf41638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:23:30.041072 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 663/1324] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:23:29 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:23:30.081299 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47ebd4-1069-4ccd-9758-b4d6b5da0efa None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:23:30.082857 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-5a47ebd4-1069-4ccd-9758-b4d6b5da0efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:23:30.178770 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47ebd4-1069-4ccd-9758-b4d6b5da0efa None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:23:30.246376 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad249c98-14fc-4b07-9ada-26b7f0f4b548 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:23:30.247027 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad249c98-14fc-4b07-9ada-26b7f0f4b548 service neutron] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:30.247844 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad249c98-14fc-4b07-9ada-26b7f0f4b548 service neutron] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:30.248232 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad249c98-14fc-4b07-9ada-26b7f0f4b548 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:30.249789 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-ad249c98-14fc-4b07-9ada-26b7f0f4b548 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:23:30.354186 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad249c98-14fc-4b07-9ada-26b7f0f4b548 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:23:30.355632 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad249c98-14fc-4b07-9ada-26b7f0f4b548 service neutron] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:23:30.372649 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 662/1325] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:23:30 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:23:33.330244 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb120e-575e-4885-b836-cf567fed179d None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:33.330799 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb120e-575e-4885-b836-cf567fed179d None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:33.330914 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb120e-575e-4885-b836-cf567fed179d None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:33.332655 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 664/1326] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:23:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:23:33.338218 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db999615-874a-4ece-8b3d-5d634b62e81c None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:33.338653 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db999615-874a-4ece-8b3d-5d634b62e81c None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:33.338808 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db999615-874a-4ece-8b3d-5d634b62e81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:33.401162 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-db999615-874a-4ece-8b3d-5d634b62e81c None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:23:33.402334 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-db999615-874a-4ece-8b3d-5d634b62e81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:23:33.494994 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 663/1327] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:23:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:23:33.531352 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb120e-575e-4885-b836-cf567fed179d None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:23:33.532914 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-6acb120e-575e-4885-b836-cf567fed179d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:23:33.634821 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb120e-575e-4885-b836-cf567fed179d None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:23:33.706146 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aaeb65-e455-44d0-9fb5-bb0168bbdf33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:23:33.706812 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aaeb65-e455-44d0-9fb5-bb0168bbdf33 service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:33.707098 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aaeb65-e455-44d0-9fb5-bb0168bbdf33 service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:33.707371 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aaeb65-e455-44d0-9fb5-bb0168bbdf33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:33.709261 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-89aaeb65-e455-44d0-9fb5-bb0168bbdf33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:23:33.815336 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aaeb65-e455-44d0-9fb5-bb0168bbdf33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:23:33.816758 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aaeb65-e455-44d0-9fb5-bb0168bbdf33 service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:23:33.834885 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 665/1328] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:23:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:23:36.195477 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238f4f9-ba88-4cea-99a9-4a386993c9ba None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:36.195976 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238f4f9-ba88-4cea-99a9-4a386993c9ba None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:36.196083 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238f4f9-ba88-4cea-99a9-4a386993c9ba None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:36.198000 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 664/1329] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:23:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:23:36.203523 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625a7f8-4b91-418f-8fa4-fd27241efeb8 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:36.203937 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625a7f8-4b91-418f-8fa4-fd27241efeb8 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:36.204065 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625a7f8-4b91-418f-8fa4-fd27241efeb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:36.267199 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-9625a7f8-4b91-418f-8fa4-fd27241efeb8 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:23:36.268382 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-9625a7f8-4b91-418f-8fa4-fd27241efeb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:23:36.366254 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 666/1330] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:23:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:23:36.402266 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1238f4f9-ba88-4cea-99a9-4a386993c9ba None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:23:36.404498 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-1238f4f9-ba88-4cea-99a9-4a386993c9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:23:36.502401 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1238f4f9-ba88-4cea-99a9-4a386993c9ba None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:23:36.572571 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c34251-0101-4ecf-9ed9-508dc51256f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:23:36.573207 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c34251-0101-4ecf-9ed9-508dc51256f5 service neutron] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:36.573486 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c34251-0101-4ecf-9ed9-508dc51256f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:36.573760 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c34251-0101-4ecf-9ed9-508dc51256f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:36.575410 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-b5c34251-0101-4ecf-9ed9-508dc51256f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:23:36.682121 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c34251-0101-4ecf-9ed9-508dc51256f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:23:36.683590 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c34251-0101-4ecf-9ed9-508dc51256f5 service neutron] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:23:36.702125 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 665/1331] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:23:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:23:39.074399 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bc87d-85a1-408f-b5a4-ca6bd275a499 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:39.074986 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bc87d-85a1-408f-b5a4-ca6bd275a499 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:39.074986 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bc87d-85a1-408f-b5a4-ca6bd275a499 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:39.077024 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 667/1332] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:23:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:23:39.082165 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec598d20-f692-4f1f-b131-68284aa5d5fd None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:39.082586 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec598d20-f692-4f1f-b131-68284aa5d5fd None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:39.082888 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec598d20-f692-4f1f-b131-68284aa5d5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:39.150433 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-ec598d20-f692-4f1f-b131-68284aa5d5fd None None] MFA Rules not processed for user `65bb7dc9a10b405e9a58441897d664c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:23:39.151558 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-ec598d20-f692-4f1f-b131-68284aa5d5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:23:39.247240 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 666/1333] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:23:39 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:23:39.285065 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433bc87d-85a1-408f-b5a4-ca6bd275a499 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:23:39.286587 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-433bc87d-85a1-408f-b5a4-ca6bd275a499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:23:39.387164 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433bc87d-85a1-408f-b5a4-ca6bd275a499 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:23:39.458272 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac1d32-2bba-4c8b-8725-c9e0e5064003 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:23:39.458849 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac1d32-2bba-4c8b-8725-c9e0e5064003 service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:39.459384 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac1d32-2bba-4c8b-8725-c9e0e5064003 service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:39.459658 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac1d32-2bba-4c8b-8725-c9e0e5064003 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:39.461270 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-baac1d32-2bba-4c8b-8725-c9e0e5064003 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:23:39.566438 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac1d32-2bba-4c8b-8725-c9e0e5064003 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:23:39.567876 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac1d32-2bba-4c8b-8725-c9e0e5064003 service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:23:39.585651 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 668/1334] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:23:39 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:23:42.135783 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144468f3-d3d5-4370-834e-d3bb9f31a511 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:42.136292 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144468f3-d3d5-4370-834e-d3bb9f31a511 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:42.136292 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144468f3-d3d5-4370-834e-d3bb9f31a511 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:42.138882 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 667/1335] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:23:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:23:42.144347 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df59b8-d993-4a51-a42d-777e74c7f1e6 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:42.144785 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df59b8-d993-4a51-a42d-777e74c7f1e6 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:42.144908 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df59b8-d993-4a51-a42d-777e74c7f1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:42.207399 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-45df59b8-d993-4a51-a42d-777e74c7f1e6 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:23:42.208578 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-45df59b8-d993-4a51-a42d-777e74c7f1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:23:42.301420 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 669/1336] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:23:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:23:42.338652 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144468f3-d3d5-4370-834e-d3bb9f31a511 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:23:42.340283 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-144468f3-d3d5-4370-834e-d3bb9f31a511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:23:42.446795 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144468f3-d3d5-4370-834e-d3bb9f31a511 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:23:42.521740 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8622f-7fc6-4b88-bf7c-cb4cd08b492e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:23:42.522394 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8622f-7fc6-4b88-bf7c-cb4cd08b492e service neutron] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:42.522706 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8622f-7fc6-4b88-bf7c-cb4cd08b492e service neutron] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:42.522984 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8622f-7fc6-4b88-bf7c-cb4cd08b492e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:42.524657 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-17a8622f-7fc6-4b88-bf7c-cb4cd08b492e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:23:42.637201 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a8622f-7fc6-4b88-bf7c-cb4cd08b492e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:23:42.638894 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a8622f-7fc6-4b88-bf7c-cb4cd08b492e service neutron] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:23:42.658892 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 668/1337] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:23:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:23:45.047621 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38684585-b432-476f-b630-fea764c4f64c None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:45.048227 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38684585-b432-476f-b630-fea764c4f64c None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:45.048227 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38684585-b432-476f-b630-fea764c4f64c None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:45.050102 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 670/1338] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:23:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:23:45.055142 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e4623-4c55-4eca-96af-c2b3bd3ea661 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:45.055594 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e4623-4c55-4eca-96af-c2b3bd3ea661 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:45.055704 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e4623-4c55-4eca-96af-c2b3bd3ea661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:45.118890 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-e07e4623-4c55-4eca-96af-c2b3bd3ea661 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:23:45.119990 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-e07e4623-4c55-4eca-96af-c2b3bd3ea661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:23:45.215026 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 669/1339] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:23:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:23:45.255488 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38684585-b432-476f-b630-fea764c4f64c None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:23:45.256991 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-38684585-b432-476f-b630-fea764c4f64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:23:45.356635 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38684585-b432-476f-b630-fea764c4f64c None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:23:45.429754 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c5c385-bc4e-4b36-a023-bba69f0b01d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:23:45.430310 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5c385-bc4e-4b36-a023-bba69f0b01d2 service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:45.430588 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5c385-bc4e-4b36-a023-bba69f0b01d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:45.430883 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5c385-bc4e-4b36-a023-bba69f0b01d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:45.432491 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-86c5c385-bc4e-4b36-a023-bba69f0b01d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:23:45.537605 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c5c385-bc4e-4b36-a023-bba69f0b01d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:23:45.539049 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c5c385-bc4e-4b36-a023-bba69f0b01d2 service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:23:45.556639 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 671/1340] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:23:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:23:48.599926 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadfdab8-7a52-4241-bab6-ade07b7f87d7 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:48.600380 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadfdab8-7a52-4241-bab6-ade07b7f87d7 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:48.600485 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadfdab8-7a52-4241-bab6-ade07b7f87d7 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:48.602236 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 670/1341] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:23:48.607370 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987eb884-7089-43b5-b63b-25a85d618dda None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:48.607806 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987eb884-7089-43b5-b63b-25a85d618dda None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:48.607952 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987eb884-7089-43b5-b63b-25a85d618dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:48.675496 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-987eb884-7089-43b5-b63b-25a85d618dda None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:23:48.676606 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-987eb884-7089-43b5-b63b-25a85d618dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:23:48.774292 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 672/1342] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:23:48 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:23:48.811045 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadfdab8-7a52-4241-bab6-ade07b7f87d7 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:23:48.813144 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-eadfdab8-7a52-4241-bab6-ade07b7f87d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:23:48.902552 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadfdab8-7a52-4241-bab6-ade07b7f87d7 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:23:48.906648 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf40e5-3891-4a80-8e41-e6a00ed2907d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:23:48.907281 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf40e5-3891-4a80-8e41-e6a00ed2907d service neutron] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:48.907560 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf40e5-3891-4a80-8e41-e6a00ed2907d service neutron] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:48.907829 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf40e5-3891-4a80-8e41-e6a00ed2907d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:48.916383 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcf40e5-3891-4a80-8e41-e6a00ed2907d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:23:48.917792 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcf40e5-3891-4a80-8e41-e6a00ed2907d service neutron] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:23:48.927445 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 671/1343] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:23:48 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:23:53.327780 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc2dee-b657-4873-bdca-b6d7da96b315 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:53.328302 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc2dee-b657-4873-bdca-b6d7da96b315 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:53.328302 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc2dee-b657-4873-bdca-b6d7da96b315 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:53.330113 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 673/1344] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:23:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:23:53.335667 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b90ddb-60c5-4334-a286-2253e31b6af8 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:53.336112 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b90ddb-60c5-4334-a286-2253e31b6af8 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:53.336206 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b90ddb-60c5-4334-a286-2253e31b6af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:53.365784 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-55b90ddb-60c5-4334-a286-2253e31b6af8 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:23:53.366936 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-55b90ddb-60c5-4334-a286-2253e31b6af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:23:53.441121 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 672/1345] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:23:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:23:53.481806 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc2dee-b657-4873-bdca-b6d7da96b315 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:23:53.483563 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-26fc2dee-b657-4873-bdca-b6d7da96b315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:23:53.496130 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc2dee-b657-4873-bdca-b6d7da96b315 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:23:53.499723 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8930eb-1c26-45fa-8116-f4a770d34f4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:23:53.500368 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8930eb-1c26-45fa-8116-f4a770d34f4c service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:53.500645 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8930eb-1c26-45fa-8116-f4a770d34f4c service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:53.500914 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8930eb-1c26-45fa-8116-f4a770d34f4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:53.509757 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8930eb-1c26-45fa-8116-f4a770d34f4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:23:53.511214 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8930eb-1c26-45fa-8116-f4a770d34f4c service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:23:53.520422 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 674/1346] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:23:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:23:56.479591 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3765242-8a4f-496f-8393-7ca53b652571 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:56.480135 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3765242-8a4f-496f-8393-7ca53b652571 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:56.480135 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3765242-8a4f-496f-8393-7ca53b652571 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:56.481985 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 673/1347] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:23:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:23:56.487374 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297d0cb-3f96-4484-8ef1-1906cc4f4cc4 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:56.487824 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297d0cb-3f96-4484-8ef1-1906cc4f4cc4 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:56.488045 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297d0cb-3f96-4484-8ef1-1906cc4f4cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:56.506151 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-2297d0cb-3f96-4484-8ef1-1906cc4f4cc4 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:23:56.507298 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-2297d0cb-3f96-4484-8ef1-1906cc4f4cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:23:56.515578 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 675/1348] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:23:56 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:23:56.552622 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3765242-8a4f-496f-8393-7ca53b652571 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:23:56.564052 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3765242-8a4f-496f-8393-7ca53b652571 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:23:56.568152 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aaed2d-c32c-4afd-9c4d-2ff63358aac8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:23:56.568780 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aaed2d-c32c-4afd-9c4d-2ff63358aac8 service neutron] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:23:56.569058 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aaed2d-c32c-4afd-9c4d-2ff63358aac8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:23:56.569335 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aaed2d-c32c-4afd-9c4d-2ff63358aac8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:23:56.582075 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aaed2d-c32c-4afd-9c4d-2ff63358aac8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:23:56.584305 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aaed2d-c32c-4afd-9c4d-2ff63358aac8 service neutron] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:23:56.604961 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 674/1349] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:23:56 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:24:01.168546 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff1324-34dc-49bd-ac28-fa64f42f166e None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:01.169135 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff1324-34dc-49bd-ac28-fa64f42f166e None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:01.169135 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff1324-34dc-49bd-ac28-fa64f42f166e None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:01.171062 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 676/1350] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:24:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:01.176060 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ceaf6-c889-43fd-886f-95da66e929bb None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:01.176449 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ceaf6-c889-43fd-886f-95da66e929bb None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:01.176614 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ceaf6-c889-43fd-886f-95da66e929bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:01.194387 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-fb5ceaf6-c889-43fd-886f-95da66e929bb None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:01.195607 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-fb5ceaf6-c889-43fd-886f-95da66e929bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:01.204447 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 675/1351] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:24:01.242947 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff1324-34dc-49bd-ac28-fa64f42f166e None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:01.253998 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff1324-34dc-49bd-ac28-fa64f42f166e None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:01.257470 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f025d8b2-fde1-4f63-a223-157ca83da01f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:01.258094 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025d8b2-fde1-4f63-a223-157ca83da01f service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:01.258371 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025d8b2-fde1-4f63-a223-157ca83da01f service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:01.258665 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025d8b2-fde1-4f63-a223-157ca83da01f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:01.267695 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f025d8b2-fde1-4f63-a223-157ca83da01f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:01.269106 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f025d8b2-fde1-4f63-a223-157ca83da01f service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:01.278964 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 677/1352] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:24:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:24:06.559465 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437de1ea-f8c5-4d02-b09f-91df19e507cf None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:06.559948 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437de1ea-f8c5-4d02-b09f-91df19e507cf None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:06.559948 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437de1ea-f8c5-4d02-b09f-91df19e507cf None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:06.562023 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 676/1353] 10.222.0.21 () {54 vars in 921 bytes} [Mon Feb 28 10:24:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:06.567332 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd4985-07d9-4b83-bb45-54d591388c0b None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:06.568083 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd4985-07d9-4b83-bb45-54d591388c0b None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:06.568518 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd4985-07d9-4b83-bb45-54d591388c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:06.709275 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-66cd4985-07d9-4b83-bb45-54d591388c0b None None] MFA Rules not processed for user `1b2346e4de5d45a79d4bb2abb01d4827`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:06.710780 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-66cd4985-07d9-4b83-bb45-54d591388c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:06.796866 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 678/1354] 10.222.0.21 () {58 vars in 1018 bytes} [Mon Feb 28 10:24:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:24:11.293104 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864d00e-7e1b-441a-b633-b01cd44e81f0 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:11.294131 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864d00e-7e1b-441a-b633-b01cd44e81f0 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:11.294522 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864d00e-7e1b-441a-b633-b01cd44e81f0 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:11.296495 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 677/1355] 10.222.0.21 () {54 vars in 921 bytes} [Mon Feb 28 10:24:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:11.301917 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd65f78-aaca-47f3-96ce-29f070e23abe None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:11.302382 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd65f78-aaca-47f3-96ce-29f070e23abe None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:11.302712 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd65f78-aaca-47f3-96ce-29f070e23abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:11.322168 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-edd65f78-aaca-47f3-96ce-29f070e23abe None None] MFA Rules not processed for user `1b2346e4de5d45a79d4bb2abb01d4827`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:11.324117 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-edd65f78-aaca-47f3-96ce-29f070e23abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:11.333927 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 679/1356] 10.222.0.21 () {58 vars in 1018 bytes} [Mon Feb 28 10:24:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:24:12.685493 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e8518-545d-4ceb-bba0-a56dd18c7321 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:12.686009 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e8518-545d-4ceb-bba0-a56dd18c7321 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:12.686113 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e8518-545d-4ceb-bba0-a56dd18c7321 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:12.687857 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 678/1357] 10.222.0.21 () {54 vars in 921 bytes} [Mon Feb 28 10:24:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:12.693246 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fa568-d172-4fac-90f3-3111da67d055 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:12.693708 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fa568-d172-4fac-90f3-3111da67d055 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:12.693807 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fa568-d172-4fac-90f3-3111da67d055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:12.712520 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-121fa568-d172-4fac-90f3-3111da67d055 None None] MFA Rules not processed for user `1b2346e4de5d45a79d4bb2abb01d4827`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:12.713703 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-121fa568-d172-4fac-90f3-3111da67d055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:12.722659 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 680/1358] 10.222.0.21 () {58 vars in 1018 bytes} [Mon Feb 28 10:24:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:24:16.524718 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e2856-f655-494f-bd19-44e253f727ee None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:16.525311 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e2856-f655-494f-bd19-44e253f727ee None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:16.525311 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e2856-f655-494f-bd19-44e253f727ee None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:16.527937 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 679/1359] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:24:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:16.533031 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738e907-555f-4730-9cda-7d2b5851a4c8 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:16.533485 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738e907-555f-4730-9cda-7d2b5851a4c8 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:16.533588 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738e907-555f-4730-9cda-7d2b5851a4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:16.551405 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-7738e907-555f-4730-9cda-7d2b5851a4c8 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:16.552556 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-7738e907-555f-4730-9cda-7d2b5851a4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:16.561594 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 681/1360] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:24:16.616321 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9d469-76d2-47a2-bb94-293580f2bc35 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:16.616608 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9d469-76d2-47a2-bb94-293580f2bc35 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:16.616884 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9d469-76d2-47a2-bb94-293580f2bc35 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:16.618843 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 680/1361] 10.222.0.21 () {54 vars in 961 bytes} [Mon Feb 28 10:24:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:16.625097 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f65774-cadd-4e40-afaf-41f46134bba8 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:16.625392 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f65774-cadd-4e40-afaf-41f46134bba8 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:16.625670 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f65774-cadd-4e40-afaf-41f46134bba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:16.674558 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-75f65774-cadd-4e40-afaf-41f46134bba8 None None] MFA Rules not processed for user `ec202a34db8e47f4a6c18285245e3f5b`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:16.675765 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-75f65774-cadd-4e40-afaf-41f46134bba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:16.755924 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 682/1362] 10.222.0.21 () {58 vars in 1058 bytes} [Mon Feb 28 10:24:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:24:16.764957 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b9d469-76d2-47a2-bb94-293580f2bc35 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:16.780694 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b9d469-76d2-47a2-bb94-293580f2bc35 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:16.786295 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386c009-93f1-419f-92b8-f0dc2a7af523 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec202a34db8e47f4a6c18285245e3f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:16.786964 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386c009-93f1-419f-92b8-f0dc2a7af523 service nova] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:16.787241 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386c009-93f1-419f-92b8-f0dc2a7af523 service nova] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:16.787510 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386c009-93f1-419f-92b8-f0dc2a7af523 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:16.796904 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3386c009-93f1-419f-92b8-f0dc2a7af523 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:16.798465 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3386c009-93f1-419f-92b8-f0dc2a7af523 service nova] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:16.808625 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 681/1363] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:24:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:24:19.353334 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791c9f1-a1d7-4f5a-a365-ac8784a4a146 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:19.353854 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791c9f1-a1d7-4f5a-a365-ac8784a4a146 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:19.354896 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791c9f1-a1d7-4f5a-a365-ac8784a4a146 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:19.357681 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 683/1364] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:24:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:19.363204 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45830edc-1294-4a54-bd55-7760bd4149b0 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:19.363688 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45830edc-1294-4a54-bd55-7760bd4149b0 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:19.363798 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45830edc-1294-4a54-bd55-7760bd4149b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:19.382680 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-45830edc-1294-4a54-bd55-7760bd4149b0 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:19.383802 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-45830edc-1294-4a54-bd55-7760bd4149b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:19.391911 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 682/1365] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:24:19.437266 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c791c9f1-a1d7-4f5a-a365-ac8784a4a146 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:19.451862 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c791c9f1-a1d7-4f5a-a365-ac8784a4a146 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:19.457397 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a29e0-6e23-4138-ac33-b165c354e854 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec202a34db8e47f4a6c18285245e3f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:19.458411 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a29e0-6e23-4138-ac33-b165c354e854 service nova] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:19.458737 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a29e0-6e23-4138-ac33-b165c354e854 service nova] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:19.459011 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a29e0-6e23-4138-ac33-b165c354e854 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:19.467862 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a29e0-6e23-4138-ac33-b165c354e854 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:19.469422 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a29e0-6e23-4138-ac33-b165c354e854 service nova] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:19.479921 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 684/1366] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:24:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:24:22.120509 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745f467-44f2-48e2-955c-bf081878c25f None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:22.121004 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745f467-44f2-48e2-955c-bf081878c25f None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:22.121004 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745f467-44f2-48e2-955c-bf081878c25f None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:22.122767 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 683/1367] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:24:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:22.127956 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253a061-a576-4371-ab42-b41c0b0ff6ae None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:22.128375 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253a061-a576-4371-ab42-b41c0b0ff6ae None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:22.128507 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253a061-a576-4371-ab42-b41c0b0ff6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:22.146423 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-3253a061-a576-4371-ab42-b41c0b0ff6ae None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:22.147628 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-3253a061-a576-4371-ab42-b41c0b0ff6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:22.155355 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 685/1368] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:24:22.200007 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf469e2-ef3d-4c21-81df-be9f7b314e09 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:22.200291 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf469e2-ef3d-4c21-81df-be9f7b314e09 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:22.200570 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf469e2-ef3d-4c21-81df-be9f7b314e09 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:22.202337 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 684/1369] 10.222.0.21 () {54 vars in 961 bytes} [Mon Feb 28 10:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:22.207490 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4c328-27d3-49a2-9b59-64aa1b9f5351 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:22.208130 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4c328-27d3-49a2-9b59-64aa1b9f5351 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:22.208404 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4c328-27d3-49a2-9b59-64aa1b9f5351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:22.226563 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-dbd4c328-27d3-49a2-9b59-64aa1b9f5351 None None] MFA Rules not processed for user `ec202a34db8e47f4a6c18285245e3f5b`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:22.227746 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-dbd4c328-27d3-49a2-9b59-64aa1b9f5351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:22.237748 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 686/1370] 10.222.0.21 () {58 vars in 1058 bytes} [Mon Feb 28 10:24:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:24:22.245736 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf469e2-ef3d-4c21-81df-be9f7b314e09 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:22.259741 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf469e2-ef3d-4c21-81df-be9f7b314e09 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:22.265788 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432cb72-1f46-44d1-a34d-5d8399105538 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec202a34db8e47f4a6c18285245e3f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:22.266073 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432cb72-1f46-44d1-a34d-5d8399105538 service nova] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:22.266467 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432cb72-1f46-44d1-a34d-5d8399105538 service nova] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:22.266642 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432cb72-1f46-44d1-a34d-5d8399105538 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:22.275607 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5432cb72-1f46-44d1-a34d-5d8399105538 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:22.277148 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5432cb72-1f46-44d1-a34d-5d8399105538 service nova] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:22.293933 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 685/1371] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:24:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:24:24.750426 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4d02e-701e-4a14-a023-bdab39a73648 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:24.750967 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4d02e-701e-4a14-a023-bdab39a73648 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:24.751158 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4d02e-701e-4a14-a023-bdab39a73648 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:24.752845 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 687/1372] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:24:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:24.758833 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31a0fb-8fd2-425c-9dd4-9944fd22a409 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:24.759315 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31a0fb-8fd2-425c-9dd4-9944fd22a409 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:24.759393 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31a0fb-8fd2-425c-9dd4-9944fd22a409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:24.778970 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-2a31a0fb-8fd2-425c-9dd4-9944fd22a409 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:24.780465 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-2a31a0fb-8fd2-425c-9dd4-9944fd22a409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:24.788878 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 686/1373] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:24:24.835052 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae4d02e-701e-4a14-a023-bdab39a73648 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:24.850803 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae4d02e-701e-4a14-a023-bdab39a73648 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:24.857435 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ec8e4-7840-4540-9f6a-5cab14d2bbd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec202a34db8e47f4a6c18285245e3f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:24.858360 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ec8e4-7840-4540-9f6a-5cab14d2bbd6 service nova] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:24.858895 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ec8e4-7840-4540-9f6a-5cab14d2bbd6 service nova] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:24.859467 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ec8e4-7840-4540-9f6a-5cab14d2bbd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:24.861265 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8a555-cf83-40cd-b70a-f6571846aaa5 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:24.861555 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8a555-cf83-40cd-b70a-f6571846aaa5 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:24.861830 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8a555-cf83-40cd-b70a-f6571846aaa5 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:24.863973 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 687/1374] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:24:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:24.868760 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6fbcb-a5b0-4d11-821f-fc47666cb530 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:24.869089 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7ec8e4-7840-4540-9f6a-5cab14d2bbd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:24.869816 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6fbcb-a5b0-4d11-821f-fc47666cb530 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:24.870209 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6fbcb-a5b0-4d11-821f-fc47666cb530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:24.871795 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7ec8e4-7840-4540-9f6a-5cab14d2bbd6 service nova] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:24.881866 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 688/1375] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:24:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:24:24.888824 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-d4a6fbcb-a5b0-4d11-821f-fc47666cb530 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:24.889999 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-d4a6fbcb-a5b0-4d11-821f-fc47666cb530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:24.899216 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 688/1376] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:24:25.199446 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626fc87-5a32-4655-a7e8-34c6c73808f8 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:25.199446 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626fc87-5a32-4655-a7e8-34c6c73808f8 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:25.199446 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626fc87-5a32-4655-a7e8-34c6c73808f8 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:25.202647 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 689/1377] 10.222.0.21 () {54 vars in 963 bytes} [Mon Feb 28 10:24:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:25.206007 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4f0e0-d82c-4ac9-8bd4-c7cfbaaf86b8 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:25.206007 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4f0e0-d82c-4ac9-8bd4-c7cfbaaf86b8 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:25.206373 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4f0e0-d82c-4ac9-8bd4-c7cfbaaf86b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:25.256309 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-e1b4f0e0-d82c-4ac9-8bd4-c7cfbaaf86b8 None None] MFA Rules not processed for user `b2e92304833d47828c52ae737f6b96cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:25.257636 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-e1b4f0e0-d82c-4ac9-8bd4-c7cfbaaf86b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:25.317446 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 689/1378] 10.222.0.21 () {58 vars in 1060 bytes} [Mon Feb 28 10:24:25 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:24:25.325690 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626fc87-5a32-4655-a7e8-34c6c73808f8 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:25.337364 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626fc87-5a32-4655-a7e8-34c6c73808f8 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:25.340964 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c5fef-f72a-43f2-a9d7-2a137449ebf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:25.341605 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c5fef-f72a-43f2-a9d7-2a137449ebf0 service cinder] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:25.341914 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c5fef-f72a-43f2-a9d7-2a137449ebf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:25.342298 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c5fef-f72a-43f2-a9d7-2a137449ebf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:25.351703 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28c5fef-f72a-43f2-a9d7-2a137449ebf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:25.353236 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28c5fef-f72a-43f2-a9d7-2a137449ebf0 service cinder] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:25.365582 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 690/1379] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:24:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:24:27.378023 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0c88f-8fd1-4c3e-9557-4286cf7fc2ec None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:27.378649 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0c88f-8fd1-4c3e-9557-4286cf7fc2ec None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:27.378649 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0c88f-8fd1-4c3e-9557-4286cf7fc2ec None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:27.380487 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 690/1380] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:24:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:27.387195 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41143dc8-07da-4667-abda-f9ca2b21961e None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:27.387723 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41143dc8-07da-4667-abda-f9ca2b21961e None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:27.387723 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41143dc8-07da-4667-abda-f9ca2b21961e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:27.406947 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-41143dc8-07da-4667-abda-f9ca2b21961e None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:27.408185 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-41143dc8-07da-4667-abda-f9ca2b21961e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:27.416773 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 691/1381] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:24:27.462026 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0c88f-8fd1-4c3e-9557-4286cf7fc2ec None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:27.477050 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0c88f-8fd1-4c3e-9557-4286cf7fc2ec None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:27.483670 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f60d4-67ed-4d38-9ef9-6bf873a44b5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec202a34db8e47f4a6c18285245e3f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:27.484531 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f60d4-67ed-4d38-9ef9-6bf873a44b5b service nova] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:27.484840 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f60d4-67ed-4d38-9ef9-6bf873a44b5b service nova] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:27.485115 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f60d4-67ed-4d38-9ef9-6bf873a44b5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:27.493875 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f60d4-67ed-4d38-9ef9-6bf873a44b5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:27.496200 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f60d4-67ed-4d38-9ef9-6bf873a44b5b service nova] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:27.505783 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 691/1382] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:24:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:24:29.871061 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3c22c-f5e7-49f1-aed9-9c98fc26671a None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:29.871612 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3c22c-f5e7-49f1-aed9-9c98fc26671a None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:29.871838 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3c22c-f5e7-49f1-aed9-9c98fc26671a None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:29.873733 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 692/1383] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:24:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:29.879160 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7b2b4-1b69-4bc3-ba71-fcb3e066e1e1 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:29.879586 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7b2b4-1b69-4bc3-ba71-fcb3e066e1e1 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:29.879703 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7b2b4-1b69-4bc3-ba71-fcb3e066e1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:29.898239 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-ded7b2b4-1b69-4bc3-ba71-fcb3e066e1e1 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:29.899448 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-ded7b2b4-1b69-4bc3-ba71-fcb3e066e1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:29.908332 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 692/1384] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:24:29.952342 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3c22c-f5e7-49f1-aed9-9c98fc26671a None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:29.967963 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3c22c-f5e7-49f1-aed9-9c98fc26671a None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:29.973327 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e06016e-0622-4244-9b24-77bbc97789d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec202a34db8e47f4a6c18285245e3f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:29.974070 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e06016e-0622-4244-9b24-77bbc97789d3 service nova] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:29.974449 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e06016e-0622-4244-9b24-77bbc97789d3 service nova] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:29.974842 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e06016e-0622-4244-9b24-77bbc97789d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:29.987829 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e06016e-0622-4244-9b24-77bbc97789d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:29.989492 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e06016e-0622-4244-9b24-77bbc97789d3 service nova] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:30.000115 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 693/1385] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:24:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:24:32.356952 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3c94d-e592-49c1-a02d-996df8f4667f None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:32.357529 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3c94d-e592-49c1-a02d-996df8f4667f None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:32.357529 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3c94d-e592-49c1-a02d-996df8f4667f None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:32.359262 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 693/1386] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:32.364645 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74866e92-42f3-4a24-8a69-50ccb3449454 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:32.365076 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74866e92-42f3-4a24-8a69-50ccb3449454 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:32.365485 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74866e92-42f3-4a24-8a69-50ccb3449454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:32.384230 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-74866e92-42f3-4a24-8a69-50ccb3449454 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:32.385813 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-74866e92-42f3-4a24-8a69-50ccb3449454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:32.394069 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 694/1387] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:24:32.436482 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3c94d-e592-49c1-a02d-996df8f4667f None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:32.451421 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3c94d-e592-49c1-a02d-996df8f4667f None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:32.456886 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b19c90-eefd-444c-af12-5e4917ee4868 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec202a34db8e47f4a6c18285245e3f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:32.457802 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b19c90-eefd-444c-af12-5e4917ee4868 service nova] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:32.458281 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b19c90-eefd-444c-af12-5e4917ee4868 service nova] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:32.458773 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b19c90-eefd-444c-af12-5e4917ee4868 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:32.467677 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b19c90-eefd-444c-af12-5e4917ee4868 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:32.469237 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b19c90-eefd-444c-af12-5e4917ee4868 service nova] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:32.479576 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 694/1388] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:24:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:24:34.791372 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7762c4-7b2b-40d2-a46a-c4a3801e7e3f None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:34.791926 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7762c4-7b2b-40d2-a46a-c4a3801e7e3f None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:34.791926 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7762c4-7b2b-40d2-a46a-c4a3801e7e3f None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:34.793698 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 695/1389] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:24:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:34.799336 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef0e97-0432-4b71-94f7-8169a817c4f7 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:34.799750 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef0e97-0432-4b71-94f7-8169a817c4f7 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:34.799886 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef0e97-0432-4b71-94f7-8169a817c4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:34.817867 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-8cef0e97-0432-4b71-94f7-8169a817c4f7 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:34.819074 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-8cef0e97-0432-4b71-94f7-8169a817c4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:34.828090 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 695/1390] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:24:34.874083 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7762c4-7b2b-40d2-a46a-c4a3801e7e3f None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:34.888300 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7762c4-7b2b-40d2-a46a-c4a3801e7e3f None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:34.893679 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8c194-4b0b-43cf-b14a-14744d964c20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec202a34db8e47f4a6c18285245e3f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:34.894307 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8c194-4b0b-43cf-b14a-14744d964c20 service nova] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:34.894588 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8c194-4b0b-43cf-b14a-14744d964c20 service nova] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:34.894888 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8c194-4b0b-43cf-b14a-14744d964c20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:34.902947 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa8c194-4b0b-43cf-b14a-14744d964c20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:34.904517 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa8c194-4b0b-43cf-b14a-14744d964c20 service nova] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:34.913890 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 696/1391] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:24:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:24:37.549610 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc879067-1ffa-4845-b6ef-62227309a33e None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:37.550160 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc879067-1ffa-4845-b6ef-62227309a33e None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:37.550160 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc879067-1ffa-4845-b6ef-62227309a33e None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:37.552014 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 696/1392] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:24:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:37.557806 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3a04c-a0ba-49e0-8168-284fbd227afc None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:37.558326 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3a04c-a0ba-49e0-8168-284fbd227afc None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:37.558326 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3a04c-a0ba-49e0-8168-284fbd227afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:37.576898 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-a3c3a04c-a0ba-49e0-8168-284fbd227afc None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:37.578084 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-a3c3a04c-a0ba-49e0-8168-284fbd227afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:37.586208 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 697/1393] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:24:37.630750 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc879067-1ffa-4845-b6ef-62227309a33e None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:37.647831 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc879067-1ffa-4845-b6ef-62227309a33e None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:37.653925 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534829d1-9e71-474f-9cab-cd9b3e9b36de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec202a34db8e47f4a6c18285245e3f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:37.654799 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534829d1-9e71-474f-9cab-cd9b3e9b36de service nova] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:37.655086 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534829d1-9e71-474f-9cab-cd9b3e9b36de service nova] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:37.655432 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534829d1-9e71-474f-9cab-cd9b3e9b36de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:37.665066 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534829d1-9e71-474f-9cab-cd9b3e9b36de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:37.667221 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534829d1-9e71-474f-9cab-cd9b3e9b36de service nova] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:37.678258 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 697/1394] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:24:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:24:40.168543 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b22de2-9bfc-497a-a3bd-9748780ef3e2 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:40.169065 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b22de2-9bfc-497a-a3bd-9748780ef3e2 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:40.169163 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b22de2-9bfc-497a-a3bd-9748780ef3e2 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:40.171346 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 698/1395] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:24:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:40.177045 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26ec50-fc7a-4b7a-994a-2aa5ce6d8340 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:40.177486 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26ec50-fc7a-4b7a-994a-2aa5ce6d8340 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:40.177669 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26ec50-fc7a-4b7a-994a-2aa5ce6d8340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:40.198654 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-9d26ec50-fc7a-4b7a-994a-2aa5ce6d8340 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:40.200334 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-9d26ec50-fc7a-4b7a-994a-2aa5ce6d8340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:40.209733 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 698/1396] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:24:40.266547 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b22de2-9bfc-497a-a3bd-9748780ef3e2 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:40.281230 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b22de2-9bfc-497a-a3bd-9748780ef3e2 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:40.287069 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a3d20-f90f-4d8d-b842-c169adbe757e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec202a34db8e47f4a6c18285245e3f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:40.287766 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a3d20-f90f-4d8d-b842-c169adbe757e service nova] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:40.288069 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a3d20-f90f-4d8d-b842-c169adbe757e service nova] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:40.288332 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a3d20-f90f-4d8d-b842-c169adbe757e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:40.298024 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a3d20-f90f-4d8d-b842-c169adbe757e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:40.300050 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a3d20-f90f-4d8d-b842-c169adbe757e service nova] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:40.309789 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 699/1397] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:24:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:24:42.743435 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba949e-484b-46ba-a4fb-c148aef94956 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:42.744013 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba949e-484b-46ba-a4fb-c148aef94956 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:42.744220 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba949e-484b-46ba-a4fb-c148aef94956 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:42.746026 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 699/1398] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:24:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:42.751918 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9944c77-366b-48c3-bd74-0a6ffbc7d57f None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:42.752347 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9944c77-366b-48c3-bd74-0a6ffbc7d57f None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:42.752622 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9944c77-366b-48c3-bd74-0a6ffbc7d57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:42.771777 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-f9944c77-366b-48c3-bd74-0a6ffbc7d57f None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:42.772990 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-f9944c77-366b-48c3-bd74-0a6ffbc7d57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:42.781373 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 700/1399] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:24:42.826782 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba949e-484b-46ba-a4fb-c148aef94956 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:42.844599 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba949e-484b-46ba-a4fb-c148aef94956 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:42.852754 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d5737-5d93-4222-b035-9545fcab1dc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec202a34db8e47f4a6c18285245e3f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:42.853380 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d5737-5d93-4222-b035-9545fcab1dc1 service nova] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:42.853661 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d5737-5d93-4222-b035-9545fcab1dc1 service nova] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:42.853935 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d5737-5d93-4222-b035-9545fcab1dc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:42.862685 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d5737-5d93-4222-b035-9545fcab1dc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:42.864243 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d5737-5d93-4222-b035-9545fcab1dc1 service nova] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:42.874635 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 700/1400] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:24:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:24:45.337078 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6411c0f-b7f1-42a6-8f16-9665b53aabc1 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:45.337078 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6411c0f-b7f1-42a6-8f16-9665b53aabc1 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:45.337778 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6411c0f-b7f1-42a6-8f16-9665b53aabc1 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:45.339346 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 701/1401] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:24:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:45.344715 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a157282-27a7-40dd-8619-af3c3708f158 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:45.345200 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a157282-27a7-40dd-8619-af3c3708f158 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:45.345398 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a157282-27a7-40dd-8619-af3c3708f158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:45.363827 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-7a157282-27a7-40dd-8619-af3c3708f158 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:45.365025 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-7a157282-27a7-40dd-8619-af3c3708f158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:45.373776 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 701/1402] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:24:45.419132 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6411c0f-b7f1-42a6-8f16-9665b53aabc1 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:45.433824 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6411c0f-b7f1-42a6-8f16-9665b53aabc1 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:45.439319 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce678e8-8959-4f8d-958c-10d6244187e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec202a34db8e47f4a6c18285245e3f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:45.439951 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce678e8-8959-4f8d-958c-10d6244187e4 service nova] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:45.440232 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce678e8-8959-4f8d-958c-10d6244187e4 service nova] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:45.440509 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce678e8-8959-4f8d-958c-10d6244187e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:45.448832 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce678e8-8959-4f8d-958c-10d6244187e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:45.450410 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce678e8-8959-4f8d-958c-10d6244187e4 service nova] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:45.459973 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 702/1403] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:24:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:24:46.193752 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62810f16-e183-41e2-9996-f72f339b0318 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:46.193964 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62810f16-e183-41e2-9996-f72f339b0318 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:46.194222 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62810f16-e183-41e2-9996-f72f339b0318 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:46.196643 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 702/1404] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:24:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:46.201958 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5fafe-9592-4ac6-8906-b6e54cbac592 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:46.202249 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5fafe-9592-4ac6-8906-b6e54cbac592 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:46.202696 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5fafe-9592-4ac6-8906-b6e54cbac592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:46.221067 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-49e5fafe-9592-4ac6-8906-b6e54cbac592 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:46.222298 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-49e5fafe-9592-4ac6-8906-b6e54cbac592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:46.230085 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 703/1405] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:24:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:24:46.287626 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa40ea6-247a-4acb-847f-f5a1b084140b None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:46.287936 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa40ea6-247a-4acb-847f-f5a1b084140b None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:46.288207 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa40ea6-247a-4acb-847f-f5a1b084140b None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:46.290184 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 703/1406] 10.222.0.21 () {54 vars in 962 bytes} [Mon Feb 28 10:24:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:46.295001 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83221690-c6f6-413c-92b5-6bd884bdd4d4 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:46.295293 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83221690-c6f6-413c-92b5-6bd884bdd4d4 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:46.295573 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83221690-c6f6-413c-92b5-6bd884bdd4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:46.343009 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-83221690-c6f6-413c-92b5-6bd884bdd4d4 None None] MFA Rules not processed for user `d99b63b9b6e44219921569db1bf2e0dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:46.344191 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-83221690-c6f6-413c-92b5-6bd884bdd4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:46.401466 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 704/1407] 10.222.0.21 () {58 vars in 1059 bytes} [Mon Feb 28 10:24:46 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:24:46.409010 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa40ea6-247a-4acb-847f-f5a1b084140b None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:46.419643 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa40ea6-247a-4acb-847f-f5a1b084140b None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:46.423165 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e82e16-468e-4617-96a2-255a014c8d28 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99b63b9b6e44219921569db1bf2e0dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:46.423807 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e82e16-468e-4617-96a2-255a014c8d28 service glance] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:46.424087 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e82e16-468e-4617-96a2-255a014c8d28 service glance] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:46.424359 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e82e16-468e-4617-96a2-255a014c8d28 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:46.433565 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e82e16-468e-4617-96a2-255a014c8d28 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:46.435025 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e82e16-468e-4617-96a2-255a014c8d28 service glance] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:46.444122 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 704/1408] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:24:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:24:46.855234 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04b1c2-2988-40c3-a124-89c0f504dbcb None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:46.855524 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04b1c2-2988-40c3-a124-89c0f504dbcb None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:46.855802 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04b1c2-2988-40c3-a124-89c0f504dbcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:46.903396 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-4c04b1c2-2988-40c3-a124-89c0f504dbcb None None] MFA Rules not processed for user `1c1284bfe6cc43848731ed2b3d9e914b`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:46.904577 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-4c04b1c2-2988-40c3-a124-89c0f504dbcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:46.966314 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 705/1409] 10.222.0.21 () {58 vars in 1009 bytes} [Mon Feb 28 10:24:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:24:47.006677 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb591a-2462-4b4d-90ef-49866d197363 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:47.006914 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb591a-2462-4b4d-90ef-49866d197363 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:47.007193 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb591a-2462-4b4d-90ef-49866d197363 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:47.009704 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 705/1410] 10.222.0.21 () {54 vars in 942 bytes} [Mon Feb 28 10:24:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:24:47.015805 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21dedc-972b-410c-ab35-e2a2a515087b None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:47.016093 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21dedc-972b-410c-ab35-e2a2a515087b None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:47.016367 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21dedc-972b-410c-ab35-e2a2a515087b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:47.065910 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-8e21dedc-972b-410c-ab35-e2a2a515087b None None] MFA Rules not processed for user `8696fe8a37aa4d73a62bdc2efd35a23d`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:24:47.067136 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-8e21dedc-972b-410c-ab35-e2a2a515087b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:24:47.137032 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 706/1411] 10.222.0.21 () {58 vars in 1039 bytes} [Mon Feb 28 10:24:47 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:24:47.146486 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb591a-2462-4b4d-90ef-49866d197363 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:24:47.160256 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb591a-2462-4b4d-90ef-49866d197363 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:24:47.165235 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a58625-e2fc-479a-a7b6-92de982db1f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8696fe8a37aa4d73a62bdc2efd35a23d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:24:47.165857 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a58625-e2fc-479a-a7b6-92de982db1f0 service swift] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:24:47.166139 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a58625-e2fc-479a-a7b6-92de982db1f0 service swift] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:24:47.166412 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a58625-e2fc-479a-a7b6-92de982db1f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:24:47.174254 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a58625-e2fc-479a-a7b6-92de982db1f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:24:47.175873 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a58625-e2fc-479a-a7b6-92de982db1f0 service swift] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:24:47.184222 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 706/1412] 10.222.0.21 () {60 vars in 1384 bytes} [Mon Feb 28 10:24:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 10:25:10.188093 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fec4c9-01ed-4fa4-92a0-60f1f1103197 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:10.188678 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fec4c9-01ed-4fa4-92a0-60f1f1103197 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:10.188678 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fec4c9-01ed-4fa4-92a0-60f1f1103197 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:10.190357 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 707/1413] 10.222.0.21 () {54 vars in 918 bytes} [Mon Feb 28 10:25:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:10.196100 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ccdcb-43c0-4f30-8f0a-82dbff61d2d1 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:10.196572 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ccdcb-43c0-4f30-8f0a-82dbff61d2d1 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:10.196687 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ccdcb-43c0-4f30-8f0a-82dbff61d2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:10.215060 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-ed2ccdcb-43c0-4f30-8f0a-82dbff61d2d1 None None] MFA Rules not processed for user `1b2346e4de5d45a79d4bb2abb01d4827`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:10.216241 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-ed2ccdcb-43c0-4f30-8f0a-82dbff61d2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:10.224478 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 707/1414] 10.222.0.21 () {58 vars in 1015 bytes} [Mon Feb 28 10:25:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:25:10.239070 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3bb53-87fa-4d76-98dd-e4ad7883ceff None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:10.239342 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3bb53-87fa-4d76-98dd-e4ad7883ceff None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:10.239630 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3bb53-87fa-4d76-98dd-e4ad7883ceff None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:10.241475 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 708/1415] 10.222.0.21 () {54 vars in 918 bytes} [Mon Feb 28 10:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:10.246071 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d426c3-d19d-4057-8628-b983d8b90d4c None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:10.246349 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d426c3-d19d-4057-8628-b983d8b90d4c None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:10.246638 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d426c3-d19d-4057-8628-b983d8b90d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:10.264616 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-26d426c3-d19d-4057-8628-b983d8b90d4c None None] MFA Rules not processed for user `ec202a34db8e47f4a6c18285245e3f5b`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:10.265775 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-26d426c3-d19d-4057-8628-b983d8b90d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:10.275209 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 708/1416] 10.222.0.21 () {58 vars in 1015 bytes} [Mon Feb 28 10:25:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:25:13.026254 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26afdf-1e09-4773-97bd-3bb2ba4d9d70 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:13.026803 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26afdf-1e09-4773-97bd-3bb2ba4d9d70 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:13.026803 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26afdf-1e09-4773-97bd-3bb2ba4d9d70 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:13.028545 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 709/1417] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 10:25:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:13.033840 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad55d71-2f9f-4d02-9d94-2ab1123e6aac None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:13.034304 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad55d71-2f9f-4d02-9d94-2ab1123e6aac None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:13.034413 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad55d71-2f9f-4d02-9d94-2ab1123e6aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:13.052717 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-9ad55d71-2f9f-4d02-9d94-2ab1123e6aac None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:13.053913 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-9ad55d71-2f9f-4d02-9d94-2ab1123e6aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:13.061744 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 709/1418] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 10:25:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:25:13.104286 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26afdf-1e09-4773-97bd-3bb2ba4d9d70 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:13.119134 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26afdf-1e09-4773-97bd-3bb2ba4d9d70 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:13.124384 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc4be0-a4d1-4f68-b7f1-48285160288c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec202a34db8e47f4a6c18285245e3f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:13.125005 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc4be0-a4d1-4f68-b7f1-48285160288c service nova] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:13.125283 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc4be0-a4d1-4f68-b7f1-48285160288c service nova] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:13.125555 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc4be0-a4d1-4f68-b7f1-48285160288c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:13.133773 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebc4be0-a4d1-4f68-b7f1-48285160288c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:13.135369 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebc4be0-a4d1-4f68-b7f1-48285160288c service nova] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:13.144594 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 710/1419] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:25:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:25:14.528530 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f64b4-d6e3-402d-a41c-56496d581cec None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:14.529192 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f64b4-d6e3-402d-a41c-56496d581cec None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:14.529192 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f64b4-d6e3-402d-a41c-56496d581cec None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:14.530887 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 710/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 10:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:14.535971 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9472ddd-1e01-43b7-b633-7a19b9757e91 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:14.536400 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9472ddd-1e01-43b7-b633-7a19b9757e91 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:14.536506 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9472ddd-1e01-43b7-b633-7a19b9757e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:14.554722 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-f9472ddd-1e01-43b7-b633-7a19b9757e91 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:14.555940 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-f9472ddd-1e01-43b7-b633-7a19b9757e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:14.563630 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 711/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 10:25:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:25:14.723163 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f64b4-d6e3-402d-a41c-56496d581cec None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:14.737177 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f64b4-d6e3-402d-a41c-56496d581cec None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:14.742541 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b260b9-6200-45b0-ba49-550d73894182 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec202a34db8e47f4a6c18285245e3f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:14.743192 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b260b9-6200-45b0-ba49-550d73894182 service nova] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:14.743469 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b260b9-6200-45b0-ba49-550d73894182 service nova] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:14.743741 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b260b9-6200-45b0-ba49-550d73894182 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:14.751527 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b260b9-6200-45b0-ba49-550d73894182 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:14.753094 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b260b9-6200-45b0-ba49-550d73894182 service nova] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:14.762744 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 711/1422] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:25:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:25:16.076828 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b79867-31a1-401e-8d59-216dd342bc82 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:16.077404 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b79867-31a1-401e-8d59-216dd342bc82 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:16.077404 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b79867-31a1-401e-8d59-216dd342bc82 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:16.079221 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 712/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 10:25:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:16.085179 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70f591-7809-49a0-90d5-e6e6d0a4a00b None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:16.085957 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70f591-7809-49a0-90d5-e6e6d0a4a00b None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:16.086235 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70f591-7809-49a0-90d5-e6e6d0a4a00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:16.104075 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-2b70f591-7809-49a0-90d5-e6e6d0a4a00b None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:16.105187 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-2b70f591-7809-49a0-90d5-e6e6d0a4a00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:16.113026 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 712/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 10:25:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:25:16.267802 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b79867-31a1-401e-8d59-216dd342bc82 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:16.282114 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b79867-31a1-401e-8d59-216dd342bc82 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:16.287526 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5cdcc4-19c2-4036-a986-8b88bb5071f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec202a34db8e47f4a6c18285245e3f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:16.288419 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5cdcc4-19c2-4036-a986-8b88bb5071f9 service nova] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:16.288696 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5cdcc4-19c2-4036-a986-8b88bb5071f9 service nova] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:16.288966 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5cdcc4-19c2-4036-a986-8b88bb5071f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:16.296767 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5cdcc4-19c2-4036-a986-8b88bb5071f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:16.298311 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5cdcc4-19c2-4036-a986-8b88bb5071f9 service nova] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:16.307534 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 713/1425] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:25:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:25:17.637003 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcbc524-034e-4b1f-89c9-d4fdc540596a None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:17.637551 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcbc524-034e-4b1f-89c9-d4fdc540596a None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:17.637551 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcbc524-034e-4b1f-89c9-d4fdc540596a None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:17.639350 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 713/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 10:25:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:17.644426 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d81996-e10c-49d8-8e96-f91941116ffd None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:17.644841 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d81996-e10c-49d8-8e96-f91941116ffd None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:17.644985 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d81996-e10c-49d8-8e96-f91941116ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:17.663353 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-32d81996-e10c-49d8-8e96-f91941116ffd None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:17.664549 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-32d81996-e10c-49d8-8e96-f91941116ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:17.672271 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 714/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 10:25:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:25:17.823685 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcbc524-034e-4b1f-89c9-d4fdc540596a None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:17.838696 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcbc524-034e-4b1f-89c9-d4fdc540596a None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:17.843983 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838fb143-b321-4626-adcf-9f7684214316 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec202a34db8e47f4a6c18285245e3f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:17.844605 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838fb143-b321-4626-adcf-9f7684214316 service nova] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:17.844880 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838fb143-b321-4626-adcf-9f7684214316 service nova] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:17.845146 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838fb143-b321-4626-adcf-9f7684214316 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:17.853449 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838fb143-b321-4626-adcf-9f7684214316 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:17.855038 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838fb143-b321-4626-adcf-9f7684214316 service nova] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:17.864077 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 714/1428] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:25:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:25:19.174833 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f8fb9-1809-4a6a-8d39-e87e2cf0ec51 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:19.175373 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f8fb9-1809-4a6a-8d39-e87e2cf0ec51 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:19.175373 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f8fb9-1809-4a6a-8d39-e87e2cf0ec51 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:19.177121 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 715/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 10:25:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:19.182199 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d690e6e-29e2-4b37-9f71-ece8daf05f4c None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:19.182667 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d690e6e-29e2-4b37-9f71-ece8daf05f4c None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:19.182794 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d690e6e-29e2-4b37-9f71-ece8daf05f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:19.201317 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-8d690e6e-29e2-4b37-9f71-ece8daf05f4c None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:19.202502 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-8d690e6e-29e2-4b37-9f71-ece8daf05f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:19.211118 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 715/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 10:25:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:25:19.362999 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f8fb9-1809-4a6a-8d39-e87e2cf0ec51 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:19.376929 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f8fb9-1809-4a6a-8d39-e87e2cf0ec51 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:19.382799 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7203d4b-8c0d-466f-9d66-b9e6c84d5c86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec202a34db8e47f4a6c18285245e3f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:19.383423 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7203d4b-8c0d-466f-9d66-b9e6c84d5c86 service nova] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:19.383702 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7203d4b-8c0d-466f-9d66-b9e6c84d5c86 service nova] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:19.383990 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7203d4b-8c0d-466f-9d66-b9e6c84d5c86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:19.391856 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7203d4b-8c0d-466f-9d66-b9e6c84d5c86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:19.393483 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7203d4b-8c0d-466f-9d66-b9e6c84d5c86 service nova] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:19.403482 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 716/1431] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:25:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:25:20.687702 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a71cb-011e-4c95-8011-40147c5719d3 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:20.688170 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a71cb-011e-4c95-8011-40147c5719d3 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:20.688281 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a71cb-011e-4c95-8011-40147c5719d3 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:20.690037 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 716/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 10:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:20.694981 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065802d-e448-470e-a8a3-5434242ba236 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:20.695398 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065802d-e448-470e-a8a3-5434242ba236 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:20.695534 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065802d-e448-470e-a8a3-5434242ba236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:20.713342 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-a065802d-e448-470e-a8a3-5434242ba236 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:20.714487 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-a065802d-e448-470e-a8a3-5434242ba236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:20.722228 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 717/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 10:25:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:25:20.875147 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a71cb-011e-4c95-8011-40147c5719d3 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:20.889364 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a71cb-011e-4c95-8011-40147c5719d3 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:20.894712 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde46ced-d109-495b-a438-d6bc03d2a1bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec202a34db8e47f4a6c18285245e3f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:20.895282 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde46ced-d109-495b-a438-d6bc03d2a1bd service nova] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:20.895561 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde46ced-d109-495b-a438-d6bc03d2a1bd service nova] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:20.895832 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde46ced-d109-495b-a438-d6bc03d2a1bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:20.904676 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde46ced-d109-495b-a438-d6bc03d2a1bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:20.906228 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde46ced-d109-495b-a438-d6bc03d2a1bd service nova] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:20.916059 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 717/1434] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:25:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:25:22.178181 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f651c91-48c1-4835-87fd-540106a2f35f None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:22.178749 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f651c91-48c1-4835-87fd-540106a2f35f None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:22.178749 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f651c91-48c1-4835-87fd-540106a2f35f None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:22.180509 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 718/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 10:25:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:22.185486 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174a431-829b-49b2-ad9d-e1a9abed4d95 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:22.185917 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174a431-829b-49b2-ad9d-e1a9abed4d95 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:22.186017 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174a431-829b-49b2-ad9d-e1a9abed4d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:22.204279 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-1174a431-829b-49b2-ad9d-e1a9abed4d95 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:22.205480 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-1174a431-829b-49b2-ad9d-e1a9abed4d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:22.214129 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 718/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 10:25:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:25:22.367355 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f651c91-48c1-4835-87fd-540106a2f35f None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:22.381939 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f651c91-48c1-4835-87fd-540106a2f35f None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:22.387296 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4f879-c7be-4922-8aaa-49bfa41415b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec202a34db8e47f4a6c18285245e3f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:22.387921 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4f879-c7be-4922-8aaa-49bfa41415b5 service nova] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:22.388199 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4f879-c7be-4922-8aaa-49bfa41415b5 service nova] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:22.388469 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4f879-c7be-4922-8aaa-49bfa41415b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:22.396293 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4f879-c7be-4922-8aaa-49bfa41415b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:22.398545 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4f879-c7be-4922-8aaa-49bfa41415b5 service nova] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:22.407583 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 719/1437] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:25:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:25:23.676052 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8fa5e-54d8-43b0-a6a0-cd19b8d8ffb0 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:23.676617 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8fa5e-54d8-43b0-a6a0-cd19b8d8ffb0 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:23.676617 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8fa5e-54d8-43b0-a6a0-cd19b8d8ffb0 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:23.678619 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 719/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 10:25:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:23.683666 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae2b9d-18c0-4f1d-a74c-3a109880f21f None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:23.684103 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae2b9d-18c0-4f1d-a74c-3a109880f21f None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:23.684212 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae2b9d-18c0-4f1d-a74c-3a109880f21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:23.702368 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-c9ae2b9d-18c0-4f1d-a74c-3a109880f21f None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:23.703605 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-c9ae2b9d-18c0-4f1d-a74c-3a109880f21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:23.712395 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 720/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 10:25:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:25:23.862763 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c8fa5e-54d8-43b0-a6a0-cd19b8d8ffb0 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:23.876761 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c8fa5e-54d8-43b0-a6a0-cd19b8d8ffb0 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:23.882786 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6acd32-070b-47cb-b6b4-8876b7d430ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec202a34db8e47f4a6c18285245e3f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:23.883409 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6acd32-070b-47cb-b6b4-8876b7d430ed service nova] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:23.883680 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6acd32-070b-47cb-b6b4-8876b7d430ed service nova] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:23.883956 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6acd32-070b-47cb-b6b4-8876b7d430ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:23.891810 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6acd32-070b-47cb-b6b4-8876b7d430ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:23.893373 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6acd32-070b-47cb-b6b4-8876b7d430ed service nova] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:23.902954 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 720/1440] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:25:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:25:25.181806 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77718514-3f1f-446c-9093-fe94cc6560d9 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:25.182392 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77718514-3f1f-446c-9093-fe94cc6560d9 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:25.182392 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77718514-3f1f-446c-9093-fe94cc6560d9 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:25.184189 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 721/1441] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 10:25:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:25.189068 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034629a8-05fa-42f7-877e-a051dc3f4142 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:25.189474 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034629a8-05fa-42f7-877e-a051dc3f4142 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:25.189621 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034629a8-05fa-42f7-877e-a051dc3f4142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:25.208113 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-034629a8-05fa-42f7-877e-a051dc3f4142 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:25.209974 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-034629a8-05fa-42f7-877e-a051dc3f4142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:25.217737 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 721/1442] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 10:25:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:25:25.370151 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77718514-3f1f-446c-9093-fe94cc6560d9 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:25.384923 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77718514-3f1f-446c-9093-fe94cc6560d9 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:25.390169 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b1ae17-a6d8-40ab-88f0-f4135e4c87d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec202a34db8e47f4a6c18285245e3f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:25.390825 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1ae17-a6d8-40ab-88f0-f4135e4c87d7 service nova] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:25.391104 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1ae17-a6d8-40ab-88f0-f4135e4c87d7 service nova] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:25.391380 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1ae17-a6d8-40ab-88f0-f4135e4c87d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:25.400128 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b1ae17-a6d8-40ab-88f0-f4135e4c87d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:25.401675 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b1ae17-a6d8-40ab-88f0-f4135e4c87d7 service nova] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:25.410692 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 722/1443] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:25:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:25:27.663170 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821656c-8a6a-41fd-a219-864880238bec None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:27.663745 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821656c-8a6a-41fd-a219-864880238bec None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:27.663868 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821656c-8a6a-41fd-a219-864880238bec None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:27.666135 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 722/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 10:25:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:27.671543 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968d196-a755-4cb6-8473-9d2f638b824f None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:27.672007 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968d196-a755-4cb6-8473-9d2f638b824f None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:27.672102 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968d196-a755-4cb6-8473-9d2f638b824f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:27.690331 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-0968d196-a755-4cb6-8473-9d2f638b824f None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:27.691585 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-0968d196-a755-4cb6-8473-9d2f638b824f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:27.700156 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 723/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 10:25:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:25:27.739014 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8821656c-8a6a-41fd-a219-864880238bec None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:27.751002 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8821656c-8a6a-41fd-a219-864880238bec None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:27.754469 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a77139-61cf-40e4-9ecd-693a50ce4f95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:27.755128 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a77139-61cf-40e4-9ecd-693a50ce4f95 service neutron] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:27.755402 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a77139-61cf-40e4-9ecd-693a50ce4f95 service neutron] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:27.756800 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a77139-61cf-40e4-9ecd-693a50ce4f95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:27.766422 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a77139-61cf-40e4-9ecd-693a50ce4f95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:27.767875 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a77139-61cf-40e4-9ecd-693a50ce4f95 service neutron] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:27.777324 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 723/1446] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:25:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:25:30.292213 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68528a7b-2211-49ff-ba3f-d1db80ee0860 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:30.292762 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68528a7b-2211-49ff-ba3f-d1db80ee0860 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:30.292762 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68528a7b-2211-49ff-ba3f-d1db80ee0860 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:30.294559 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 724/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 10:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:30.299738 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da305bdf-96cc-4bc7-ba0c-20f113fa0261 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:30.300174 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da305bdf-96cc-4bc7-ba0c-20f113fa0261 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:30.300324 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da305bdf-96cc-4bc7-ba0c-20f113fa0261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:30.319287 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-da305bdf-96cc-4bc7-ba0c-20f113fa0261 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:30.320477 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-da305bdf-96cc-4bc7-ba0c-20f113fa0261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:30.328964 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 724/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 10:25:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:25:30.374905 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68528a7b-2211-49ff-ba3f-d1db80ee0860 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:30.386142 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68528a7b-2211-49ff-ba3f-d1db80ee0860 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:30.389623 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b40b4-eabb-44de-a116-8ad7c963b0f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:30.390249 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b40b4-eabb-44de-a116-8ad7c963b0f9 service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:30.390529 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b40b4-eabb-44de-a116-8ad7c963b0f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:30.390835 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b40b4-eabb-44de-a116-8ad7c963b0f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:30.400046 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b40b4-eabb-44de-a116-8ad7c963b0f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:30.401458 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b40b4-eabb-44de-a116-8ad7c963b0f9 service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:30.410604 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 725/1449] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:25:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:25:33.035846 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41141f6-dd94-4340-bf38-618b9393e20d None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:33.036374 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41141f6-dd94-4340-bf38-618b9393e20d None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:33.036374 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41141f6-dd94-4340-bf38-618b9393e20d None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:33.038725 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 725/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 10:25:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:25:33.044113 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e062e-ebaa-454b-a913-f35c030faa08 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:33.044542 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e062e-ebaa-454b-a913-f35c030faa08 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:33.044667 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e062e-ebaa-454b-a913-f35c030faa08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:33.062395 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-843e062e-ebaa-454b-a913-f35c030faa08 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:33.063627 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-843e062e-ebaa-454b-a913-f35c030faa08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:33.071484 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 726/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 10:25:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:25:33.110537 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41141f6-dd94-4340-bf38-618b9393e20d None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:33.121003 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41141f6-dd94-4340-bf38-618b9393e20d None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:33.124442 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd1846b-1f92-4763-9a95-0e748d554213 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:33.125051 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1846b-1f92-4763-9a95-0e748d554213 service neutron] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:33.125324 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1846b-1f92-4763-9a95-0e748d554213 service neutron] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:33.125590 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1846b-1f92-4763-9a95-0e748d554213 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:33.134548 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd1846b-1f92-4763-9a95-0e748d554213 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:33.136156 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd1846b-1f92-4763-9a95-0e748d554213 service neutron] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:33.145556 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 726/1452] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:25:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:25:35.585651 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfaf442-05e5-4435-b934-8c39801f4e3a None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:35.586196 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfaf442-05e5-4435-b934-8c39801f4e3a None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:35.586196 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfaf442-05e5-4435-b934-8c39801f4e3a None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:35.588061 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 727/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 10:25:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:35.593306 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e35592-7448-456d-b35e-b5bd148c3517 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:35.593697 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e35592-7448-456d-b35e-b5bd148c3517 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:35.593845 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e35592-7448-456d-b35e-b5bd148c3517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:35.611710 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-c8e35592-7448-456d-b35e-b5bd148c3517 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:35.612895 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-c8e35592-7448-456d-b35e-b5bd148c3517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:35.621036 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 727/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 10:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:25:35.658245 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfaf442-05e5-4435-b934-8c39801f4e3a None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:35.669295 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfaf442-05e5-4435-b934-8c39801f4e3a None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:35.672744 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d0e45-dc6b-4ba0-a7cd-890664ada05b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:35.673363 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d0e45-dc6b-4ba0-a7cd-890664ada05b service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:35.673642 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d0e45-dc6b-4ba0-a7cd-890664ada05b service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:35.673912 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d0e45-dc6b-4ba0-a7cd-890664ada05b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:35.683419 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d0e45-dc6b-4ba0-a7cd-890664ada05b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:35.684821 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d0e45-dc6b-4ba0-a7cd-890664ada05b service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:35.693993 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 728/1455] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:25:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:25:38.082311 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be3cd4-cbd8-4727-be47-6b205e22c23c None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:38.082876 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be3cd4-cbd8-4727-be47-6b205e22c23c None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:38.082876 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be3cd4-cbd8-4727-be47-6b205e22c23c None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:38.084695 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 728/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 10:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:38.090117 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea3be4-c0ce-4571-9451-6794b7a1db4c None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:38.090526 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea3be4-c0ce-4571-9451-6794b7a1db4c None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:38.090698 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea3be4-c0ce-4571-9451-6794b7a1db4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:38.110034 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-d4ea3be4-c0ce-4571-9451-6794b7a1db4c None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:38.111187 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-d4ea3be4-c0ce-4571-9451-6794b7a1db4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:38.119464 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 729/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 10:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:25:38.157748 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7be3cd4-cbd8-4727-be47-6b205e22c23c None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:38.169047 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7be3cd4-cbd8-4727-be47-6b205e22c23c None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:38.172486 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c44f76-8441-49e4-b2a9-b34531d864ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:38.173117 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c44f76-8441-49e4-b2a9-b34531d864ba service neutron] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:38.173394 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c44f76-8441-49e4-b2a9-b34531d864ba service neutron] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:38.173663 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c44f76-8441-49e4-b2a9-b34531d864ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:38.182360 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c44f76-8441-49e4-b2a9-b34531d864ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:38.183830 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c44f76-8441-49e4-b2a9-b34531d864ba service neutron] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:38.192882 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 729/1458] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:25:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:25:40.555797 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a8a16-f33e-41f6-825b-10469347ff6f None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:40.556378 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a8a16-f33e-41f6-825b-10469347ff6f None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:40.556378 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a8a16-f33e-41f6-825b-10469347ff6f None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:40.558129 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 730/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 10:25:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:40.563736 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e663322-5c18-4b66-9ea1-278ff78c6791 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:40.564212 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e663322-5c18-4b66-9ea1-278ff78c6791 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:40.564312 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e663322-5c18-4b66-9ea1-278ff78c6791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:40.582722 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-5e663322-5c18-4b66-9ea1-278ff78c6791 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:40.584131 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-5e663322-5c18-4b66-9ea1-278ff78c6791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:40.592103 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 730/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 10:25:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:25:40.630935 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a8a16-f33e-41f6-825b-10469347ff6f None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:40.641163 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a8a16-f33e-41f6-825b-10469347ff6f None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:40.644635 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80c398-ea72-4395-8dbf-d61b7d26475a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:40.645257 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80c398-ea72-4395-8dbf-d61b7d26475a service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:40.645916 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80c398-ea72-4395-8dbf-d61b7d26475a service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:40.645916 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80c398-ea72-4395-8dbf-d61b7d26475a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:40.655001 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b80c398-ea72-4395-8dbf-d61b7d26475a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:40.656946 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b80c398-ea72-4395-8dbf-d61b7d26475a service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:40.665960 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 731/1461] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:25:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:25:43.020878 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca6dd9-42a3-4b37-a9f3-1793487fd853 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:43.021516 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca6dd9-42a3-4b37-a9f3-1793487fd853 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:43.021516 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca6dd9-42a3-4b37-a9f3-1793487fd853 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:43.023144 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 731/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 10:25:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:43.028500 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf63c5-9c3d-4022-9c1c-e1ee928df85c None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:43.028920 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf63c5-9c3d-4022-9c1c-e1ee928df85c None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:43.029040 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf63c5-9c3d-4022-9c1c-e1ee928df85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:43.046864 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-3fdf63c5-9c3d-4022-9c1c-e1ee928df85c None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:43.048038 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-3fdf63c5-9c3d-4022-9c1c-e1ee928df85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:43.056156 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 732/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 10:25:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:25:43.101042 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca6dd9-42a3-4b37-a9f3-1793487fd853 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:43.111471 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca6dd9-42a3-4b37-a9f3-1793487fd853 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:43.115280 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae1a1c8-5850-49c8-b8a5-35f0634126d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:43.115931 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1a1c8-5850-49c8-b8a5-35f0634126d0 service neutron] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:43.116209 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1a1c8-5850-49c8-b8a5-35f0634126d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:43.116481 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1a1c8-5850-49c8-b8a5-35f0634126d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:43.125085 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae1a1c8-5850-49c8-b8a5-35f0634126d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:43.126496 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae1a1c8-5850-49c8-b8a5-35f0634126d0 service neutron] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:43.136084 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 732/1464] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:25:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:25:45.476766 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae06e1-a3c3-4c82-881b-1c264d265c7c None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:45.477443 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae06e1-a3c3-4c82-881b-1c264d265c7c None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:45.477443 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae06e1-a3c3-4c82-881b-1c264d265c7c None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:45.479127 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 733/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 10:25:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:45.484364 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f87646-5420-4d45-994d-77fd4160ac0e None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:45.484784 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f87646-5420-4d45-994d-77fd4160ac0e None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:45.484911 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f87646-5420-4d45-994d-77fd4160ac0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:45.502203 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-47f87646-5420-4d45-994d-77fd4160ac0e None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:45.503407 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-47f87646-5420-4d45-994d-77fd4160ac0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:45.511711 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 733/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 10:25:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:25:45.548602 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae06e1-a3c3-4c82-881b-1c264d265c7c None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:45.559303 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae06e1-a3c3-4c82-881b-1c264d265c7c None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:45.562776 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ea5e9-85d9-413c-8776-6f806b550c5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:45.563393 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ea5e9-85d9-413c-8776-6f806b550c5a service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:45.563669 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ea5e9-85d9-413c-8776-6f806b550c5a service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:45.563937 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ea5e9-85d9-413c-8776-6f806b550c5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:45.573997 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98ea5e9-85d9-413c-8776-6f806b550c5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:45.575884 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98ea5e9-85d9-413c-8776-6f806b550c5a service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:45.585938 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 734/1467] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:25:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:25:47.912191 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824686f-1f1d-4cb6-a6f4-67148785ed79 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:47.912720 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824686f-1f1d-4cb6-a6f4-67148785ed79 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:47.912720 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824686f-1f1d-4cb6-a6f4-67148785ed79 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:47.914500 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 734/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 10:25:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:47.919829 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed0885-0aa6-4e43-863a-901d6bf07e36 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:47.920268 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed0885-0aa6-4e43-863a-901d6bf07e36 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:47.920386 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed0885-0aa6-4e43-863a-901d6bf07e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:47.937979 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-9fed0885-0aa6-4e43-863a-901d6bf07e36 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:47.939182 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-9fed0885-0aa6-4e43-863a-901d6bf07e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:47.946939 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 735/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 10:25:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:25:47.984127 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824686f-1f1d-4cb6-a6f4-67148785ed79 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:47.995029 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824686f-1f1d-4cb6-a6f4-67148785ed79 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:47.998546 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a718c9b2-8f18-40db-91cb-14bb32b64777 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:47.999230 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718c9b2-8f18-40db-91cb-14bb32b64777 service neutron] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:47.999511 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718c9b2-8f18-40db-91cb-14bb32b64777 service neutron] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:47.999785 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718c9b2-8f18-40db-91cb-14bb32b64777 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:48.008733 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a718c9b2-8f18-40db-91cb-14bb32b64777 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:48.010143 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a718c9b2-8f18-40db-91cb-14bb32b64777 service neutron] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:48.019378 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 735/1470] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:25:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:25:50.330911 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae2873-035a-4f57-80bb-963f60bf688f None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:50.331482 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae2873-035a-4f57-80bb-963f60bf688f None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:50.331482 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae2873-035a-4f57-80bb-963f60bf688f None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:50.334266 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 736/1471] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 10:25:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:25:50.339680 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4f6d3-516e-45fb-8d2d-141844ac23f5 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:50.340100 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4f6d3-516e-45fb-8d2d-141844ac23f5 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:50.340215 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4f6d3-516e-45fb-8d2d-141844ac23f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:50.358306 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-e2b4f6d3-516e-45fb-8d2d-141844ac23f5 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:25:50.359559 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-e2b4f6d3-516e-45fb-8d2d-141844ac23f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:25:50.367896 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 736/1472] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 10:25:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:25:50.405533 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae2873-035a-4f57-80bb-963f60bf688f None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:25:50.416775 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae2873-035a-4f57-80bb-963f60bf688f None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:25:50.420374 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c8864-15fb-426f-9551-58773f52e2f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:25:50.421004 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c8864-15fb-426f-9551-58773f52e2f8 service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:25:50.421282 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c8864-15fb-426f-9551-58773f52e2f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:25:50.421555 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c8864-15fb-426f-9551-58773f52e2f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:25:50.430420 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849c8864-15fb-426f-9551-58773f52e2f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:25:50.431865 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849c8864-15fb-426f-9551-58773f52e2f8 service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:25:50.440964 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 737/1473] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:25:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:26:11.134298 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47305e12-655d-4e5a-ac80-c8c0d09a9941 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:11.134982 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47305e12-655d-4e5a-ac80-c8c0d09a9941 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:11.134982 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47305e12-655d-4e5a-ac80-c8c0d09a9941 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:11.136625 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 737/1474] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:26:11.141827 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f650ba-c96e-47b2-9b28-4c2ff84d7672 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:11.142229 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f650ba-c96e-47b2-9b28-4c2ff84d7672 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:11.142379 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f650ba-c96e-47b2-9b28-4c2ff84d7672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:11.160792 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-b2f650ba-c96e-47b2-9b28-4c2ff84d7672 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:26:11.161973 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-b2f650ba-c96e-47b2-9b28-4c2ff84d7672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:26:11.169647 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 738/1475] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:26:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:26:11.217171 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01955008-bd5a-463f-8484-f565721f77ad None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:11.217455 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01955008-bd5a-463f-8484-f565721f77ad None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:11.217727 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01955008-bd5a-463f-8484-f565721f77ad None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:11.219511 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 738/1476] 10.222.0.21 () {54 vars in 962 bytes} [Mon Feb 28 10:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:26:11.224782 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0afe8-7aac-4e13-9c3c-4967f9bcba42 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:11.225066 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0afe8-7aac-4e13-9c3c-4967f9bcba42 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:11.225345 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0afe8-7aac-4e13-9c3c-4967f9bcba42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:11.242979 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-5df0afe8-7aac-4e13-9c3c-4967f9bcba42 None None] MFA Rules not processed for user `d99b63b9b6e44219921569db1bf2e0dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:26:11.244152 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-5df0afe8-7aac-4e13-9c3c-4967f9bcba42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:26:11.250445 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 739/1477] 10.222.0.21 () {58 vars in 1059 bytes} [Mon Feb 28 10:26:11 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:26:11.257412 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01955008-bd5a-463f-8484-f565721f77ad None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:11.268276 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01955008-bd5a-463f-8484-f565721f77ad None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:11.272844 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69faa96e-0369-4e28-ae3e-199fb2273d04 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99b63b9b6e44219921569db1bf2e0dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:11.273460 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69faa96e-0369-4e28-ae3e-199fb2273d04 service glance] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:11.273736 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69faa96e-0369-4e28-ae3e-199fb2273d04 service glance] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:11.274004 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69faa96e-0369-4e28-ae3e-199fb2273d04 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:11.282577 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69faa96e-0369-4e28-ae3e-199fb2273d04 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:11.284008 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69faa96e-0369-4e28-ae3e-199fb2273d04 service glance] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:11.293778 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 739/1478] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:26:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:26:13.678035 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e41b78-b597-4e88-8be3-28b5bf3eb60e None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:13.678656 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e41b78-b597-4e88-8be3-28b5bf3eb60e None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:13.678656 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e41b78-b597-4e88-8be3-28b5bf3eb60e None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:13.680461 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 740/1479] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:26:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:26:13.685770 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb7e7b-956c-4ac9-972c-fe2a17dda5f0 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:13.686198 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb7e7b-956c-4ac9-972c-fe2a17dda5f0 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:13.686313 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb7e7b-956c-4ac9-972c-fe2a17dda5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:13.704482 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-aadb7e7b-956c-4ac9-972c-fe2a17dda5f0 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:26:13.705939 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-aadb7e7b-956c-4ac9-972c-fe2a17dda5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:26:13.713744 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 740/1480] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:26:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:26:13.736735 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e41b78-b597-4e88-8be3-28b5bf3eb60e None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:13.749202 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e41b78-b597-4e88-8be3-28b5bf3eb60e None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:13.754085 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5f0ff-4ac9-49d5-bcad-796f8f3cb1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:13.754749 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5f0ff-4ac9-49d5-bcad-796f8f3cb1b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:13.755032 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5f0ff-4ac9-49d5-bcad-796f8f3cb1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:13.755303 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5f0ff-4ac9-49d5-bcad-796f8f3cb1b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:13.756008 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f5f0ff-4ac9-49d5-bcad-796f8f3cb1b9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:13.757699 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING py.warnings [None req-37f5f0ff-4ac9-49d5-bcad-796f8f3cb1b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 10:26:13.757699 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: warnings.warn(msg) Feb 28 10:26:13.757699 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: Feb 28 10:26:13.758863 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f5f0ff-4ac9-49d5-bcad-796f8f3cb1b9 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:13.777095 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 741/1481] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Feb 28 10:26:13 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:26:16.105200 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdaf8b9-f7b9-4fa6-96b8-ca0fb82ee4d3 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:16.105807 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdaf8b9-f7b9-4fa6-96b8-ca0fb82ee4d3 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:16.105807 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdaf8b9-f7b9-4fa6-96b8-ca0fb82ee4d3 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:16.107539 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 741/1482] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:26:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:26:16.113875 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e383a48-ab67-4051-9194-125fa80e94ec None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:16.114333 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e383a48-ab67-4051-9194-125fa80e94ec None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:16.114440 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e383a48-ab67-4051-9194-125fa80e94ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:16.132219 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-5e383a48-ab67-4051-9194-125fa80e94ec None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:26:16.133389 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-5e383a48-ab67-4051-9194-125fa80e94ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:26:16.140990 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 742/1483] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:26:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:26:16.182940 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdaf8b9-f7b9-4fa6-96b8-ca0fb82ee4d3 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:16.196938 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdaf8b9-f7b9-4fa6-96b8-ca0fb82ee4d3 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:16.202273 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28613783-f354-4dc2-9d9d-8f4df6506a4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec202a34db8e47f4a6c18285245e3f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:16.202920 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28613783-f354-4dc2-9d9d-8f4df6506a4b service nova] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:16.203196 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28613783-f354-4dc2-9d9d-8f4df6506a4b service nova] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:16.203465 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28613783-f354-4dc2-9d9d-8f4df6506a4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:16.211778 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28613783-f354-4dc2-9d9d-8f4df6506a4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:16.213343 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28613783-f354-4dc2-9d9d-8f4df6506a4b service nova] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:16.223255 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 742/1484] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:26:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:26:18.701686 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb17e9c-64d5-4025-a1dc-8220c4aa09a5 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:18.702185 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb17e9c-64d5-4025-a1dc-8220c4aa09a5 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:18.702290 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb17e9c-64d5-4025-a1dc-8220c4aa09a5 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:18.704053 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 743/1485] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:26:18.709846 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0fc9e-2594-4ed7-942e-e07ef78e5d4b None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:18.710285 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0fc9e-2594-4ed7-942e-e07ef78e5d4b None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:18.710399 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0fc9e-2594-4ed7-942e-e07ef78e5d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:18.727783 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-ceb0fc9e-2594-4ed7-942e-e07ef78e5d4b None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:26:18.728946 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-ceb0fc9e-2594-4ed7-942e-e07ef78e5d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:26:18.736573 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 743/1486] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:26:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:26:18.773138 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb17e9c-64d5-4025-a1dc-8220c4aa09a5 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:18.783536 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb17e9c-64d5-4025-a1dc-8220c4aa09a5 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:18.787485 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183bd019-d4e1-4acf-a283-40a3a53ab863 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:18.788100 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bd019-d4e1-4acf-a283-40a3a53ab863 service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:18.788373 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bd019-d4e1-4acf-a283-40a3a53ab863 service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:18.788640 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bd019-d4e1-4acf-a283-40a3a53ab863 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:18.797165 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183bd019-d4e1-4acf-a283-40a3a53ab863 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:18.798572 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183bd019-d4e1-4acf-a283-40a3a53ab863 service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:18.808505 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 744/1487] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:26:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:26:21.169392 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16009d56-e453-4cfe-9379-e7be575e1f11 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:21.169974 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16009d56-e453-4cfe-9379-e7be575e1f11 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:21.169974 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16009d56-e453-4cfe-9379-e7be575e1f11 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:21.171750 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 744/1488] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:26:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:26:21.177780 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942ca25-83c0-4c73-843e-829c630d5db7 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:21.178212 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942ca25-83c0-4c73-843e-829c630d5db7 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:21.178320 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942ca25-83c0-4c73-843e-829c630d5db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:21.196622 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-b942ca25-83c0-4c73-843e-829c630d5db7 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:26:21.197807 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-b942ca25-83c0-4c73-843e-829c630d5db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:26:21.205770 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 745/1489] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:26:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:26:21.243727 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16009d56-e453-4cfe-9379-e7be575e1f11 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:21.254719 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16009d56-e453-4cfe-9379-e7be575e1f11 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:21.258114 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e3111-e433-40ff-997b-416bc952096c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:21.258760 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e3111-e433-40ff-997b-416bc952096c service neutron] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:21.259036 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e3111-e433-40ff-997b-416bc952096c service neutron] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:21.259304 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e3111-e433-40ff-997b-416bc952096c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:21.269172 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e3111-e433-40ff-997b-416bc952096c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:21.270626 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e3111-e433-40ff-997b-416bc952096c service neutron] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:21.279607 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 745/1490] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:26:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:26:23.720736 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a79603-226a-477e-978f-570446358547 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:23.721822 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a79603-226a-477e-978f-570446358547 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:23.721822 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a79603-226a-477e-978f-570446358547 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:23.723651 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 746/1491] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:26:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:26:23.728821 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46063e11-c120-4b85-ba51-6c523f0d6d8e None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:23.729268 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46063e11-c120-4b85-ba51-6c523f0d6d8e None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:23.729397 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46063e11-c120-4b85-ba51-6c523f0d6d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:23.747434 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-46063e11-c120-4b85-ba51-6c523f0d6d8e None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:26:23.748614 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-46063e11-c120-4b85-ba51-6c523f0d6d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:26:23.756425 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 746/1492] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:26:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:26:23.796219 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a79603-226a-477e-978f-570446358547 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:23.807339 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a79603-226a-477e-978f-570446358547 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:23.810801 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96b98e-b3bc-4feb-a6e2-14ec9669ce61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:23.811419 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96b98e-b3bc-4feb-a6e2-14ec9669ce61 service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:23.811699 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96b98e-b3bc-4feb-a6e2-14ec9669ce61 service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:23.811968 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96b98e-b3bc-4feb-a6e2-14ec9669ce61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:23.820843 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96b98e-b3bc-4feb-a6e2-14ec9669ce61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:23.822251 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96b98e-b3bc-4feb-a6e2-14ec9669ce61 service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:23.831792 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 747/1493] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:26:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:26:26.361459 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651d7f4-8eba-4f74-b483-825780dff9b5 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:26.362544 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651d7f4-8eba-4f74-b483-825780dff9b5 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:26.363026 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651d7f4-8eba-4f74-b483-825780dff9b5 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:26.364811 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 747/1494] 10.222.0.21 () {54 vars in 926 bytes} [Mon Feb 28 10:26:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:26:26.369976 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b70c4-c6ae-4c46-b94b-9239d5980c29 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:26.370433 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b70c4-c6ae-4c46-b94b-9239d5980c29 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:26.370551 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b70c4-c6ae-4c46-b94b-9239d5980c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:26.388644 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-d43b70c4-c6ae-4c46-b94b-9239d5980c29 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:26:26.389828 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-d43b70c4-c6ae-4c46-b94b-9239d5980c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:26:26.397520 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 748/1495] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Feb 28 10:26:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:26:26.436902 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651d7f4-8eba-4f74-b483-825780dff9b5 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:26:26.448808 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651d7f4-8eba-4f74-b483-825780dff9b5 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:26:26.452288 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466bf099-7a78-44dc-a265-31e83842aad6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:26:26.452911 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466bf099-7a78-44dc-a265-31e83842aad6 service neutron] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:26:26.453190 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466bf099-7a78-44dc-a265-31e83842aad6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:26:26.453460 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466bf099-7a78-44dc-a265-31e83842aad6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:26:26.462517 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466bf099-7a78-44dc-a265-31e83842aad6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:26:26.464026 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466bf099-7a78-44dc-a265-31e83842aad6 service neutron] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:26:26.473371 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 748/1496] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:26:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:27:51.147137 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03f93e-91c4-4d4d-be77-a5cad7f07dfc None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:27:51.147760 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03f93e-91c4-4d4d-be77-a5cad7f07dfc None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:27:51.147760 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03f93e-91c4-4d4d-be77-a5cad7f07dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:27:51.166210 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-0e03f93e-91c4-4d4d-be77-a5cad7f07dfc None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:27:51.167423 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-0e03f93e-91c4-4d4d-be77-a5cad7f07dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:27:51.175734 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 749/1497] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:27:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:27:51.184888 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4bad6-bb66-4b0b-829b-454e769f00df None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:27:51.185398 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4bad6-bb66-4b0b-829b-454e769f00df None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:27:51.185505 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4bad6-bb66-4b0b-829b-454e769f00df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:27:51.203559 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-ccb4bad6-bb66-4b0b-829b-454e769f00df None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:27:51.204988 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-ccb4bad6-bb66-4b0b-829b-454e769f00df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:27:51.212669 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 749/1498] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:27:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:27:51.217163 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03f93e-91c4-4d4d-be77-a5cad7f07dfc None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:27:51.227478 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03f93e-91c4-4d4d-be77-a5cad7f07dfc None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:27:51.231960 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06472ddb-c2fe-4c68-ad7f-daada3e0ee7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:27:51.232600 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06472ddb-c2fe-4c68-ad7f-daada3e0ee7c admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:27:51.232875 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06472ddb-c2fe-4c68-ad7f-daada3e0ee7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:27:51.233146 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06472ddb-c2fe-4c68-ad7f-daada3e0ee7c admin admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:27:51.233953 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06472ddb-c2fe-4c68-ad7f-daada3e0ee7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:27:51.234271 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06472ddb-c2fe-4c68-ad7f-daada3e0ee7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:27:51.235334 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING py.warnings [None req-06472ddb-c2fe-4c68-ad7f-daada3e0ee7c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 10:27:51.235334 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: warnings.warn(msg) Feb 28 10:27:51.235334 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: Feb 28 10:27:51.236197 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06472ddb-c2fe-4c68-ad7f-daada3e0ee7c admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:27:51.247242 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 750/1499] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:27:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:27:51.255173 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4bad6-bb66-4b0b-829b-454e769f00df None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:27:51.264336 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4bad6-bb66-4b0b-829b-454e769f00df None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:27:51.269462 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc0277b-d8ed-45e3-874e-b260ecef4970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:27:51.270106 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc0277b-d8ed-45e3-874e-b260ecef4970 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:27:51.270387 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc0277b-d8ed-45e3-874e-b260ecef4970 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:27:51.270698 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc0277b-d8ed-45e3-874e-b260ecef4970 admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:27:51.271388 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc0277b-d8ed-45e3-874e-b260ecef4970 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:27:51.272401 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING py.warnings [None req-ddc0277b-d8ed-45e3-874e-b260ecef4970 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 10:27:51.272401 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: warnings.warn(msg) Feb 28 10:27:51.272401 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: Feb 28 10:27:51.273687 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc0277b-d8ed-45e3-874e-b260ecef4970 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:27:51.308304 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 750/1500] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:27:51 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:27:51.313303 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06472ddb-c2fe-4c68-ad7f-daada3e0ee7c admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:27:51.322815 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06472ddb-c2fe-4c68-ad7f-daada3e0ee7c admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:27:51.377446 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc031478-3759-47f5-8fed-c39db34760b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:27:51.378093 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc031478-3759-47f5-8fed-c39db34760b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:27:51.378377 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc031478-3759-47f5-8fed-c39db34760b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:27:51.378667 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc031478-3759-47f5-8fed-c39db34760b8 admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:27:51.379347 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc031478-3759-47f5-8fed-c39db34760b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:27:51.380344 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING py.warnings [None req-dc031478-3759-47f5-8fed-c39db34760b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 10:27:51.380344 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: warnings.warn(msg) Feb 28 10:27:51.380344 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: Feb 28 10:27:51.381517 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc031478-3759-47f5-8fed-c39db34760b8 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:27:51.401017 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 751/1501] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:27:51 2022] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:27:51.405043 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc0277b-d8ed-45e3-874e-b260ecef4970 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:27:51.415144 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc0277b-d8ed-45e3-874e-b260ecef4970 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:27:51.419593 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c250897-6e31-4ed1-a0fe-b8673ae0ecf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:27:51.420234 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c250897-6e31-4ed1-a0fe-b8673ae0ecf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:27:51.420511 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c250897-6e31-4ed1-a0fe-b8673ae0ecf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:27:51.420787 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c250897-6e31-4ed1-a0fe-b8673ae0ecf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:27:51.421595 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c250897-6e31-4ed1-a0fe-b8673ae0ecf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:27:51.422619 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING py.warnings [None req-0c250897-6e31-4ed1-a0fe-b8673ae0ecf0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 10:27:51.422619 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: warnings.warn(msg) Feb 28 10:27:51.422619 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: Feb 28 10:27:51.423493 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c250897-6e31-4ed1-a0fe-b8673ae0ecf0 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:27:51.436391 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 751/1502] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:27:51.440844 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc031478-3759-47f5-8fed-c39db34760b8 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:27:51.450349 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc031478-3759-47f5-8fed-c39db34760b8 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:27:51.456103 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ead7b7-d628-4b0c-a117-0fc70356f86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:27:51.456736 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ead7b7-d628-4b0c-a117-0fc70356f86a admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:27:51.457010 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ead7b7-d628-4b0c-a117-0fc70356f86a admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:27:51.457275 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ead7b7-d628-4b0c-a117-0fc70356f86a admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:27:51.457975 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ead7b7-d628-4b0c-a117-0fc70356f86a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:27:51.458985 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING py.warnings [None req-b6ead7b7-d628-4b0c-a117-0fc70356f86a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 10:27:51.458985 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: warnings.warn(msg) Feb 28 10:27:51.458985 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: Feb 28 10:27:51.459849 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ead7b7-d628-4b0c-a117-0fc70356f86a admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:27:51.472926 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 752/1503] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:27:51.477047 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c250897-6e31-4ed1-a0fe-b8673ae0ecf0 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:27:51.486910 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c250897-6e31-4ed1-a0fe-b8673ae0ecf0 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:27:51.491347 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2897cf68-0d37-4fff-83e3-0d76ad5a9969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:27:51.492204 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897cf68-0d37-4fff-83e3-0d76ad5a9969 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:27:51.492486 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897cf68-0d37-4fff-83e3-0d76ad5a9969 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:27:51.492761 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897cf68-0d37-4fff-83e3-0d76ad5a9969 admin admin] PATH_INFO: `/v3/projects/03c415b3b3854bcabdede1f94c3b0fc9/users/2dd851b71c214d06b87cbb73f0e7502d/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:27:51.507773 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2897cf68-0d37-4fff-83e3-0d76ad5a9969 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03c415b3b3854bcabdede1f94c3b0fc9, user_id=2dd851b71c214d06b87cbb73f0e7502d, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:27:51.508804 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING py.warnings [None req-2897cf68-0d37-4fff-83e3-0d76ad5a9969 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 10:27:51.508804 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: warnings.warn(msg) Feb 28 10:27:51.508804 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: Feb 28 10:27:51.510731 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2897cf68-0d37-4fff-83e3-0d76ad5a9969 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:27:51.524406 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 752/1504] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:27:51 2022] PUT /identity/v3/projects/03c415b3b3854bcabdede1f94c3b0fc9/users/2dd851b71c214d06b87cbb73f0e7502d/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:27:51.536865 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674f91e-25c3-4492-94f9-32dddce0b019 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:27:51.537150 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674f91e-25c3-4492-94f9-32dddce0b019 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:27:51.537451 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674f91e-25c3-4492-94f9-32dddce0b019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:27:51.564414 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-9674f91e-25c3-4492-94f9-32dddce0b019 None None] MFA Rules not processed for user `2dd851b71c214d06b87cbb73f0e7502d`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:27:51.565628 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-9674f91e-25c3-4492-94f9-32dddce0b019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:27:51.625802 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 753/1505] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:27:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:27:51.636872 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2897cf68-0d37-4fff-83e3-0d76ad5a9969 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:27:51.705259 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2897cf68-0d37-4fff-83e3-0d76ad5a9969 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:27:51.710505 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bffc24-e461-497f-9525-f5c63865568c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec202a34db8e47f4a6c18285245e3f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:27:51.711161 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bffc24-e461-497f-9525-f5c63865568c service nova] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:27:51.711442 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bffc24-e461-497f-9525-f5c63865568c service nova] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:27:51.711719 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bffc24-e461-497f-9525-f5c63865568c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:27:51.719661 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bffc24-e461-497f-9525-f5c63865568c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:27:51.721219 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bffc24-e461-497f-9525-f5c63865568c service nova] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:27:51.729680 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 753/1506] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:27:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:27:51.803039 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc599fb-2504-4c3d-9db5-095c0620a9b3 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:27:51.803326 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc599fb-2504-4c3d-9db5-095c0620a9b3 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:27:51.803599 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc599fb-2504-4c3d-9db5-095c0620a9b3 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:27:51.805281 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 754/1507] 10.222.0.21 () {52 vars in 829 bytes} [Mon Feb 28 10:27:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:27:51.808878 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bffc24-e461-497f-9525-f5c63865568c service nova] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:27:51.868458 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bffc24-e461-497f-9525-f5c63865568c service nova] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:27:51.872948 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac27b3-d109-4383-8fec-10062032b930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:27:51.873795 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac27b3-d109-4383-8fec-10062032b930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:27:51.874091 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac27b3-d109-4383-8fec-10062032b930 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:27:51.874969 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac27b3-d109-4383-8fec-10062032b930 admin admin] PATH_INFO: `/v3/users/2dd851b71c214d06b87cbb73f0e7502d` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:27:51.876250 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfac27b3-d109-4383-8fec-10062032b930 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dd851b71c214d06b87cbb73f0e7502d)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:27:51.877272 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING py.warnings [None req-dfac27b3-d109-4383-8fec-10062032b930 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 10:27:51.877272 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: warnings.warn(msg) Feb 28 10:27:51.877272 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: Feb 28 10:27:51.878454 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfac27b3-d109-4383-8fec-10062032b930 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:27:51.940309 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-dfac27b3-d109-4383-8fec-10062032b930 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dd851b71c214d06b87cbb73f0e7502d'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:27:51.940936 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-dfac27b3-d109-4383-8fec-10062032b930 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dd851b71c214d06b87cbb73f0e7502d'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:27:51.958386 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-dfac27b3-d109-4383-8fec-10062032b930 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dd851b71c214d06b87cbb73f0e7502d'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:27:51.967608 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-dfac27b3-d109-4383-8fec-10062032b930 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dd851b71c214d06b87cbb73f0e7502d'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:27:51.979328 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-dfac27b3-d109-4383-8fec-10062032b930 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dd851b71c214d06b87cbb73f0e7502d'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:27:51.985822 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 754/1508] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:27:51 2022] DELETE /identity/v3/users/2dd851b71c214d06b87cbb73f0e7502d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:27:51.990228 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688d0ee-45cf-46a1-856e-3b7759282973 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:27:51.990514 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688d0ee-45cf-46a1-856e-3b7759282973 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:27:51.990815 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688d0ee-45cf-46a1-856e-3b7759282973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:27:52.009048 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-c688d0ee-45cf-46a1-856e-3b7759282973 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:27:52.010224 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-c688d0ee-45cf-46a1-856e-3b7759282973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:27:52.065865 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 755/1509] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:27:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:27:52.075123 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac27b3-d109-4383-8fec-10062032b930 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:27:52.076535 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-dfac27b3-d109-4383-8fec-10062032b930 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:27:52.129967 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac27b3-d109-4383-8fec-10062032b930 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:27:52.133476 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a636c-cbb8-4806-a362-9b81587a532a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:27:52.134108 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a636c-cbb8-4806-a362-9b81587a532a service neutron] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:27:52.134387 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a636c-cbb8-4806-a362-9b81587a532a service neutron] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:27:52.134687 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a636c-cbb8-4806-a362-9b81587a532a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:27:52.143377 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a636c-cbb8-4806-a362-9b81587a532a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:27:52.144790 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a636c-cbb8-4806-a362-9b81587a532a service neutron] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:27:52.153774 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 755/1510] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:27:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:27:52.470451 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688d0ee-45cf-46a1-856e-3b7759282973 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:27:52.471980 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-c688d0ee-45cf-46a1-856e-3b7759282973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:27:52.483264 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688d0ee-45cf-46a1-856e-3b7759282973 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:27:52.488397 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c8ea5-0631-40f4-8685-cd1c436339ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:27:52.489244 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c8ea5-0631-40f4-8685-cd1c436339ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:27:52.489517 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c8ea5-0631-40f4-8685-cd1c436339ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:27:52.489781 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c8ea5-0631-40f4-8685-cd1c436339ea admin admin] PATH_INFO: `/v3/projects/03c415b3b3854bcabdede1f94c3b0fc9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:27:52.490982 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c8ea5-0631-40f4-8685-cd1c436339ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=03c415b3b3854bcabdede1f94c3b0fc9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:27:52.491979 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING py.warnings [None req-a67c8ea5-0631-40f4-8685-cd1c436339ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 10:27:52.491979 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: warnings.warn(msg) Feb 28 10:27:52.491979 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: Feb 28 10:27:52.493197 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c8ea5-0631-40f4-8685-cd1c436339ea admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:27:52.556118 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-a67c8ea5-0631-40f4-8685-cd1c436339ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03c415b3b3854bcabdede1f94c3b0fc9', 'request_id': 'req-a67c8ea5-0631-40f4-8685-cd1c436339ea'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:27:52.562032 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-a67c8ea5-0631-40f4-8685-cd1c436339ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03c415b3b3854bcabdede1f94c3b0fc9', 'request_id': 'req-a67c8ea5-0631-40f4-8685-cd1c436339ea'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:27:52.574979 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-a67c8ea5-0631-40f4-8685-cd1c436339ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03c415b3b3854bcabdede1f94c3b0fc9', 'request_id': 'req-a67c8ea5-0631-40f4-8685-cd1c436339ea'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:27:52.589761 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-a67c8ea5-0631-40f4-8685-cd1c436339ea admin admin] The token cache is being invalidate because project 03c415b3b3854bcabdede1f94c3b0fc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:27:52.590046 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-a67c8ea5-0631-40f4-8685-cd1c436339ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:27:52.590776 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-a67c8ea5-0631-40f4-8685-cd1c436339ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:27:52.592344 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 756/1511] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:27:52 2022] DELETE /identity/v3/projects/03c415b3b3854bcabdede1f94c3b0fc9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:29:29.273149 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e5a0b-d8fa-46a4-8f8a-4a79b8005976 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:29:29.273756 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e5a0b-d8fa-46a4-8f8a-4a79b8005976 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:29:29.273756 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e5a0b-d8fa-46a4-8f8a-4a79b8005976 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:29:29.275577 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 756/1512] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 10:29:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:29:29.281211 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b815d-d547-45b8-8d45-81232933849c None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:29:29.281665 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b815d-d547-45b8-8d45-81232933849c None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:29:29.281768 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b815d-d547-45b8-8d45-81232933849c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:29:29.299458 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-573b815d-d547-45b8-8d45-81232933849c None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:29:29.300663 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-573b815d-d547-45b8-8d45-81232933849c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:29:29.357221 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 757/1513] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 10:29:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:29:29.514528 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e5a0b-d8fa-46a4-8f8a-4a79b8005976 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:29:29.516238 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-b75e5a0b-d8fa-46a4-8f8a-4a79b8005976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:29:29.560413 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c01c4-9977-4471-9a79-307f2c8282f2 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:29:29.560705 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c01c4-9977-4471-9a79-307f2c8282f2 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:29:29.561067 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c01c4-9977-4471-9a79-307f2c8282f2 None None] PATH_INFO: `/v3` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:29:29.562258 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 758/1514] 10.222.0.26 () {54 vars in 925 bytes} [Mon Feb 28 10:29:29 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:29:29.568153 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8578f5-c9ac-456e-aea0-1795622425ab None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:29:29.568437 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8578f5-c9ac-456e-aea0-1795622425ab None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:29:29.568715 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8578f5-c9ac-456e-aea0-1795622425ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:29:29.587040 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-cd8578f5-c9ac-456e-aea0-1795622425ab None None] MFA Rules not processed for user `1b2346e4de5d45a79d4bb2abb01d4827`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:29:29.588229 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-cd8578f5-c9ac-456e-aea0-1795622425ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:29:29.590890 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e5a0b-d8fa-46a4-8f8a-4a79b8005976 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:29:29.596362 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c388a-ed07-41ae-8207-3ad84bda21d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec202a34db8e47f4a6c18285245e3f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:29:29.596999 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c388a-ed07-41ae-8207-3ad84bda21d2 service nova] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:29:29.597277 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c388a-ed07-41ae-8207-3ad84bda21d2 service nova] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:29:29.597550 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c388a-ed07-41ae-8207-3ad84bda21d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:29:29.605686 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c388a-ed07-41ae-8207-3ad84bda21d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:29:29.607414 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c388a-ed07-41ae-8207-3ad84bda21d2 service nova] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:29:29.616504 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 757/1515] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:29:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:29:29.649408 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 759/1516] 10.222.0.26 () {58 vars in 1015 bytes} [Mon Feb 28 10:29:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:29:30.898551 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22700f1d-a896-429b-bf20-f2ec5cdf200d None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:29:30.899158 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22700f1d-a896-429b-bf20-f2ec5cdf200d None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:29:30.899158 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22700f1d-a896-429b-bf20-f2ec5cdf200d None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:29:30.900876 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 758/1517] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 10:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:29:30.906633 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb5ea3-6d54-4adf-92e2-91080b1d46fa None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:29:30.907068 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb5ea3-6d54-4adf-92e2-91080b1d46fa None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:29:30.907188 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb5ea3-6d54-4adf-92e2-91080b1d46fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:29:30.926844 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-dbeb5ea3-6d54-4adf-92e2-91080b1d46fa None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:29:30.928032 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-dbeb5ea3-6d54-4adf-92e2-91080b1d46fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:29:30.935770 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 760/1518] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 10:29:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:29:31.088732 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22700f1d-a896-429b-bf20-f2ec5cdf200d None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:29:31.103379 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22700f1d-a896-429b-bf20-f2ec5cdf200d None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:29:31.109386 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a8a07-067e-48fb-a95e-d245af284f17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec202a34db8e47f4a6c18285245e3f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:29:31.110008 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a8a07-067e-48fb-a95e-d245af284f17 service nova] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:29:31.110287 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a8a07-067e-48fb-a95e-d245af284f17 service nova] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:29:31.110559 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a8a07-067e-48fb-a95e-d245af284f17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:29:31.118406 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45a8a07-067e-48fb-a95e-d245af284f17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:29:31.119996 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45a8a07-067e-48fb-a95e-d245af284f17 service nova] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:29:31.129199 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 759/1519] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:29:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:29:38.750579 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6966b6f-1108-46bd-b2b7-f363cfae5985 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:29:38.751140 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6966b6f-1108-46bd-b2b7-f363cfae5985 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:29:38.751140 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6966b6f-1108-46bd-b2b7-f363cfae5985 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:29:38.752937 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 761/1520] 10.222.0.21 () {54 vars in 960 bytes} [Mon Feb 28 10:29:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:29:38.757968 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f0e28-f40b-4028-935b-194c58a45c63 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:29:38.758395 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f0e28-f40b-4028-935b-194c58a45c63 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:29:38.758531 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f0e28-f40b-4028-935b-194c58a45c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:29:38.776843 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-507f0e28-f40b-4028-935b-194c58a45c63 None None] MFA Rules not processed for user `1b2346e4de5d45a79d4bb2abb01d4827`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:29:38.778057 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-507f0e28-f40b-4028-935b-194c58a45c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:29:38.786638 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 760/1521] 10.222.0.21 () {58 vars in 1057 bytes} [Mon Feb 28 10:29:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:29:38.793766 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6966b6f-1108-46bd-b2b7-f363cfae5985 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:29:38.807083 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6966b6f-1108-46bd-b2b7-f363cfae5985 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:29:38.812467 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681ff9a-5c43-4f17-88f4-2e60d7f3d3f7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b2346e4de5d45a79d4bb2abb01d4827', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:29:38.813088 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681ff9a-5c43-4f17-88f4-2e60d7f3d3f7 service placement] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:29:38.813369 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681ff9a-5c43-4f17-88f4-2e60d7f3d3f7 service placement] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:29:38.813642 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681ff9a-5c43-4f17-88f4-2e60d7f3d3f7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:29:38.821602 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681ff9a-5c43-4f17-88f4-2e60d7f3d3f7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:29:38.823190 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681ff9a-5c43-4f17-88f4-2e60d7f3d3f7 service placement] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:29:38.833485 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 762/1522] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:29:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:29:42.915161 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8fd2a-f32e-4900-afee-91e818c16205 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:29:42.915730 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8fd2a-f32e-4900-afee-91e818c16205 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:29:42.915730 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8fd2a-f32e-4900-afee-91e818c16205 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:29:42.917638 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 761/1523] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 10:29:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:29:42.922867 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5dfda3-4021-468f-be48-456333abce8b None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:29:42.923308 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5dfda3-4021-468f-be48-456333abce8b None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:29:42.923452 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5dfda3-4021-468f-be48-456333abce8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:29:42.941371 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-4b5dfda3-4021-468f-be48-456333abce8b None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:29:42.942555 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-4b5dfda3-4021-468f-be48-456333abce8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:29:42.950909 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 763/1524] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 10:29:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:29:43.103996 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8fd2a-f32e-4900-afee-91e818c16205 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:29:43.118933 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8fd2a-f32e-4900-afee-91e818c16205 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:29:43.124207 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d11fb-ad3e-44f9-9c63-52a1eb8b65a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec202a34db8e47f4a6c18285245e3f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:29:43.124828 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d11fb-ad3e-44f9-9c63-52a1eb8b65a4 service nova] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:29:43.125102 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d11fb-ad3e-44f9-9c63-52a1eb8b65a4 service nova] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:29:43.125370 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d11fb-ad3e-44f9-9c63-52a1eb8b65a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:29:43.133268 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107d11fb-ad3e-44f9-9c63-52a1eb8b65a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:29:43.134847 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107d11fb-ad3e-44f9-9c63-52a1eb8b65a4 service nova] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:29:43.143917 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 762/1525] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:29:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:29:44.442310 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8ddaa-3bb3-4c77-b990-d840ecd723a2 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:29:44.442910 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8ddaa-3bb3-4c77-b990-d840ecd723a2 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:29:44.442910 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8ddaa-3bb3-4c77-b990-d840ecd723a2 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:29:44.444656 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 764/1526] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 10:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:29:44.453722 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c636192-01b8-4f8e-94a6-f4917704292d None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:29:44.454138 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c636192-01b8-4f8e-94a6-f4917704292d None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:29:44.454244 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c636192-01b8-4f8e-94a6-f4917704292d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:29:44.472391 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-9c636192-01b8-4f8e-94a6-f4917704292d None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:29:44.473566 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-9c636192-01b8-4f8e-94a6-f4917704292d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:29:44.481824 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 763/1527] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 10:29:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:29:44.636770 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8ddaa-3bb3-4c77-b990-d840ecd723a2 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:29:44.651056 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8ddaa-3bb3-4c77-b990-d840ecd723a2 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:29:44.657745 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11893cad-c97d-4e85-b727-c6f3470b6659 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec202a34db8e47f4a6c18285245e3f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:29:44.658374 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11893cad-c97d-4e85-b727-c6f3470b6659 service nova] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:29:44.658686 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11893cad-c97d-4e85-b727-c6f3470b6659 service nova] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:29:44.658962 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11893cad-c97d-4e85-b727-c6f3470b6659 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:29:44.666858 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11893cad-c97d-4e85-b727-c6f3470b6659 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:29:44.669015 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11893cad-c97d-4e85-b727-c6f3470b6659 service nova] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:29:44.678213 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 765/1528] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:29:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:29:49.371594 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7c542-d4e6-419b-a691-b0fe49257c6c None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:29:49.372167 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7c542-d4e6-419b-a691-b0fe49257c6c None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:29:49.372275 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7c542-d4e6-419b-a691-b0fe49257c6c None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:29:49.374040 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 764/1529] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 10:29:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:29:49.379185 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9692574-b5c6-43d1-a116-cd82a274592d None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:29:49.379590 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9692574-b5c6-43d1-a116-cd82a274592d None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:29:49.379741 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9692574-b5c6-43d1-a116-cd82a274592d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:29:49.398086 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-b9692574-b5c6-43d1-a116-cd82a274592d None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:29:49.399307 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-b9692574-b5c6-43d1-a116-cd82a274592d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:29:49.407071 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 766/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 10:29:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:29:49.444212 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7c542-d4e6-419b-a691-b0fe49257c6c None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:29:49.445904 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-01e7c542-d4e6-419b-a691-b0fe49257c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:29:49.502664 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7c542-d4e6-419b-a691-b0fe49257c6c None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:29:49.506137 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bfdd1d-dd34-462c-acf9-7e697423b018 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:29:49.506805 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfdd1d-dd34-462c-acf9-7e697423b018 service neutron] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:29:49.507087 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfdd1d-dd34-462c-acf9-7e697423b018 service neutron] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:29:49.507362 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfdd1d-dd34-462c-acf9-7e697423b018 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:29:49.516586 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bfdd1d-dd34-462c-acf9-7e697423b018 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:29:49.517999 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bfdd1d-dd34-462c-acf9-7e697423b018 service neutron] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:29:49.527060 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 765/1531] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:29:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:29:51.870553 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6eaeef-d740-40d9-b685-a0bd2d4597a1 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:29:51.871184 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6eaeef-d740-40d9-b685-a0bd2d4597a1 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:29:51.872199 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6eaeef-d740-40d9-b685-a0bd2d4597a1 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:29:51.873985 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 767/1532] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 10:29:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:29:51.879341 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e6855-9da3-44f3-b4bd-2fe411d1d98b None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:29:51.879756 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e6855-9da3-44f3-b4bd-2fe411d1d98b None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:29:51.879873 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e6855-9da3-44f3-b4bd-2fe411d1d98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:29:51.897589 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-525e6855-9da3-44f3-b4bd-2fe411d1d98b None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:29:51.898802 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-525e6855-9da3-44f3-b4bd-2fe411d1d98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:29:51.906718 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 766/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 10:29:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:29:51.942430 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6eaeef-d740-40d9-b685-a0bd2d4597a1 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:29:51.952977 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6eaeef-d740-40d9-b685-a0bd2d4597a1 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:29:51.956706 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f690f9-d2d7-4497-9d86-3800d3b3e123 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:29:51.957326 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f690f9-d2d7-4497-9d86-3800d3b3e123 service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:29:51.957603 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f690f9-d2d7-4497-9d86-3800d3b3e123 service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:29:51.957876 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f690f9-d2d7-4497-9d86-3800d3b3e123 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:29:51.966549 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f690f9-d2d7-4497-9d86-3800d3b3e123 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:29:51.967978 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f690f9-d2d7-4497-9d86-3800d3b3e123 service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:29:51.977153 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 768/1534] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:29:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:29:56.255081 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5205e52-d43b-462e-bc1d-2b151b2bc913 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:29:56.255621 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5205e52-d43b-462e-bc1d-2b151b2bc913 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:29:56.255621 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5205e52-d43b-462e-bc1d-2b151b2bc913 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:29:56.257343 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 767/1535] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 10:29:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:29:56.263123 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be2f79-b03b-4150-87f2-8a2970937a40 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:29:56.263540 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be2f79-b03b-4150-87f2-8a2970937a40 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:29:56.263660 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be2f79-b03b-4150-87f2-8a2970937a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:29:56.281750 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-92be2f79-b03b-4150-87f2-8a2970937a40 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:29:56.282974 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-92be2f79-b03b-4150-87f2-8a2970937a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:29:56.290574 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 769/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 10:29:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:29:56.548392 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5205e52-d43b-462e-bc1d-2b151b2bc913 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:29:56.550078 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-d5205e52-d43b-462e-bc1d-2b151b2bc913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:29:56.608484 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5205e52-d43b-462e-bc1d-2b151b2bc913 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:29:56.612018 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f0fa3-6648-4921-91eb-5a9912303e94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:29:56.612648 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f0fa3-6648-4921-91eb-5a9912303e94 service cinder] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:29:56.612930 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f0fa3-6648-4921-91eb-5a9912303e94 service cinder] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:29:56.613203 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f0fa3-6648-4921-91eb-5a9912303e94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:29:56.622797 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f0fa3-6648-4921-91eb-5a9912303e94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:29:56.624233 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f0fa3-6648-4921-91eb-5a9912303e94 service cinder] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:29:56.633418 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 768/1537] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:29:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:29:59.013841 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6787a-a42f-46d1-bb17-a2fcbc1d7501 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:29:59.014408 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6787a-a42f-46d1-bb17-a2fcbc1d7501 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:29:59.014408 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6787a-a42f-46d1-bb17-a2fcbc1d7501 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:29:59.016222 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 770/1538] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 10:29:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:29:59.021380 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908dec11-4ff2-4fd1-9301-10f590c7cead None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:29:59.021806 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908dec11-4ff2-4fd1-9301-10f590c7cead None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:29:59.021948 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908dec11-4ff2-4fd1-9301-10f590c7cead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:29:59.039258 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-908dec11-4ff2-4fd1-9301-10f590c7cead None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:29:59.040443 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-908dec11-4ff2-4fd1-9301-10f590c7cead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:29:59.048154 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 769/1539] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 10:29:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:29:59.302817 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61d143-89e5-4c97-bae0-e71b93b35148 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:29:59.303108 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61d143-89e5-4c97-bae0-e71b93b35148 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:29:59.303384 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61d143-89e5-4c97-bae0-e71b93b35148 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:29:59.305201 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 771/1540] 10.222.0.21 () {54 vars in 963 bytes} [Mon Feb 28 10:29:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:29:59.310607 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a7bdd-e18e-429f-bae0-539fe470a592 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:29:59.310910 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a7bdd-e18e-429f-bae0-539fe470a592 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:29:59.311182 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a7bdd-e18e-429f-bae0-539fe470a592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:29:59.329247 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-479a7bdd-e18e-429f-bae0-539fe470a592 None None] MFA Rules not processed for user `b2e92304833d47828c52ae737f6b96cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:29:59.330515 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-479a7bdd-e18e-429f-bae0-539fe470a592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:29:59.337152 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 770/1541] 10.222.0.21 () {58 vars in 1060 bytes} [Mon Feb 28 10:29:59 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:29:59.344773 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c61d143-89e5-4c97-bae0-e71b93b35148 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:29:59.354916 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c61d143-89e5-4c97-bae0-e71b93b35148 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:29:59.358904 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6ffd7-2cf1-4811-9b17-f56dd4071e8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:29:59.359514 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6ffd7-2cf1-4811-9b17-f56dd4071e8e service cinder] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:29:59.359790 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6ffd7-2cf1-4811-9b17-f56dd4071e8e service cinder] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:29:59.360057 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6ffd7-2cf1-4811-9b17-f56dd4071e8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:29:59.368466 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc6ffd7-2cf1-4811-9b17-f56dd4071e8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:29:59.369859 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc6ffd7-2cf1-4811-9b17-f56dd4071e8e service cinder] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:29:59.379569 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 772/1542] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:29:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:31:29.616508 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287ce6c-7b3b-4cd8-9d97-a26e4d98c778 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:29.618420 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287ce6c-7b3b-4cd8-9d97-a26e4d98c778 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:29.618420 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287ce6c-7b3b-4cd8-9d97-a26e4d98c778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:29.641119 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-f287ce6c-7b3b-4cd8-9d97-a26e4d98c778 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:29.642316 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-f287ce6c-7b3b-4cd8-9d97-a26e4d98c778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:29.654370 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 771/1543] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:29.663558 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3f75f-9589-44a4-b6ac-08ede7684175 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:29.664585 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3f75f-9589-44a4-b6ac-08ede7684175 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:29.665085 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3f75f-9589-44a4-b6ac-08ede7684175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:29.690064 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-c2f3f75f-9589-44a4-b6ac-08ede7684175 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:29.691649 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-c2f3f75f-9589-44a4-b6ac-08ede7684175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:29.703600 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 773/1544] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:29.708260 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f287ce6c-7b3b-4cd8-9d97-a26e4d98c778 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:29.723992 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f287ce6c-7b3b-4cd8-9d97-a26e4d98c778 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:29.730626 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812a49d-3056-4780-a3e7-2d34becf2e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:29.731299 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812a49d-3056-4780-a3e7-2d34becf2e47 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:29.731580 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812a49d-3056-4780-a3e7-2d34becf2e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:29.731855 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812a49d-3056-4780-a3e7-2d34becf2e47 admin admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:29.732577 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812a49d-3056-4780-a3e7-2d34becf2e47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:31:29.732882 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812a49d-3056-4780-a3e7-2d34becf2e47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:29.733897 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING py.warnings [None req-2812a49d-3056-4780-a3e7-2d34becf2e47 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 10:31:29.733897 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: warnings.warn(msg) Feb 28 10:31:29.733897 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: Feb 28 10:31:29.734793 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812a49d-3056-4780-a3e7-2d34becf2e47 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:29.750718 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 772/1545] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:31:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:31:29.758675 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3f75f-9589-44a4-b6ac-08ede7684175 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:29.768864 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3f75f-9589-44a4-b6ac-08ede7684175 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:29.779372 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b8b8b-0afd-42b4-b7c8-83165178f1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:29.780426 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b8b8b-0afd-42b4-b7c8-83165178f1f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:29.780932 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b8b8b-0afd-42b4-b7c8-83165178f1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:29.781449 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b8b8b-0afd-42b4-b7c8-83165178f1f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:29.782357 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b8b8b-0afd-42b4-b7c8-83165178f1f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:29.787545 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING py.warnings [None req-d56b8b8b-0afd-42b4-b7c8-83165178f1f4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 10:31:29.787545 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: warnings.warn(msg) Feb 28 10:31:29.787545 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: Feb 28 10:31:29.789134 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b8b8b-0afd-42b4-b7c8-83165178f1f4 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:29.824985 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 774/1546] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:31:29 2022] POST /identity/v3/projects => generated 391 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:31:29.830690 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812a49d-3056-4780-a3e7-2d34becf2e47 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:29.845680 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812a49d-3056-4780-a3e7-2d34becf2e47 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:29.930930 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92a1f6-3ef2-4ce7-aeef-00a0427b3072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:29.931587 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92a1f6-3ef2-4ce7-aeef-00a0427b3072 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:29.931872 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92a1f6-3ef2-4ce7-aeef-00a0427b3072 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:29.932145 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92a1f6-3ef2-4ce7-aeef-00a0427b3072 admin admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:29.932858 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c92a1f6-3ef2-4ce7-aeef-00a0427b3072 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:29.933964 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING py.warnings [None req-1c92a1f6-3ef2-4ce7-aeef-00a0427b3072 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 10:31:29.933964 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: warnings.warn(msg) Feb 28 10:31:29.933964 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: Feb 28 10:31:29.935400 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c92a1f6-3ef2-4ce7-aeef-00a0427b3072 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:29.968860 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 773/1547] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:31:29 2022] POST /identity/v3/users => generated 296 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:31:29.973331 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b8b8b-0afd-42b4-b7c8-83165178f1f4 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:29.991567 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b8b8b-0afd-42b4-b7c8-83165178f1f4 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:30.001198 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab08425-f4ea-4518-8f50-dcc1a9466e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:30.001882 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab08425-f4ea-4518-8f50-dcc1a9466e3c admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:30.002162 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab08425-f4ea-4518-8f50-dcc1a9466e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:30.002434 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab08425-f4ea-4518-8f50-dcc1a9466e3c admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:30.003192 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab08425-f4ea-4518-8f50-dcc1a9466e3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:30.005049 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab08425-f4ea-4518-8f50-dcc1a9466e3c admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:30.019753 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 775/1548] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:31:30.023898 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92a1f6-3ef2-4ce7-aeef-00a0427b3072 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:30.035236 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960f32a-a21e-4b5f-86fa-fdbd82fc12d2 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:30.035920 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960f32a-a21e-4b5f-86fa-fdbd82fc12d2 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:30.036424 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960f32a-a21e-4b5f-86fa-fdbd82fc12d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:30.036861 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92a1f6-3ef2-4ce7-aeef-00a0427b3072 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:30.043559 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33f298-7c24-4d88-9d62-899dd8dfcd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:30.044235 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33f298-7c24-4d88-9d62-899dd8dfcd78 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:30.044560 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33f298-7c24-4d88-9d62-899dd8dfcd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:30.045034 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33f298-7c24-4d88-9d62-899dd8dfcd78 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:30.045834 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33f298-7c24-4d88-9d62-899dd8dfcd78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:30.052158 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33f298-7c24-4d88-9d62-899dd8dfcd78 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:30.070099 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 774/1549] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:31:30.075623 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33f298-7c24-4d88-9d62-899dd8dfcd78 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:30.076050 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-a960f32a-a21e-4b5f-86fa-fdbd82fc12d2 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:30.077548 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-a960f32a-a21e-4b5f-86fa-fdbd82fc12d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:30.090315 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33f298-7c24-4d88-9d62-899dd8dfcd78 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:30.096695 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 776/1550] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:30.099416 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e2af6-57f0-40a2-88cd-e39ed610f913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:30.100333 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e2af6-57f0-40a2-88cd-e39ed610f913 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:30.100610 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e2af6-57f0-40a2-88cd-e39ed610f913 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:30.100884 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e2af6-57f0-40a2-88cd-e39ed610f913 admin admin] PATH_INFO: `/v3/projects/b77d7fba24894206bc824b8dd499e696/users/28641197fb9b472dbe0aecd4dac3f4f3/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:30.109304 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e0b61-5459-4f67-9af5-2d33d6edb562 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:30.110009 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e0b61-5459-4f67-9af5-2d33d6edb562 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:30.110508 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e0b61-5459-4f67-9af5-2d33d6edb562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:30.127531 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931e2af6-57f0-40a2-88cd-e39ed610f913 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b77d7fba24894206bc824b8dd499e696, user_id=28641197fb9b472dbe0aecd4dac3f4f3, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:30.131408 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931e2af6-57f0-40a2-88cd-e39ed610f913 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:30.149186 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-503e0b61-5459-4f67-9af5-2d33d6edb562 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:30.150937 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-503e0b61-5459-4f67-9af5-2d33d6edb562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:30.164173 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 775/1551] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:31:30 2022] PUT /identity/v3/projects/b77d7fba24894206bc824b8dd499e696/users/28641197fb9b472dbe0aecd4dac3f4f3/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:31:30.166094 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc9d97-9bd2-4a58-8ff4-b5ec4d6d23a8 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:30.166828 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc9d97-9bd2-4a58-8ff4-b5ec4d6d23a8 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:30.168980 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc9d97-9bd2-4a58-8ff4-b5ec4d6d23a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:30.207687 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-67bc9d97-9bd2-4a58-8ff4-b5ec4d6d23a8 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:30.209193 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-67bc9d97-9bd2-4a58-8ff4-b5ec4d6d23a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:30.255645 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 777/1552] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:31:30.256985 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45a989-0127-407b-a44a-0cef4fcd2a93 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:30.257269 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45a989-0127-407b-a44a-0cef4fcd2a93 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:30.257540 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45a989-0127-407b-a44a-0cef4fcd2a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:30.276470 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-ce45a989-0127-407b-a44a-0cef4fcd2a93 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:30.277686 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-ce45a989-0127-407b-a44a-0cef4fcd2a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:30.282653 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 776/1553] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:30.283251 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25eac8-a549-4bfb-8be6-743287b6485c None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:30.283534 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25eac8-a549-4bfb-8be6-743287b6485c None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:30.283837 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25eac8-a549-4bfb-8be6-743287b6485c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:30.290800 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 778/1554] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:30.292060 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83a420-fb03-4afb-8634-f622dd31033d None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:30.293222 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83a420-fb03-4afb-8634-f622dd31033d None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:30.293222 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83a420-fb03-4afb-8634-f622dd31033d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:30.303529 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-4c25eac8-a549-4bfb-8be6-743287b6485c None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:30.304712 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-4c25eac8-a549-4bfb-8be6-743287b6485c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:30.311409 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-5d83a420-fb03-4afb-8634-f622dd31033d None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:30.312557 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-5d83a420-fb03-4afb-8634-f622dd31033d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:30.313579 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 777/1555] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:30.315083 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc124e-d940-4f32-9d28-a549632d708e None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:30.315349 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc124e-d940-4f32-9d28-a549632d708e None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:30.315628 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc124e-d940-4f32-9d28-a549632d708e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:30.320502 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 779/1556] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:30.321737 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0006e-3de6-438d-b0ea-e2bc070654dd None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:30.322024 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0006e-3de6-438d-b0ea-e2bc070654dd None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:30.322303 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0006e-3de6-438d-b0ea-e2bc070654dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:30.334952 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-4adc124e-d940-4f32-9d28-a549632d708e None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:30.336301 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-4adc124e-d940-4f32-9d28-a549632d708e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:30.343173 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-5ca0006e-3de6-438d-b0ea-e2bc070654dd None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:30.344347 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-5ca0006e-3de6-438d-b0ea-e2bc070654dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:30.344801 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 778/1557] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:30.346084 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf8b51-3eb3-4d64-ab80-82c1d71ca3e4 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:30.346370 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf8b51-3eb3-4d64-ab80-82c1d71ca3e4 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:30.346668 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf8b51-3eb3-4d64-ab80-82c1d71ca3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:30.359707 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 780/1558] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:30.360650 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0006e-3de6-438d-b0ea-e2bc070654dd None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:30.370034 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0006e-3de6-438d-b0ea-e2bc070654dd None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:30.371528 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-c1cf8b51-3eb3-4d64-ab80-82c1d71ca3e4 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:30.372735 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-c1cf8b51-3eb3-4d64-ab80-82c1d71ca3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:30.379178 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3dae4-e1b1-4e03-823c-12251ca6a68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:30.379885 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3dae4-e1b1-4e03-823c-12251ca6a68a admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:30.380165 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3dae4-e1b1-4e03-823c-12251ca6a68a admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:30.380439 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3dae4-e1b1-4e03-823c-12251ca6a68a admin admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:30.381154 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba3dae4-e1b1-4e03-823c-12251ca6a68a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:31:30.381374 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 779/1559] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:30.386051 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba3dae4-e1b1-4e03-823c-12251ca6a68a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:30.386742 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c5db6-359a-43c9-bdb9-a7ea31f4d823 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:30.386742 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c5db6-359a-43c9-bdb9-a7ea31f4d823 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:30.386742 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c5db6-359a-43c9-bdb9-a7ea31f4d823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:30.386983 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba3dae4-e1b1-4e03-823c-12251ca6a68a admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:30.398180 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 781/1560] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:31:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:31:30.401192 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9568d23-22bb-4798-97c7-17d390fe3f41 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:30.401740 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9568d23-22bb-4798-97c7-17d390fe3f41 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:30.402217 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9568d23-22bb-4798-97c7-17d390fe3f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:30.403732 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-011c5db6-359a-43c9-bdb9-a7ea31f4d823 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:30.404960 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-011c5db6-359a-43c9-bdb9-a7ea31f4d823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:30.413845 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 780/1561] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:30.415145 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee17b6d-edff-4280-aa58-7cb4686e9234 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:30.415428 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee17b6d-edff-4280-aa58-7cb4686e9234 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:30.415701 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee17b6d-edff-4280-aa58-7cb4686e9234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:30.423198 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-a9568d23-22bb-4798-97c7-17d390fe3f41 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:30.424389 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-a9568d23-22bb-4798-97c7-17d390fe3f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:30.433856 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-6ee17b6d-edff-4280-aa58-7cb4686e9234 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:30.437911 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 782/1562] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:30.438041 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-6ee17b6d-edff-4280-aa58-7cb4686e9234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:30.438144 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9568d23-22bb-4798-97c7-17d390fe3f41 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:30.446000 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 781/1563] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:30.447294 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fabe7c-f966-487b-85a8-9d69fdc3a377 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:30.447576 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fabe7c-f966-487b-85a8-9d69fdc3a377 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:30.447851 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fabe7c-f966-487b-85a8-9d69fdc3a377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:30.466903 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-27fabe7c-f966-487b-85a8-9d69fdc3a377 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:30.467978 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-27fabe7c-f966-487b-85a8-9d69fdc3a377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:30.475917 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 782/1564] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:30.477202 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc543a7-fa86-4dfc-bf24-89dae099dc33 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:30.477540 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc543a7-fa86-4dfc-bf24-89dae099dc33 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:30.477805 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc543a7-fa86-4dfc-bf24-89dae099dc33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:30.491723 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9568d23-22bb-4798-97c7-17d390fe3f41 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:30.495247 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbecb840-639f-4ace-8cdb-c6ce5d644673 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:30.496411 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbecb840-639f-4ace-8cdb-c6ce5d644673 service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:30.496569 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-0dc543a7-fa86-4dfc-bf24-89dae099dc33 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:30.496723 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbecb840-639f-4ace-8cdb-c6ce5d644673 service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:30.496950 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbecb840-639f-4ace-8cdb-c6ce5d644673 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:30.497617 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-0dc543a7-fa86-4dfc-bf24-89dae099dc33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:30.505305 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 783/1565] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:30.505859 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbecb840-639f-4ace-8cdb-c6ce5d644673 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:30.506547 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778bfbcd-f477-487f-8ad7-3076f91600fc None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:30.506865 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778bfbcd-f477-487f-8ad7-3076f91600fc None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:30.507138 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778bfbcd-f477-487f-8ad7-3076f91600fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:30.507328 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbecb840-639f-4ace-8cdb-c6ce5d644673 service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:30.517158 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 783/1566] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:31:30.517930 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbecb840-639f-4ace-8cdb-c6ce5d644673 service neutron] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:30.524818 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-778bfbcd-f477-487f-8ad7-3076f91600fc None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:30.525996 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-778bfbcd-f477-487f-8ad7-3076f91600fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:30.527181 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbecb840-639f-4ace-8cdb-c6ce5d644673 service neutron] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:30.532287 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24cf17b-fd43-40aa-a650-90bba7c60019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:30.532548 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24cf17b-fd43-40aa-a650-90bba7c60019 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:30.532836 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24cf17b-fd43-40aa-a650-90bba7c60019 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:30.533109 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24cf17b-fd43-40aa-a650-90bba7c60019 admin admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:30.533789 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24cf17b-fd43-40aa-a650-90bba7c60019 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:30.535717 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24cf17b-fd43-40aa-a650-90bba7c60019 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:30.535973 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 784/1567] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:30.537009 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778bfbcd-f477-487f-8ad7-3076f91600fc None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:30.548236 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778bfbcd-f477-487f-8ad7-3076f91600fc None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:30.553091 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b759b56-f3f9-4488-83aa-bdfc347a1cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:30.553740 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b759b56-f3f9-4488-83aa-bdfc347a1cae admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:30.554370 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b759b56-f3f9-4488-83aa-bdfc347a1cae admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:30.554370 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b759b56-f3f9-4488-83aa-bdfc347a1cae admin admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:30.555393 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b759b56-f3f9-4488-83aa-bdfc347a1cae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:31:30.555683 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b759b56-f3f9-4488-83aa-bdfc347a1cae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:30.557514 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b759b56-f3f9-4488-83aa-bdfc347a1cae admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:30.572009 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 784/1568] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:31:30 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:31:30.572450 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 785/1569] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:31:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:31:30.573269 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24cf17b-fd43-40aa-a650-90bba7c60019 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:30.573379 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b759b56-f3f9-4488-83aa-bdfc347a1cae admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:30.588547 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b759b56-f3f9-4488-83aa-bdfc347a1cae admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:30.655334 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd235e0-fe29-45e3-b5b5-41a2b68aeaa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:30.656050 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd235e0-fe29-45e3-b5b5-41a2b68aeaa2 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:30.656346 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd235e0-fe29-45e3-b5b5-41a2b68aeaa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:30.656623 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd235e0-fe29-45e3-b5b5-41a2b68aeaa2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:30.657462 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd235e0-fe29-45e3-b5b5-41a2b68aeaa2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:31:30.657725 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd235e0-fe29-45e3-b5b5-41a2b68aeaa2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:30.659377 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd235e0-fe29-45e3-b5b5-41a2b68aeaa2 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:30.663357 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24cf17b-fd43-40aa-a650-90bba7c60019 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:30.668798 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb4248-bca4-4fe9-9216-8197303738b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:30.669554 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb4248-bca4-4fe9-9216-8197303738b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:30.670193 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb4248-bca4-4fe9-9216-8197303738b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:30.670678 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb4248-bca4-4fe9-9216-8197303738b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:30.671403 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb4248-bca4-4fe9-9216-8197303738b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:31:30.671708 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb4248-bca4-4fe9-9216-8197303738b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:30.680170 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 786/1570] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:31:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:31:30.680170 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd235e0-fe29-45e3-b5b5-41a2b68aeaa2 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:30.680462 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb4248-bca4-4fe9-9216-8197303738b7 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:30.690047 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 785/1571] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:31:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:31:30.691486 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb4248-bca4-4fe9-9216-8197303738b7 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:30.691904 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd235e0-fe29-45e3-b5b5-41a2b68aeaa2 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:30.701457 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183f813-9317-4215-a07b-cd90772e4552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:30.702412 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183f813-9317-4215-a07b-cd90772e4552 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:30.703308 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183f813-9317-4215-a07b-cd90772e4552 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:30.703655 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183f813-9317-4215-a07b-cd90772e4552 admin admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:30.704758 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d183f813-9317-4215-a07b-cd90772e4552 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:31:30.705158 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d183f813-9317-4215-a07b-cd90772e4552 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:30.706493 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb4248-bca4-4fe9-9216-8197303738b7 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:30.707301 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d183f813-9317-4215-a07b-cd90772e4552 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:30.711660 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c2b75-149b-4da2-a40d-820852303dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:30.714467 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c2b75-149b-4da2-a40d-820852303dcd admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:30.714467 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c2b75-149b-4da2-a40d-820852303dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:30.714467 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c2b75-149b-4da2-a40d-820852303dcd admin admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:30.714467 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c2b75-149b-4da2-a40d-820852303dcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:31:30.714467 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c2b75-149b-4da2-a40d-820852303dcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:30.715968 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c2b75-149b-4da2-a40d-820852303dcd admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:30.727856 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 787/1572] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:31:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:31:30.728443 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183f813-9317-4215-a07b-cd90772e4552 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:30.738453 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 786/1573] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:31:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:31:30.739724 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c2b75-149b-4da2-a40d-820852303dcd admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:30.749991 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183f813-9317-4215-a07b-cd90772e4552 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:30.754826 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c2b75-149b-4da2-a40d-820852303dcd admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:30.761415 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ca2b6-89fa-439e-995b-f4defd02e973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:30.761415 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ca2b6-89fa-439e-995b-f4defd02e973 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:30.761415 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ca2b6-89fa-439e-995b-f4defd02e973 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:30.761415 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ca2b6-89fa-439e-995b-f4defd02e973 admin admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:30.763792 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f9ae0-9ebd-491f-88b2-17f96a6d06c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:30.763886 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ca2b6-89fa-439e-995b-f4defd02e973 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:30.763971 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f9ae0-9ebd-491f-88b2-17f96a6d06c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:30.763971 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f9ae0-9ebd-491f-88b2-17f96a6d06c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:30.763971 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f9ae0-9ebd-491f-88b2-17f96a6d06c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:30.764191 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ca2b6-89fa-439e-995b-f4defd02e973 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:30.764268 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f9ae0-9ebd-491f-88b2-17f96a6d06c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:31:30.764934 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f9ae0-9ebd-491f-88b2-17f96a6d06c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:30.767235 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f9ae0-9ebd-491f-88b2-17f96a6d06c2 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:30.789782 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 788/1574] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:31:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:31:30.789782 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f9ae0-9ebd-491f-88b2-17f96a6d06c2 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:30.797270 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f9ae0-9ebd-491f-88b2-17f96a6d06c2 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:30.801947 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 787/1575] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:31:30 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:31:30.801947 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ca2b6-89fa-439e-995b-f4defd02e973 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:30.875318 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed7471-2b2d-457f-9b04-bd7c1cf5400e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:30.876001 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed7471-2b2d-457f-9b04-bd7c1cf5400e admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:30.876285 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed7471-2b2d-457f-9b04-bd7c1cf5400e admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:30.876560 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed7471-2b2d-457f-9b04-bd7c1cf5400e admin admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:30.877312 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed7471-2b2d-457f-9b04-bd7c1cf5400e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:30.879423 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed7471-2b2d-457f-9b04-bd7c1cf5400e admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:30.892498 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ca2b6-89fa-439e-995b-f4defd02e973 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:30.898797 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e568e-c0a5-4170-a822-85cb916c82ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:30.899499 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e568e-c0a5-4170-a822-85cb916c82ed admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:30.899761 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e568e-c0a5-4170-a822-85cb916c82ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:30.900134 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e568e-c0a5-4170-a822-85cb916c82ed admin admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:30.901036 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e568e-c0a5-4170-a822-85cb916c82ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:30.903099 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e568e-c0a5-4170-a822-85cb916c82ed admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:30.904929 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 789/1576] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:31:30 2022] POST /identity/v3/users => generated 287 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:31:30.907610 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed7471-2b2d-457f-9b04-bd7c1cf5400e admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:30.925264 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed7471-2b2d-457f-9b04-bd7c1cf5400e admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:30.932146 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6137e5-60bb-4875-8591-8802b259d891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:30.932943 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6137e5-60bb-4875-8591-8802b259d891 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:30.933734 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6137e5-60bb-4875-8591-8802b259d891 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:30.934091 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6137e5-60bb-4875-8591-8802b259d891 admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:30.934854 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6137e5-60bb-4875-8591-8802b259d891 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:30.937379 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6137e5-60bb-4875-8591-8802b259d891 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:30.943330 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 788/1577] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:31:30 2022] POST /identity/v3/projects => generated 379 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:31:30.944422 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e568e-c0a5-4170-a822-85cb916c82ed admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:30.991151 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 790/1578] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:31:30 2022] POST /identity/v3/projects => generated 375 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:31:30.995891 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6137e5-60bb-4875-8591-8802b259d891 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:31.021612 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e568e-c0a5-4170-a822-85cb916c82ed admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:31.074529 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6137e5-60bb-4875-8591-8802b259d891 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:31.079813 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1058846-6dc8-4cc8-a1d5-59ccd32ce198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:31.080890 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1058846-6dc8-4cc8-a1d5-59ccd32ce198 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:31.081389 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1058846-6dc8-4cc8-a1d5-59ccd32ce198 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:31.081850 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1058846-6dc8-4cc8-a1d5-59ccd32ce198 admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:31.082770 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1058846-6dc8-4cc8-a1d5-59ccd32ce198 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:31.085156 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1058846-6dc8-4cc8-a1d5-59ccd32ce198 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:31.093738 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba26fc-a98c-4017-9b4c-6e998df7b9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:31.095626 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba26fc-a98c-4017-9b4c-6e998df7b9f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:31.095626 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba26fc-a98c-4017-9b4c-6e998df7b9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:31.095626 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba26fc-a98c-4017-9b4c-6e998df7b9f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:31.095963 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba26fc-a98c-4017-9b4c-6e998df7b9f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:31.097776 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba26fc-a98c-4017-9b4c-6e998df7b9f4 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:31.118968 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 791/1579] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:31:30 2022] POST /identity/v3/projects => generated 405 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:31:31.118968 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1058846-6dc8-4cc8-a1d5-59ccd32ce198 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:31.129945 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 789/1580] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:31:30 2022] POST /identity/v3/projects => generated 385 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:31:31.131144 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba26fc-a98c-4017-9b4c-6e998df7b9f4 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:31.188534 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1058846-6dc8-4cc8-a1d5-59ccd32ce198 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:31.204845 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba26fc-a98c-4017-9b4c-6e998df7b9f4 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:31.211938 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f73612-347b-43e1-806f-ad7958996de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:31.212619 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f73612-347b-43e1-806f-ad7958996de7 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:31.212899 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f73612-347b-43e1-806f-ad7958996de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:31.213175 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f73612-347b-43e1-806f-ad7958996de7 admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:31.214023 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f73612-347b-43e1-806f-ad7958996de7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:31.217001 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f73612-347b-43e1-806f-ad7958996de7 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:31.245161 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 790/1581] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:31:31 2022] POST /identity/v3/users => generated 288 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:31:31.246472 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f73612-347b-43e1-806f-ad7958996de7 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:31.259959 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f73612-347b-43e1-806f-ad7958996de7 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:31.267211 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029d7f5-e08b-4846-b69b-b408687b73fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:31.267972 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029d7f5-e08b-4846-b69b-b408687b73fd admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:31.268320 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029d7f5-e08b-4846-b69b-b408687b73fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:31.268691 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029d7f5-e08b-4846-b69b-b408687b73fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:31.269564 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16523c4-8faf-4103-a102-1d4a054157c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:31.269720 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1029d7f5-e08b-4846-b69b-b408687b73fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:31.270242 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16523c4-8faf-4103-a102-1d4a054157c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:31.270571 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16523c4-8faf-4103-a102-1d4a054157c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:31.270889 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16523c4-8faf-4103-a102-1d4a054157c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:31.271607 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1029d7f5-e08b-4846-b69b-b408687b73fd admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:31.271731 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16523c4-8faf-4103-a102-1d4a054157c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:31.274127 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16523c4-8faf-4103-a102-1d4a054157c1 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:31.285863 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 791/1582] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:31:31.286996 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029d7f5-e08b-4846-b69b-b408687b73fd admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:31.301869 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029d7f5-e08b-4846-b69b-b408687b73fd admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:31.308469 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602badbd-6acd-4bfd-b9db-5245f5bfdce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:31.309236 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602badbd-6acd-4bfd-b9db-5245f5bfdce3 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:31.309616 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602badbd-6acd-4bfd-b9db-5245f5bfdce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:31.309960 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602badbd-6acd-4bfd-b9db-5245f5bfdce3 admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:31.310770 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602badbd-6acd-4bfd-b9db-5245f5bfdce3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:31.313515 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 792/1583] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:31:31 2022] POST /identity/v3/projects => generated 385 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:31:31.314385 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16523c4-8faf-4103-a102-1d4a054157c1 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:31.318075 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602badbd-6acd-4bfd-b9db-5245f5bfdce3 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:31.344398 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 792/1584] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:31:31 2022] POST /identity/v3/users => generated 290 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:31:31.345457 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602badbd-6acd-4bfd-b9db-5245f5bfdce3 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:31.359172 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602badbd-6acd-4bfd-b9db-5245f5bfdce3 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:31.402473 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16523c4-8faf-4103-a102-1d4a054157c1 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:31.408416 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3dd64-3808-4318-b19d-74750425c80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:31.409283 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3dd64-3808-4318-b19d-74750425c80e admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:31.409712 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3dd64-3808-4318-b19d-74750425c80e admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:31.410143 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3dd64-3808-4318-b19d-74750425c80e admin admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:31.411692 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe3dd64-3808-4318-b19d-74750425c80e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:31.413975 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe3dd64-3808-4318-b19d-74750425c80e admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:31.426021 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c77d29-917e-4334-bfa1-c29e0fe041ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:31.426616 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c77d29-917e-4334-bfa1-c29e0fe041ed admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:31.427693 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c77d29-917e-4334-bfa1-c29e0fe041ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:31.427693 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c77d29-917e-4334-bfa1-c29e0fe041ed admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:31.428160 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c77d29-917e-4334-bfa1-c29e0fe041ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:31.430531 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c77d29-917e-4334-bfa1-c29e0fe041ed admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:31.448347 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 793/1585] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:31:31 2022] POST /identity/v3/users => generated 288 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:31:31.450007 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3dd64-3808-4318-b19d-74750425c80e admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:31.457002 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 793/1586] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:31:31 2022] POST /identity/v3/users => generated 303 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:31:31.458284 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c77d29-917e-4334-bfa1-c29e0fe041ed admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:31.463213 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3dd64-3808-4318-b19d-74750425c80e admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:31.469021 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f5ec9-fe95-460e-8470-244c42a9f2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:31.469700 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f5ec9-fe95-460e-8470-244c42a9f2a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:31.469985 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f5ec9-fe95-460e-8470-244c42a9f2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:31.470277 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f5ec9-fe95-460e-8470-244c42a9f2a4 admin admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:31.470997 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f5ec9-fe95-460e-8470-244c42a9f2a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:31.473008 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f5ec9-fe95-460e-8470-244c42a9f2a4 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:31.475581 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c77d29-917e-4334-bfa1-c29e0fe041ed admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:31.486076 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ce9127-0bad-4c16-8856-3e54b85cf9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:31.486746 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce9127-0bad-4c16-8856-3e54b85cf9b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:31.487007 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce9127-0bad-4c16-8856-3e54b85cf9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:31.487281 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce9127-0bad-4c16-8856-3e54b85cf9b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:31.488139 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ce9127-0bad-4c16-8856-3e54b85cf9b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:31.489821 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ce9127-0bad-4c16-8856-3e54b85cf9b1 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:31.497432 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 794/1587] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:31:31 2022] POST /identity/v3/users => generated 293 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:31:31.498876 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f5ec9-fe95-460e-8470-244c42a9f2a4 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:31.501409 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 794/1588] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:31:31.502503 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ce9127-0bad-4c16-8856-3e54b85cf9b1 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:31.514438 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ce9127-0bad-4c16-8856-3e54b85cf9b1 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:31.515222 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f5ec9-fe95-460e-8470-244c42a9f2a4 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:31.519442 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d96a1-5a10-4a24-8439-02c02315fb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:31.520125 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d96a1-5a10-4a24-8439-02c02315fb92 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:31.520407 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d96a1-5a10-4a24-8439-02c02315fb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:31.520682 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d96a1-5a10-4a24-8439-02c02315fb92 admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:31.520985 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613ebfb-e3ef-4451-8ae9-56e7409dca6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:31.521377 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87d96a1-5a10-4a24-8439-02c02315fb92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:31.521983 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613ebfb-e3ef-4451-8ae9-56e7409dca6d admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:31.522591 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613ebfb-e3ef-4451-8ae9-56e7409dca6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:31.523231 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613ebfb-e3ef-4451-8ae9-56e7409dca6d admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:31.523349 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87d96a1-5a10-4a24-8439-02c02315fb92 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:31.524352 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a613ebfb-e3ef-4451-8ae9-56e7409dca6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:31.526346 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a613ebfb-e3ef-4451-8ae9-56e7409dca6d admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:31.541202 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 795/1589] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:31:31.542516 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613ebfb-e3ef-4451-8ae9-56e7409dca6d admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:31.545394 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 795/1590] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:31:31 2022] POST /identity/v3/users => generated 293 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:31:31.546356 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d96a1-5a10-4a24-8439-02c02315fb92 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:31.554691 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613ebfb-e3ef-4451-8ae9-56e7409dca6d admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:31.557057 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d96a1-5a10-4a24-8439-02c02315fb92 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:31.559672 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6057f51-614e-41be-9240-550e443e1fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:31.560339 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6057f51-614e-41be-9240-550e443e1fcd admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:31.560621 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6057f51-614e-41be-9240-550e443e1fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:31.560886 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6057f51-614e-41be-9240-550e443e1fcd admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:31.561602 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6057f51-614e-41be-9240-550e443e1fcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:31.562366 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823974ed-480b-40d2-95eb-6be8d7080989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:31.563097 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823974ed-480b-40d2-95eb-6be8d7080989 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:31.563204 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6057f51-614e-41be-9240-550e443e1fcd admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:31.563390 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823974ed-480b-40d2-95eb-6be8d7080989 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:31.563655 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823974ed-480b-40d2-95eb-6be8d7080989 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:31.564379 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823974ed-480b-40d2-95eb-6be8d7080989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:31.566389 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823974ed-480b-40d2-95eb-6be8d7080989 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:31.575642 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 796/1591] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:31:31.577357 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6057f51-614e-41be-9240-550e443e1fcd admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:31.579087 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 796/1592] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:31:31.579969 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823974ed-480b-40d2-95eb-6be8d7080989 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:31.590059 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6057f51-614e-41be-9240-550e443e1fcd admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:31.591605 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823974ed-480b-40d2-95eb-6be8d7080989 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:31.595212 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0fd748-3560-4132-a400-a86e96b2281a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:31.595870 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fd748-3560-4132-a400-a86e96b2281a admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:31.596155 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fd748-3560-4132-a400-a86e96b2281a admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:31.596422 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fd748-3560-4132-a400-a86e96b2281a admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:31.597143 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0fd748-3560-4132-a400-a86e96b2281a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:31.598385 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398ca34-bb71-45f6-a131-b8c2216cd7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:31.598782 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0fd748-3560-4132-a400-a86e96b2281a admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:31.599417 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398ca34-bb71-45f6-a131-b8c2216cd7fa admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:31.599851 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398ca34-bb71-45f6-a131-b8c2216cd7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:31.600316 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398ca34-bb71-45f6-a131-b8c2216cd7fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:31.601379 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4398ca34-bb71-45f6-a131-b8c2216cd7fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:31.603348 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4398ca34-bb71-45f6-a131-b8c2216cd7fa admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:31.610732 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 797/1593] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:31:31.610732 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0fd748-3560-4132-a400-a86e96b2281a admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:31.618676 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 797/1594] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:31:31.620319 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398ca34-bb71-45f6-a131-b8c2216cd7fa admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:31.622228 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0fd748-3560-4132-a400-a86e96b2281a admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:31.627640 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56b48a-5883-4cab-8347-b01e1b03de10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:31.628599 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56b48a-5883-4cab-8347-b01e1b03de10 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:31.628883 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56b48a-5883-4cab-8347-b01e1b03de10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:31.629158 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56b48a-5883-4cab-8347-b01e1b03de10 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:31.629973 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56b48a-5883-4cab-8347-b01e1b03de10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:31.630388 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398ca34-bb71-45f6-a131-b8c2216cd7fa admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:31.631785 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56b48a-5883-4cab-8347-b01e1b03de10 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:31.635443 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf26a0-8aff-4da2-9008-b13ff6769f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:31.637145 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf26a0-8aff-4da2-9008-b13ff6769f78 admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:31.637440 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf26a0-8aff-4da2-9008-b13ff6769f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:31.637672 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf26a0-8aff-4da2-9008-b13ff6769f78 admin admin] PATH_INFO: `/v3/projects/100f86b605bb41ecb2187e3dcfa2dc76/users/1d367c7ea49143e3a3b23b788b256d4e/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:31.646905 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 798/1595] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:31:31.646905 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56b48a-5883-4cab-8347-b01e1b03de10 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:31.653175 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf26a0-8aff-4da2-9008-b13ff6769f78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=100f86b605bb41ecb2187e3dcfa2dc76, user_id=1d367c7ea49143e3a3b23b788b256d4e, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:31.654269 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING py.warnings [None req-bebf26a0-8aff-4da2-9008-b13ff6769f78 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 10:31:31.654269 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: warnings.warn(msg) Feb 28 10:31:31.654269 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: Feb 28 10:31:31.656200 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf26a0-8aff-4da2-9008-b13ff6769f78 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:31.657397 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56b48a-5883-4cab-8347-b01e1b03de10 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:31.662642 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b21a3-9c96-48ce-b00f-dc27380cc20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:31.663452 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b21a3-9c96-48ce-b00f-dc27380cc20a admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:31.663844 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b21a3-9c96-48ce-b00f-dc27380cc20a admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:31.664115 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b21a3-9c96-48ce-b00f-dc27380cc20a admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:31.664892 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4b21a3-9c96-48ce-b00f-dc27380cc20a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:31.666491 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4b21a3-9c96-48ce-b00f-dc27380cc20a admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:31.670674 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 798/1596] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:31:31 2022] PUT /identity/v3/projects/100f86b605bb41ecb2187e3dcfa2dc76/users/1d367c7ea49143e3a3b23b788b256d4e/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:31:31.672679 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf26a0-8aff-4da2-9008-b13ff6769f78 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:31.678573 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 799/1597] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:31:31.679497 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b21a3-9c96-48ce-b00f-dc27380cc20a admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:31.690037 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b21a3-9c96-48ce-b00f-dc27380cc20a admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:31.746541 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf26a0-8aff-4da2-9008-b13ff6769f78 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:31.751341 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd0fe1-7c2d-4210-9ed6-22aaff8483ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:31.752185 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd0fe1-7c2d-4210-9ed6-22aaff8483ee admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:31.752395 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd0fe1-7c2d-4210-9ed6-22aaff8483ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:31.752665 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd0fe1-7c2d-4210-9ed6-22aaff8483ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:31.753379 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabd0fe1-7c2d-4210-9ed6-22aaff8483ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:31.755005 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabd0fe1-7c2d-4210-9ed6-22aaff8483ee admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:31.756199 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f775fe-8d7d-4fb8-bbf0-619aa2dab19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:31.756939 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f775fe-8d7d-4fb8-bbf0-619aa2dab19c admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:31.757222 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f775fe-8d7d-4fb8-bbf0-619aa2dab19c admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:31.757502 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f775fe-8d7d-4fb8-bbf0-619aa2dab19c admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:31.758312 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f775fe-8d7d-4fb8-bbf0-619aa2dab19c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:31.759978 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f775fe-8d7d-4fb8-bbf0-619aa2dab19c admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:31.765525 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 799/1598] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:31:31.765525 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd0fe1-7c2d-4210-9ed6-22aaff8483ee admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:31.779053 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 800/1599] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:31:31.779053 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f775fe-8d7d-4fb8-bbf0-619aa2dab19c admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:31.781630 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd0fe1-7c2d-4210-9ed6-22aaff8483ee admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:31.786390 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a91df6-1e2d-4e72-b851-1577191fa625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:31.787125 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a91df6-1e2d-4e72-b851-1577191fa625 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:31.787410 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a91df6-1e2d-4e72-b851-1577191fa625 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:31.787684 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a91df6-1e2d-4e72-b851-1577191fa625 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:31.788408 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a91df6-1e2d-4e72-b851-1577191fa625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:31.789047 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f775fe-8d7d-4fb8-bbf0-619aa2dab19c admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:31.789990 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a91df6-1e2d-4e72-b851-1577191fa625 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:31.794049 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0498b3-9329-4755-822d-037fccd0ca25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:31.794739 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0498b3-9329-4755-822d-037fccd0ca25 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:31.795040 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0498b3-9329-4755-822d-037fccd0ca25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:31.795312 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0498b3-9329-4755-822d-037fccd0ca25 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:31.796026 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0498b3-9329-4755-822d-037fccd0ca25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:31.797594 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0498b3-9329-4755-822d-037fccd0ca25 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:31.801889 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 800/1600] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:31:31.802617 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a91df6-1e2d-4e72-b851-1577191fa625 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:31.814671 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 801/1601] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:31:31.814880 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a91df6-1e2d-4e72-b851-1577191fa625 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:31.814983 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882daa62-ac44-486b-bbd6-11e0383796b1 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:31.814983 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882daa62-ac44-486b-bbd6-11e0383796b1 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:31.814983 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882daa62-ac44-486b-bbd6-11e0383796b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:31.819798 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e51ae9-7199-4a0d-adc3-5ab53faf8b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:31.820685 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e51ae9-7199-4a0d-adc3-5ab53faf8b5e admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:31.820968 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e51ae9-7199-4a0d-adc3-5ab53faf8b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:31.821246 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e51ae9-7199-4a0d-adc3-5ab53faf8b5e admin admin] PATH_INFO: `/v3/projects/4be56389a99c4e61a4bd82656603ad7e/users/dcd2fb73989043479f425c538315ec5a/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:31.838758 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e51ae9-7199-4a0d-adc3-5ab53faf8b5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4be56389a99c4e61a4bd82656603ad7e, user_id=dcd2fb73989043479f425c538315ec5a, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:31.841139 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-882daa62-ac44-486b-bbd6-11e0383796b1 None None] MFA Rules not processed for user `1d367c7ea49143e3a3b23b788b256d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:31.842352 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-882daa62-ac44-486b-bbd6-11e0383796b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:31.842485 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e51ae9-7199-4a0d-adc3-5ab53faf8b5e admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:31.865448 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 801/1602] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:31:31 2022] PUT /identity/v3/projects/4be56389a99c4e61a4bd82656603ad7e/users/dcd2fb73989043479f425c538315ec5a/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:31:31.866300 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e51ae9-7199-4a0d-adc3-5ab53faf8b5e admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:31.917791 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 802/1603] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:31.917791 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882daa62-ac44-486b-bbd6-11e0383796b1 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:31.925019 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882daa62-ac44-486b-bbd6-11e0383796b1 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:31.929633 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec36a7-c490-4d23-a03f-88588e2bf870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:31.930866 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec36a7-c490-4d23-a03f-88588e2bf870 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:31.930866 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec36a7-c490-4d23-a03f-88588e2bf870 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:31.931088 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec36a7-c490-4d23-a03f-88588e2bf870 admin admin] PATH_INFO: `/v3/projects/16ab7d83969f4e2ea219ab1eb98cf29d/users/15ea80a65cbe4394bb9c7d3b73287655/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:31.936986 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e51ae9-7199-4a0d-adc3-5ab53faf8b5e admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:31.942752 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a4fcd-b662-460a-b4bc-07f0598344fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:31.943599 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a4fcd-b662-460a-b4bc-07f0598344fd admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:31.944021 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a4fcd-b662-460a-b4bc-07f0598344fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:31.944352 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a4fcd-b662-460a-b4bc-07f0598344fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:31.945152 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5a4fcd-b662-460a-b4bc-07f0598344fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:31.946826 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5a4fcd-b662-460a-b4bc-07f0598344fd admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:31.955111 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec36a7-c490-4d23-a03f-88588e2bf870 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16ab7d83969f4e2ea219ab1eb98cf29d, user_id=15ea80a65cbe4394bb9c7d3b73287655, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:31.958271 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec36a7-c490-4d23-a03f-88588e2bf870 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:31.958668 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 802/1604] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:31:31.959648 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a4fcd-b662-460a-b4bc-07f0598344fd admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:31.974635 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a4fcd-b662-460a-b4bc-07f0598344fd admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:31.990700 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 803/1605] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:31:31 2022] PUT /identity/v3/projects/16ab7d83969f4e2ea219ab1eb98cf29d/users/15ea80a65cbe4394bb9c7d3b73287655/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:31:31.992660 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec36a7-c490-4d23-a03f-88588e2bf870 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:32.060719 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047078e5-020e-40c7-9715-876a7a12d9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:32.061938 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047078e5-020e-40c7-9715-876a7a12d9c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:32.063023 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047078e5-020e-40c7-9715-876a7a12d9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:32.063314 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047078e5-020e-40c7-9715-876a7a12d9c2 admin admin] PATH_INFO: `/v3/projects/17631b0e5f9d499f9b830044f7acffa5/users/9f32c16ee62d441d9e5fde2b1ce0afaf/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:32.079539 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047078e5-020e-40c7-9715-876a7a12d9c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17631b0e5f9d499f9b830044f7acffa5, user_id=9f32c16ee62d441d9e5fde2b1ce0afaf, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:32.082147 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047078e5-020e-40c7-9715-876a7a12d9c2 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:32.107470 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec36a7-c490-4d23-a03f-88588e2bf870 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:32.107721 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 803/1606] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:31:31 2022] PUT /identity/v3/projects/17631b0e5f9d499f9b830044f7acffa5/users/9f32c16ee62d441d9e5fde2b1ce0afaf/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:31:32.107721 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047078e5-020e-40c7-9715-876a7a12d9c2 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:32.171703 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c186d-faa8-40d6-b501-652bf3d1604d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:32.171838 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047078e5-020e-40c7-9715-876a7a12d9c2 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:32.172523 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c186d-faa8-40d6-b501-652bf3d1604d admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:32.172965 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c186d-faa8-40d6-b501-652bf3d1604d admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:32.173353 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c186d-faa8-40d6-b501-652bf3d1604d admin admin] PATH_INFO: `/v3/projects/8ed523732df14507bb746c141a78e20d/users/edc3e3c7831a4598a3205046cfc9468d/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:32.177873 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a7e32-47a3-4eb8-b339-e7fc5e9604a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:32.178809 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a7e32-47a3-4eb8-b339-e7fc5e9604a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:32.179090 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a7e32-47a3-4eb8-b339-e7fc5e9604a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:32.179932 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a7e32-47a3-4eb8-b339-e7fc5e9604a8 admin admin] PATH_INFO: `/v3/projects/9147c1b182e84f66a3a839bdae173b74/users/74ccc87e34cd4e7894b0b5be27982f37/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:32.190427 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c186d-faa8-40d6-b501-652bf3d1604d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ed523732df14507bb746c141a78e20d, user_id=edc3e3c7831a4598a3205046cfc9468d, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:32.193117 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c186d-faa8-40d6-b501-652bf3d1604d admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:32.195860 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105a7e32-47a3-4eb8-b339-e7fc5e9604a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9147c1b182e84f66a3a839bdae173b74, user_id=74ccc87e34cd4e7894b0b5be27982f37, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:32.200920 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105a7e32-47a3-4eb8-b339-e7fc5e9604a8 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:32.207555 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 804/1607] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:31:31 2022] PUT /identity/v3/projects/8ed523732df14507bb746c141a78e20d/users/edc3e3c7831a4598a3205046cfc9468d/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:31:32.209473 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49061af9-2a7c-41b2-a831-8b12a4f317a9 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:32.209745 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49061af9-2a7c-41b2-a831-8b12a4f317a9 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:32.210075 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49061af9-2a7c-41b2-a831-8b12a4f317a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:32.221999 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 804/1608] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:31:32 2022] PUT /identity/v3/projects/9147c1b182e84f66a3a839bdae173b74/users/74ccc87e34cd4e7894b0b5be27982f37/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:31:32.228570 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16032dc8-3b8c-4274-8464-dd1741d104d8 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:32.228872 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16032dc8-3b8c-4274-8464-dd1741d104d8 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:32.229133 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16032dc8-3b8c-4274-8464-dd1741d104d8 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:32.232729 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 805/1609] 10.222.0.21 () {54 vars in 961 bytes} [Mon Feb 28 10:31:32 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:31:32.233834 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16032dc8-3b8c-4274-8464-dd1741d104d8 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:32.249603 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-49061af9-2a7c-41b2-a831-8b12a4f317a9 None None] MFA Rules not processed for user `dcd2fb73989043479f425c538315ec5a`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:32.250871 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-49061af9-2a7c-41b2-a831-8b12a4f317a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:32.312138 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16032dc8-3b8c-4274-8464-dd1741d104d8 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:32.322318 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276060ad-a703-4c74-88d6-ba1c454a460d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:32.324660 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 805/1610] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:32.325959 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2b72a-c509-400e-97f0-ced827776bb3 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:32.326845 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276060ad-a703-4c74-88d6-ba1c454a460d admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:32.327127 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276060ad-a703-4c74-88d6-ba1c454a460d admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:32.327509 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276060ad-a703-4c74-88d6-ba1c454a460d admin admin] PATH_INFO: `/v3/projects/003233ff59254fa88847f9adc1437df3/users/da9524bba20140f694ac7cd6e8f37038/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:32.328443 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2b72a-c509-400e-97f0-ced827776bb3 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:32.328715 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2b72a-c509-400e-97f0-ced827776bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:32.348720 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276060ad-a703-4c74-88d6-ba1c454a460d admin admin] RBAC: Authorizing `identity:create_grant(project_id=003233ff59254fa88847f9adc1437df3, user_id=da9524bba20140f694ac7cd6e8f37038, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:32.351443 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276060ad-a703-4c74-88d6-ba1c454a460d admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:32.357675 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-20b2b72a-c509-400e-97f0-ced827776bb3 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:32.359400 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-20b2b72a-c509-400e-97f0-ced827776bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:32.366636 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 806/1611] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:31:32 2022] PUT /identity/v3/projects/003233ff59254fa88847f9adc1437df3/users/da9524bba20140f694ac7cd6e8f37038/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:31:32.368285 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea643af-849a-4f2c-9920-42dcc0be28fa None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:32.368734 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea643af-849a-4f2c-9920-42dcc0be28fa None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:32.369006 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea643af-849a-4f2c-9920-42dcc0be28fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:32.386839 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-8ea643af-849a-4f2c-9920-42dcc0be28fa None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:32.388741 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-8ea643af-849a-4f2c-9920-42dcc0be28fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:32.430400 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 806/1612] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:32.435219 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173de98d-47bb-4087-826e-5426c7fd7955 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:32.435519 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173de98d-47bb-4087-826e-5426c7fd7955 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:32.435798 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173de98d-47bb-4087-826e-5426c7fd7955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:32.449768 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 807/1613] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:32.451354 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533d8f8-1a84-46ed-91a5-edcfdda31cd4 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:32.451640 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533d8f8-1a84-46ed-91a5-edcfdda31cd4 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:32.451919 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533d8f8-1a84-46ed-91a5-edcfdda31cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:32.468167 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-173de98d-47bb-4087-826e-5426c7fd7955 None None] MFA Rules not processed for user `edc3e3c7831a4598a3205046cfc9468d`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:32.469400 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-173de98d-47bb-4087-826e-5426c7fd7955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:32.481666 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-5533d8f8-1a84-46ed-91a5-edcfdda31cd4 None None] MFA Rules not processed for user `74ccc87e34cd4e7894b0b5be27982f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:32.482885 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-5533d8f8-1a84-46ed-91a5-edcfdda31cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:32.536660 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 807/1614] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:32 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:32.537961 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de33c5-0c39-448d-8d53-28310cf8f3fa None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:32.538253 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de33c5-0c39-448d-8d53-28310cf8f3fa None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:32.538530 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de33c5-0c39-448d-8d53-28310cf8f3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:32.551477 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 808/1615] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:32.552954 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca6ae0-5243-4fad-bec1-bf506251f436 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:32.553346 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca6ae0-5243-4fad-bec1-bf506251f436 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:32.553717 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca6ae0-5243-4fad-bec1-bf506251f436 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:32.555521 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 809/1616] 10.222.0.21 () {54 vars in 961 bytes} [Mon Feb 28 10:31:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:31:32.556674 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4e48c-a2f5-465f-9053-25273f218a42 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:32.557056 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4e48c-a2f5-465f-9053-25273f218a42 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:32.557494 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4e48c-a2f5-465f-9053-25273f218a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:32.561695 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-a9de33c5-0c39-448d-8d53-28310cf8f3fa None None] MFA Rules not processed for user `ec202a34db8e47f4a6c18285245e3f5b`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:32.563074 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-a9de33c5-0c39-448d-8d53-28310cf8f3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:32.576663 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-02a4e48c-a2f5-465f-9053-25273f218a42 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:32.577956 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-02a4e48c-a2f5-465f-9053-25273f218a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:32.592434 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 810/1617] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:32.592434 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4e48c-a2f5-465f-9053-25273f218a42 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:32.592434 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-02a4e48c-a2f5-465f-9053-25273f218a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:32.638209 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 808/1618] 10.222.0.21 () {58 vars in 1058 bytes} [Mon Feb 28 10:31:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:32.639264 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de33c5-0c39-448d-8d53-28310cf8f3fa None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:32.655078 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4e48c-a2f5-465f-9053-25273f218a42 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:32.659343 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e6307-c863-4dc0-a7f3-5e2770797b4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:32.659997 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e6307-c863-4dc0-a7f3-5e2770797b4a service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:32.660277 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e6307-c863-4dc0-a7f3-5e2770797b4a service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:32.660558 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e6307-c863-4dc0-a7f3-5e2770797b4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:32.670007 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e6307-c863-4dc0-a7f3-5e2770797b4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:32.671477 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e6307-c863-4dc0-a7f3-5e2770797b4a service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:32.681381 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 811/1619] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:31:32.681994 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e6307-c863-4dc0-a7f3-5e2770797b4a service neutron] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:32.692815 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e6307-c863-4dc0-a7f3-5e2770797b4a service neutron] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:32.698366 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbde36-6869-4d3a-a1c5-1e85f83d3193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:32.700268 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbde36-6869-4d3a-a1c5-1e85f83d3193 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:32.700567 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbde36-6869-4d3a-a1c5-1e85f83d3193 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:32.700848 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbde36-6869-4d3a-a1c5-1e85f83d3193 admin admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:32.701550 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cbde36-6869-4d3a-a1c5-1e85f83d3193 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:32.701967 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de33c5-0c39-448d-8d53-28310cf8f3fa None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:32.703788 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cbde36-6869-4d3a-a1c5-1e85f83d3193 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:32.707097 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a4f9a-5f72-46ee-8b58-d7222d74f16d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:32.707749 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a4f9a-5f72-46ee-8b58-d7222d74f16d service neutron] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:32.708299 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a4f9a-5f72-46ee-8b58-d7222d74f16d service neutron] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:32.708785 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a4f9a-5f72-46ee-8b58-d7222d74f16d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:32.719319 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900a4f9a-5f72-46ee-8b58-d7222d74f16d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:32.721286 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900a4f9a-5f72-46ee-8b58-d7222d74f16d service neutron] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:32.732722 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 809/1620] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:31:32.733545 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a4f9a-5f72-46ee-8b58-d7222d74f16d service neutron] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:32.735982 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 812/1621] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:31:32 2022] POST /identity/v3/projects => generated 405 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:31:32.737300 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b82b50-40ef-4ace-913f-b92d1b8fc185 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:32.737592 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b82b50-40ef-4ace-913f-b92d1b8fc185 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:32.737872 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b82b50-40ef-4ace-913f-b92d1b8fc185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:32.743590 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a4f9a-5f72-46ee-8b58-d7222d74f16d service neutron] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:32.759394 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-56b82b50-40ef-4ace-913f-b92d1b8fc185 None None] MFA Rules not processed for user `ec202a34db8e47f4a6c18285245e3f5b`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:32.762494 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-56b82b50-40ef-4ace-913f-b92d1b8fc185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:32.813895 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b79a2-97fe-449e-89cf-0c900492b0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:32.814487 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b79a2-97fe-449e-89cf-0c900492b0a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:32.814797 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b79a2-97fe-449e-89cf-0c900492b0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:32.815119 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b79a2-97fe-449e-89cf-0c900492b0a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:32.815813 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b79a2-97fe-449e-89cf-0c900492b0a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:32.817727 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b79a2-97fe-449e-89cf-0c900492b0a2 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:32.867579 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 813/1622] 10.222.0.21 () {58 vars in 1058 bytes} [Mon Feb 28 10:31:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:32.869373 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b82b50-40ef-4ace-913f-b92d1b8fc185 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:32.885263 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 810/1623] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:31:32 2022] POST /identity/v3/projects => generated 387 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:31:32.887136 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b79a2-97fe-449e-89cf-0c900492b0a2 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:32.940869 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b82b50-40ef-4ace-913f-b92d1b8fc185 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:32.986557 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b79a2-97fe-449e-89cf-0c900492b0a2 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:32.993042 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d395b9-39b5-4dd0-a2cb-16e0f5a81f64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec202a34db8e47f4a6c18285245e3f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:32.993737 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d395b9-39b5-4dd0-a2cb-16e0f5a81f64 service nova] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:32.994171 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d395b9-39b5-4dd0-a2cb-16e0f5a81f64 service nova] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:32.994463 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d395b9-39b5-4dd0-a2cb-16e0f5a81f64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:33.005620 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20335db9-66d3-420e-890a-e861cfa54443 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:33.006785 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20335db9-66d3-420e-890a-e861cfa54443 service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:33.007128 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20335db9-66d3-420e-890a-e861cfa54443 service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:33.007407 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20335db9-66d3-420e-890a-e861cfa54443 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:33.088479 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20335db9-66d3-420e-890a-e861cfa54443 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:33.090329 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20335db9-66d3-420e-890a-e861cfa54443 service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:33.102943 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d395b9-39b5-4dd0-a2cb-16e0f5a81f64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:33.104617 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 814/1624] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:31:33.106016 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20335db9-66d3-420e-890a-e861cfa54443 service neutron] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:33.109746 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d395b9-39b5-4dd0-a2cb-16e0f5a81f64 service nova] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:33.119418 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20335db9-66d3-420e-890a-e861cfa54443 service neutron] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:33.125761 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75bc2ec-4fa0-41ae-a033-8c1b1ae0c769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:33.126471 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75bc2ec-4fa0-41ae-a033-8c1b1ae0c769 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:33.126906 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75bc2ec-4fa0-41ae-a033-8c1b1ae0c769 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:33.127186 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75bc2ec-4fa0-41ae-a033-8c1b1ae0c769 admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:33.128007 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75bc2ec-4fa0-41ae-a033-8c1b1ae0c769 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:33.130041 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75bc2ec-4fa0-41ae-a033-8c1b1ae0c769 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:33.132128 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 811/1625] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:31:33.133148 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d395b9-39b5-4dd0-a2cb-16e0f5a81f64 service nova] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:33.149256 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d395b9-39b5-4dd0-a2cb-16e0f5a81f64 service nova] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:33.159139 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0addbb8a-b06c-400b-ae9f-2ed2da17a96e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec202a34db8e47f4a6c18285245e3f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:33.160130 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addbb8a-b06c-400b-ae9f-2ed2da17a96e service nova] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:33.160574 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addbb8a-b06c-400b-ae9f-2ed2da17a96e service nova] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:33.161876 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addbb8a-b06c-400b-ae9f-2ed2da17a96e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:33.168559 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 815/1626] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:31:33 2022] POST /identity/v3/users => generated 309 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:31:33.172394 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75bc2ec-4fa0-41ae-a033-8c1b1ae0c769 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:33.190852 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75bc2ec-4fa0-41ae-a033-8c1b1ae0c769 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:33.197266 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14358b-ab6c-49ae-9bc7-b04456df7e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:33.199397 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14358b-ab6c-49ae-9bc7-b04456df7e77 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:33.199921 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14358b-ab6c-49ae-9bc7-b04456df7e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:33.200312 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14358b-ab6c-49ae-9bc7-b04456df7e77 admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:33.201121 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a14358b-ab6c-49ae-9bc7-b04456df7e77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:33.203963 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a14358b-ab6c-49ae-9bc7-b04456df7e77 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:33.233122 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 816/1627] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:31:33 2022] POST /identity/v3/users => generated 300 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:31:33.233122 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14358b-ab6c-49ae-9bc7-b04456df7e77 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:33.251732 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14358b-ab6c-49ae-9bc7-b04456df7e77 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:33.258785 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17ff0f-e0e1-44c3-91ba-3a4038c363a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:33.259635 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17ff0f-e0e1-44c3-91ba-3a4038c363a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:33.260015 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17ff0f-e0e1-44c3-91ba-3a4038c363a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:33.261165 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17ff0f-e0e1-44c3-91ba-3a4038c363a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:33.262093 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b17ff0f-e0e1-44c3-91ba-3a4038c363a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:33.263971 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b17ff0f-e0e1-44c3-91ba-3a4038c363a3 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:33.277303 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0addbb8a-b06c-400b-ae9f-2ed2da17a96e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:33.279131 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0addbb8a-b06c-400b-ae9f-2ed2da17a96e service nova] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:33.280864 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 817/1628] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:31:33.282347 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17ff0f-e0e1-44c3-91ba-3a4038c363a3 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:33.297094 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17ff0f-e0e1-44c3-91ba-3a4038c363a3 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:33.302485 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c3cffa-cbf6-40d5-95b7-caa8e365a0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:33.303432 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c3cffa-cbf6-40d5-95b7-caa8e365a0f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:33.303925 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c3cffa-cbf6-40d5-95b7-caa8e365a0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:33.304247 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c3cffa-cbf6-40d5-95b7-caa8e365a0f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:33.305227 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c3cffa-cbf6-40d5-95b7-caa8e365a0f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:33.307250 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c3cffa-cbf6-40d5-95b7-caa8e365a0f1 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:33.307480 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 812/1629] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:31:33.308360 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0addbb8a-b06c-400b-ae9f-2ed2da17a96e service nova] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:33.334500 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 818/1630] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:31:33.334859 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0addbb8a-b06c-400b-ae9f-2ed2da17a96e service nova] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:33.338841 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c3cffa-cbf6-40d5-95b7-caa8e365a0f1 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:33.348705 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1956283-e318-4991-b278-1f942702b6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:33.349666 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1956283-e318-4991-b278-1f942702b6b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:33.349998 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1956283-e318-4991-b278-1f942702b6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:33.350755 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1956283-e318-4991-b278-1f942702b6b7 admin admin] PATH_INFO: `/v3/projects/47c88acfe79742df81c431dd8c92c7d6/users/872f5a76a3ec46418d8733084b5e9f0e/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:33.361829 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c3cffa-cbf6-40d5-95b7-caa8e365a0f1 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:33.376448 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ce3a7-5b7d-49f1-9e9a-a60971eeb98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:33.377350 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ce3a7-5b7d-49f1-9e9a-a60971eeb98f admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:33.377631 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ce3a7-5b7d-49f1-9e9a-a60971eeb98f admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:33.377902 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ce3a7-5b7d-49f1-9e9a-a60971eeb98f admin admin] PATH_INFO: `/v3/projects/3a6a71f022f448c39cba213967e2b437/users/987a42f02f3c4520b8e2f4377a44bb3c/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:33.387434 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1956283-e318-4991-b278-1f942702b6b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47c88acfe79742df81c431dd8c92c7d6, user_id=872f5a76a3ec46418d8733084b5e9f0e, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:33.389931 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1956283-e318-4991-b278-1f942702b6b7 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:33.405546 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ce3a7-5b7d-49f1-9e9a-a60971eeb98f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a6a71f022f448c39cba213967e2b437, user_id=987a42f02f3c4520b8e2f4377a44bb3c, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:33.408579 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ce3a7-5b7d-49f1-9e9a-a60971eeb98f admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:33.415088 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 813/1631] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:31:33 2022] PUT /identity/v3/projects/47c88acfe79742df81c431dd8c92c7d6/users/872f5a76a3ec46418d8733084b5e9f0e/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:31:33.420089 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1956283-e318-4991-b278-1f942702b6b7 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:33.439489 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 819/1632] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:31:33 2022] PUT /identity/v3/projects/3a6a71f022f448c39cba213967e2b437/users/987a42f02f3c4520b8e2f4377a44bb3c/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:31:33.442856 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ce3a7-5b7d-49f1-9e9a-a60971eeb98f admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:33.541870 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1956283-e318-4991-b278-1f942702b6b7 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:33.573499 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ce3a7-5b7d-49f1-9e9a-a60971eeb98f admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:33.586587 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe117a9e-22e3-445d-9536-2a44c4487d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:33.587301 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe117a9e-22e3-445d-9536-2a44c4487d26 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:33.587578 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe117a9e-22e3-445d-9536-2a44c4487d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:33.587849 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe117a9e-22e3-445d-9536-2a44c4487d26 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:33.588570 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe117a9e-22e3-445d-9536-2a44c4487d26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:33.590521 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe117a9e-22e3-445d-9536-2a44c4487d26 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:33.608485 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 820/1633] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:31:33.609884 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2f9c2-79fc-4508-b141-f42503f6a2b0 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:33.610172 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2f9c2-79fc-4508-b141-f42503f6a2b0 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:33.610445 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2f9c2-79fc-4508-b141-f42503f6a2b0 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:33.624976 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 821/1634] 10.222.0.21 () {54 vars in 912 bytes} [Mon Feb 28 10:31:33 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:31:33.625820 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2f9c2-79fc-4508-b141-f42503f6a2b0 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:33.642178 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3a905-0bab-4104-93c8-bc9c3be23fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:33.642684 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2f9c2-79fc-4508-b141-f42503f6a2b0 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:33.644016 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3a905-0bab-4104-93c8-bc9c3be23fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:33.645046 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3a905-0bab-4104-93c8-bc9c3be23fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:33.646064 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3a905-0bab-4104-93c8-bc9c3be23fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:33.648359 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b3a905-0bab-4104-93c8-bc9c3be23fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:33.652748 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b3a905-0bab-4104-93c8-bc9c3be23fa5 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:33.656813 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe422ce-b647-4d39-85b2-8a8efbe4115f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:33.657723 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe422ce-b647-4d39-85b2-8a8efbe4115f admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:33.658010 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe422ce-b647-4d39-85b2-8a8efbe4115f admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:33.658269 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe422ce-b647-4d39-85b2-8a8efbe4115f admin admin] PATH_INFO: `/v3/projects/3a6a71f022f448c39cba213967e2b437/users/987a42f02f3c4520b8e2f4377a44bb3c/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:33.660441 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe422ce-b647-4d39-85b2-8a8efbe4115f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a6a71f022f448c39cba213967e2b437, user_id=987a42f02f3c4520b8e2f4377a44bb3c, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:33.664842 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe422ce-b647-4d39-85b2-8a8efbe4115f admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:33.680011 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 814/1635] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:31:33.685968 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693dfde1-3425-454f-b2fa-14697dc14854 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:33.687309 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693dfde1-3425-454f-b2fa-14697dc14854 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:33.687821 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693dfde1-3425-454f-b2fa-14697dc14854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:33.700290 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 822/1636] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:31:33 2022] PUT /identity/v3/projects/3a6a71f022f448c39cba213967e2b437/users/987a42f02f3c4520b8e2f4377a44bb3c/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:31:33.709371 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe422ce-b647-4d39-85b2-8a8efbe4115f admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:33.737094 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-693dfde1-3425-454f-b2fa-14697dc14854 None None] MFA Rules not processed for user `ec202a34db8e47f4a6c18285245e3f5b`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:33.740520 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-693dfde1-3425-454f-b2fa-14697dc14854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:33.849349 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe422ce-b647-4d39-85b2-8a8efbe4115f admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:33.854337 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac871d88-d39f-4bb3-aafd-13c51ddcbe5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:33.856226 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac871d88-d39f-4bb3-aafd-13c51ddcbe5e admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:33.856413 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac871d88-d39f-4bb3-aafd-13c51ddcbe5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:33.856699 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac871d88-d39f-4bb3-aafd-13c51ddcbe5e admin admin] PATH_INFO: `/v3/projects/47c88acfe79742df81c431dd8c92c7d6/users/872f5a76a3ec46418d8733084b5e9f0e/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:33.858772 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac871d88-d39f-4bb3-aafd-13c51ddcbe5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=47c88acfe79742df81c431dd8c92c7d6, user_id=872f5a76a3ec46418d8733084b5e9f0e, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:33.864910 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac871d88-d39f-4bb3-aafd-13c51ddcbe5e admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:33.885980 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 823/1637] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:31:33 2022] PUT /identity/v3/projects/47c88acfe79742df81c431dd8c92c7d6/users/872f5a76a3ec46418d8733084b5e9f0e/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:31:33.888033 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2b4c0-0310-4aba-8add-b70864ec346f None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:33.888323 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2b4c0-0310-4aba-8add-b70864ec346f None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:33.888600 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2b4c0-0310-4aba-8add-b70864ec346f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:33.919622 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-07e2b4c0-0310-4aba-8add-b70864ec346f None None] MFA Rules not processed for user `987a42f02f3c4520b8e2f4377a44bb3c`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:33.921078 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-07e2b4c0-0310-4aba-8add-b70864ec346f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:33.926751 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 815/1638] 10.222.0.21 () {58 vars in 1009 bytes} [Mon Feb 28 10:31:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:33.928489 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9306cf-3afe-4346-93ae-1c8e64d6eec6 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:33.928810 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9306cf-3afe-4346-93ae-1c8e64d6eec6 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:33.931700 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9306cf-3afe-4346-93ae-1c8e64d6eec6 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:33.936888 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 816/1639] 10.222.0.21 () {54 vars in 912 bytes} [Mon Feb 28 10:31:33 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:31:33.939494 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882842b7-6b65-4e45-8b11-a26d63f00db1 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:33.939921 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882842b7-6b65-4e45-8b11-a26d63f00db1 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:33.940745 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882842b7-6b65-4e45-8b11-a26d63f00db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:34.000562 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 824/1640] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:34.001502 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2b4c0-0310-4aba-8add-b70864ec346f None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:34.014306 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-882842b7-6b65-4e45-8b11-a26d63f00db1 None None] MFA Rules not processed for user `872f5a76a3ec46418d8733084b5e9f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:34.016361 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-882842b7-6b65-4e45-8b11-a26d63f00db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:34.059247 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2b4c0-0310-4aba-8add-b70864ec346f None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:34.063046 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cda446-7d97-4db5-ac42-607d3342337d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:34.063704 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cda446-7d97-4db5-ac42-607d3342337d service cinder] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:34.063988 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cda446-7d97-4db5-ac42-607d3342337d service cinder] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:34.064265 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cda446-7d97-4db5-ac42-607d3342337d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:34.145332 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cda446-7d97-4db5-ac42-607d3342337d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:34.147110 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cda446-7d97-4db5-ac42-607d3342337d service cinder] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:34.160354 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 825/1641] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:31:34.161777 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41b0e6-3207-44df-92b7-d1bc4f4fba5e None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:34.162068 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41b0e6-3207-44df-92b7-d1bc4f4fba5e None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:34.162542 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41b0e6-3207-44df-92b7-d1bc4f4fba5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:34.178893 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 817/1642] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:33 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:34.179892 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882842b7-6b65-4e45-8b11-a26d63f00db1 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:34.186699 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-9f41b0e6-3207-44df-92b7-d1bc4f4fba5e None None] MFA Rules not processed for user `ec202a34db8e47f4a6c18285245e3f5b`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:34.187931 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-9f41b0e6-3207-44df-92b7-d1bc4f4fba5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:34.198199 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 826/1643] 10.222.0.21 () {58 vars in 1009 bytes} [Mon Feb 28 10:31:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:34.202364 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882842b7-6b65-4e45-8b11-a26d63f00db1 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:34.213344 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf5e3b-1a56-4e74-8e30-40c5d01e91c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:34.214012 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf5e3b-1a56-4e74-8e30-40c5d01e91c1 service cinder] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:34.214458 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf5e3b-1a56-4e74-8e30-40c5d01e91c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:34.214986 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf5e3b-1a56-4e74-8e30-40c5d01e91c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:34.234811 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf5e3b-1a56-4e74-8e30-40c5d01e91c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:34.240509 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf5e3b-1a56-4e74-8e30-40c5d01e91c1 service cinder] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:34.254770 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 818/1644] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:34 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:31:34.302528 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41b0e6-3207-44df-92b7-d1bc4f4fba5e None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:34.311659 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf5e3b-1a56-4e74-8e30-40c5d01e91c1 service cinder] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:34.329160 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf5e3b-1a56-4e74-8e30-40c5d01e91c1 service cinder] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:34.355586 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ceb0ee-d78e-4637-b72a-c9634508ec0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:34.356333 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ceb0ee-d78e-4637-b72a-c9634508ec0f service cinder] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:34.356616 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ceb0ee-d78e-4637-b72a-c9634508ec0f service cinder] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:34.356950 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ceb0ee-d78e-4637-b72a-c9634508ec0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:34.393731 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ceb0ee-d78e-4637-b72a-c9634508ec0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:34.395542 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ceb0ee-d78e-4637-b72a-c9634508ec0f service cinder] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:34.421937 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 819/1645] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:34 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:31:34.427124 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11996b8-e4b1-4cd1-ad33-d1f732a60d95 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:34.427442 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11996b8-e4b1-4cd1-ad33-d1f732a60d95 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:34.427711 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11996b8-e4b1-4cd1-ad33-d1f732a60d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:34.489406 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-b11996b8-e4b1-4cd1-ad33-d1f732a60d95 None None] MFA Rules not processed for user `15ea80a65cbe4394bb9c7d3b73287655`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:34.491140 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-b11996b8-e4b1-4cd1-ad33-d1f732a60d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:34.499482 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41b0e6-3207-44df-92b7-d1bc4f4fba5e None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:34.511662 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f787b1a-f8fb-4ab1-a305-85d9ec54566e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:34.512510 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f787b1a-f8fb-4ab1-a305-85d9ec54566e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:34.512792 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f787b1a-f8fb-4ab1-a305-85d9ec54566e admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:34.513069 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f787b1a-f8fb-4ab1-a305-85d9ec54566e admin admin] PATH_INFO: `/v3/users/74ccc87e34cd4e7894b0b5be27982f37` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:34.536960 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f787b1a-f8fb-4ab1-a305-85d9ec54566e admin admin] RBAC: Authorizing `identity:delete_user(user_id=74ccc87e34cd4e7894b0b5be27982f37)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:34.538954 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: WARNING py.warnings [None req-9f787b1a-f8fb-4ab1-a305-85d9ec54566e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 10:31:34.538954 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: warnings.warn(msg) Feb 28 10:31:34.538954 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: Feb 28 10:31:34.551143 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f787b1a-f8fb-4ab1-a305-85d9ec54566e admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:34.657075 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 820/1646] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:34.658902 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11996b8-e4b1-4cd1-ad33-d1f732a60d95 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:34.675504 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11996b8-e4b1-4cd1-ad33-d1f732a60d95 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:34.683570 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be544015-0749-42b5-8d29-4a8591a12d50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:34.685526 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be544015-0749-42b5-8d29-4a8591a12d50 service cinder] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:34.686005 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be544015-0749-42b5-8d29-4a8591a12d50 service cinder] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:34.686392 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be544015-0749-42b5-8d29-4a8591a12d50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:34.686718 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-9f787b1a-f8fb-4ab1-a305-85d9ec54566e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74ccc87e34cd4e7894b0b5be27982f37'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:34.708529 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-9f787b1a-f8fb-4ab1-a305-85d9ec54566e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74ccc87e34cd4e7894b0b5be27982f37'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:34.709563 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-9f787b1a-f8fb-4ab1-a305-85d9ec54566e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74ccc87e34cd4e7894b0b5be27982f37'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:34.714229 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be544015-0749-42b5-8d29-4a8591a12d50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:34.716293 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be544015-0749-42b5-8d29-4a8591a12d50 service cinder] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:34.732382 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 821/1647] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:31:34.734244 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc0e68-3c8b-4bc9-98fa-835f6951554a None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:34.735132 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc0e68-3c8b-4bc9-98fa-835f6951554a None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:34.735905 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc0e68-3c8b-4bc9-98fa-835f6951554a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:34.755041 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-9f787b1a-f8fb-4ab1-a305-85d9ec54566e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74ccc87e34cd4e7894b0b5be27982f37'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:34.762968 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-f6dc0e68-3c8b-4bc9-98fa-835f6951554a None None] MFA Rules not processed for user `15ea80a65cbe4394bb9c7d3b73287655`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:34.775019 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-f6dc0e68-3c8b-4bc9-98fa-835f6951554a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:34.781758 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-9f787b1a-f8fb-4ab1-a305-85d9ec54566e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74ccc87e34cd4e7894b0b5be27982f37'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:34.793411 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 822/1648] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:34.797971 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 827/1649] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:31:34 2022] DELETE /identity/v3/users/74ccc87e34cd4e7894b0b5be27982f37 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:31:34.799650 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73013e00-32f0-4868-859d-1e3aece1bef3 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:34.800050 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73013e00-32f0-4868-859d-1e3aece1bef3 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:34.800431 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73013e00-32f0-4868-859d-1e3aece1bef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:34.823584 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-73013e00-32f0-4868-859d-1e3aece1bef3 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:34.825921 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-73013e00-32f0-4868-859d-1e3aece1bef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:34.889990 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f787b1a-f8fb-4ab1-a305-85d9ec54566e admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:34.891537 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-9f787b1a-f8fb-4ab1-a305-85d9ec54566e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:34.984949 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 823/1650] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:35.056379 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73013e00-32f0-4868-859d-1e3aece1bef3 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:35.058339 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-73013e00-32f0-4868-859d-1e3aece1bef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:35.077854 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73013e00-32f0-4868-859d-1e3aece1bef3 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:35.097225 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f787b1a-f8fb-4ab1-a305-85d9ec54566e admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:35.106752 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5588fbf-6a85-4ee4-9711-138f961ab19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:35.107571 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad02fd8-be98-47db-8465-6fdf956a32d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec202a34db8e47f4a6c18285245e3f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:35.107714 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5588fbf-6a85-4ee4-9711-138f961ab19e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:35.107907 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5588fbf-6a85-4ee4-9711-138f961ab19e admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:35.108191 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5588fbf-6a85-4ee4-9711-138f961ab19e admin admin] PATH_INFO: `/v3/users/edc3e3c7831a4598a3205046cfc9468d` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:35.108856 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad02fd8-be98-47db-8465-6fdf956a32d7 service nova] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:35.109247 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad02fd8-be98-47db-8465-6fdf956a32d7 service nova] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:35.109633 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad02fd8-be98-47db-8465-6fdf956a32d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:35.114109 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-8ad02fd8-be98-47db-8465-6fdf956a32d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:35.116815 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5588fbf-6a85-4ee4-9711-138f961ab19e admin admin] RBAC: Authorizing `identity:delete_user(user_id=edc3e3c7831a4598a3205046cfc9468d)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:35.118824 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5588fbf-6a85-4ee4-9711-138f961ab19e admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:35.197425 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad02fd8-be98-47db-8465-6fdf956a32d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:35.200246 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad02fd8-be98-47db-8465-6fdf956a32d7 service nova] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:35.211650 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 828/1651] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:31:35.212589 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad02fd8-be98-47db-8465-6fdf956a32d7 service nova] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:35.215011 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-8ad02fd8-be98-47db-8465-6fdf956a32d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:35.268981 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-a5588fbf-6a85-4ee4-9711-138f961ab19e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edc3e3c7831a4598a3205046cfc9468d'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:35.272956 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-a5588fbf-6a85-4ee4-9711-138f961ab19e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edc3e3c7831a4598a3205046cfc9468d'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:35.327600 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad02fd8-be98-47db-8465-6fdf956a32d7 service nova] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:35.335460 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d041b0-bd0a-4bc4-ae95-6244c8001f45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:35.336007 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d041b0-bd0a-4bc4-ae95-6244c8001f45 service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:35.336295 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d041b0-bd0a-4bc4-ae95-6244c8001f45 service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:35.336573 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d041b0-bd0a-4bc4-ae95-6244c8001f45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:35.341013 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-24d041b0-bd0a-4bc4-ae95-6244c8001f45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:35.347793 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-a5588fbf-6a85-4ee4-9711-138f961ab19e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edc3e3c7831a4598a3205046cfc9468d'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:35.375976 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-a5588fbf-6a85-4ee4-9711-138f961ab19e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edc3e3c7831a4598a3205046cfc9468d'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:35.386432 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d041b0-bd0a-4bc4-ae95-6244c8001f45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:35.390815 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-a5588fbf-6a85-4ee4-9711-138f961ab19e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edc3e3c7831a4598a3205046cfc9468d'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:35.393773 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d041b0-bd0a-4bc4-ae95-6244c8001f45 service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:35.419600 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 824/1652] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:31:35 2022] DELETE /identity/v3/users/edc3e3c7831a4598a3205046cfc9468d => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:31:35.423560 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88afef-4c91-415d-9daf-a61181503f11 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:35.423850 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88afef-4c91-415d-9daf-a61181503f11 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:35.424129 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88afef-4c91-415d-9daf-a61181503f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:35.427604 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 829/1653] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:31:35.489361 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-3d88afef-4c91-415d-9daf-a61181503f11 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:35.490723 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-3d88afef-4c91-415d-9daf-a61181503f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:35.684933 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 825/1654] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:31:35.687030 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d041b0-bd0a-4bc4-ae95-6244c8001f45 service neutron] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:35.689595 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-24d041b0-bd0a-4bc4-ae95-6244c8001f45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:35.704436 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d041b0-bd0a-4bc4-ae95-6244c8001f45 service neutron] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:35.712242 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94b509-0609-4ea6-aa6d-2cf9a57559ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:35.713362 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94b509-0609-4ea6-aa6d-2cf9a57559ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:35.713653 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94b509-0609-4ea6-aa6d-2cf9a57559ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:35.713978 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94b509-0609-4ea6-aa6d-2cf9a57559ea admin admin] PATH_INFO: `/v3/users/dcd2fb73989043479f425c538315ec5a` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:35.716222 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94b509-0609-4ea6-aa6d-2cf9a57559ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcd2fb73989043479f425c538315ec5a)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:35.719039 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94b509-0609-4ea6-aa6d-2cf9a57559ea admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:35.764395 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d88afef-4c91-415d-9daf-a61181503f11 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:35.767320 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-3d88afef-4c91-415d-9daf-a61181503f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:35.825093 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-9c94b509-0609-4ea6-aa6d-2cf9a57559ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcd2fb73989043479f425c538315ec5a'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:35.838732 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-9c94b509-0609-4ea6-aa6d-2cf9a57559ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcd2fb73989043479f425c538315ec5a'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:35.841018 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-9c94b509-0609-4ea6-aa6d-2cf9a57559ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcd2fb73989043479f425c538315ec5a'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:35.861486 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-9c94b509-0609-4ea6-aa6d-2cf9a57559ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcd2fb73989043479f425c538315ec5a'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:35.874199 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-9c94b509-0609-4ea6-aa6d-2cf9a57559ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcd2fb73989043479f425c538315ec5a'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:35.894408 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d88afef-4c91-415d-9daf-a61181503f11 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:35.896114 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 830/1655] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:31:35 2022] DELETE /identity/v3/users/dcd2fb73989043479f425c538315ec5a => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:31:35.897919 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706c74d-7e02-4e2d-9c5c-b9ebdd1d63be None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:35.898901 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706c74d-7e02-4e2d-9c5c-b9ebdd1d63be None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:35.899423 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706c74d-7e02-4e2d-9c5c-b9ebdd1d63be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:35.923046 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-2706c74d-7e02-4e2d-9c5c-b9ebdd1d63be None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:35.924625 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-2706c74d-7e02-4e2d-9c5c-b9ebdd1d63be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:36.057084 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb31590-9a30-442f-ac34-1f630615197c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:36.057084 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb31590-9a30-442f-ac34-1f630615197c service neutron] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:36.057084 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb31590-9a30-442f-ac34-1f630615197c service neutron] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:36.057084 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb31590-9a30-442f-ac34-1f630615197c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:36.059593 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-5fb31590-9a30-442f-ac34-1f630615197c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:36.078765 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 831/1656] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:36.120867 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706c74d-7e02-4e2d-9c5c-b9ebdd1d63be None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:36.125313 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-2706c74d-7e02-4e2d-9c5c-b9ebdd1d63be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:36.160873 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706c74d-7e02-4e2d-9c5c-b9ebdd1d63be None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:36.166052 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de3d2c-43a3-4c76-bd4f-78d0826c12c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:36.166897 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de3d2c-43a3-4c76-bd4f-78d0826c12c0 service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:36.167521 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de3d2c-43a3-4c76-bd4f-78d0826c12c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:36.167925 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de3d2c-43a3-4c76-bd4f-78d0826c12c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:36.180128 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81de3d2c-43a3-4c76-bd4f-78d0826c12c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:36.182694 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81de3d2c-43a3-4c76-bd4f-78d0826c12c0 service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:36.197615 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 832/1657] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:31:36.216975 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb31590-9a30-442f-ac34-1f630615197c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:36.218430 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb31590-9a30-442f-ac34-1f630615197c service neutron] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:36.244140 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 826/1658] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:31:36.416337 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf7854-d407-4dcc-9837-b46c7ae8660c None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:36.416576 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf7854-d407-4dcc-9837-b46c7ae8660c None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:36.416979 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf7854-d407-4dcc-9837-b46c7ae8660c None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:36.419954 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 833/1659] 10.222.0.21 () {54 vars in 912 bytes} [Mon Feb 28 10:31:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:31:36.436266 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139482bb-84c5-47df-8ddf-315b711f8509 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:36.438528 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139482bb-84c5-47df-8ddf-315b711f8509 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:36.439198 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139482bb-84c5-47df-8ddf-315b711f8509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:36.539302 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-139482bb-84c5-47df-8ddf-315b711f8509 None None] MFA Rules not processed for user `abaa12b94c834676bb17bf997dace5d1`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:36.540504 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-139482bb-84c5-47df-8ddf-315b711f8509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:36.563878 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 827/1660] 10.222.0.21 () {58 vars in 1009 bytes} [Mon Feb 28 10:31:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:36.676279 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf7854-d407-4dcc-9837-b46c7ae8660c None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:36.692150 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf7854-d407-4dcc-9837-b46c7ae8660c None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:36.700715 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f96da-7117-4d45-96c1-b835cac6b4d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:36.701289 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f96da-7117-4d45-96c1-b835cac6b4d7 service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:36.701580 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f96da-7117-4d45-96c1-b835cac6b4d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:36.701862 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f96da-7117-4d45-96c1-b835cac6b4d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:36.720675 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179f96da-7117-4d45-96c1-b835cac6b4d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:36.727468 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179f96da-7117-4d45-96c1-b835cac6b4d7 service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:36.777721 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 834/1661] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:31:37.846863 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139482bb-84c5-47df-8ddf-315b711f8509 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:37.848752 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-139482bb-84c5-47df-8ddf-315b711f8509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:37.892268 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139482bb-84c5-47df-8ddf-315b711f8509 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:37.908319 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50568c15-8124-49bb-87a1-8f2ce4bbc177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:37.909212 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50568c15-8124-49bb-87a1-8f2ce4bbc177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:37.909424 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50568c15-8124-49bb-87a1-8f2ce4bbc177 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:37.909698 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50568c15-8124-49bb-87a1-8f2ce4bbc177 admin admin] PATH_INFO: `/v3/projects/9147c1b182e84f66a3a839bdae173b74` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:37.910937 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50568c15-8124-49bb-87a1-8f2ce4bbc177 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9147c1b182e84f66a3a839bdae173b74)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:37.912017 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: WARNING py.warnings [None req-50568c15-8124-49bb-87a1-8f2ce4bbc177 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 10:31:37.912017 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: warnings.warn(msg) Feb 28 10:31:37.912017 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: Feb 28 10:31:37.918085 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f96da-7117-4d45-96c1-b835cac6b4d7 service neutron] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:37.921235 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50568c15-8124-49bb-87a1-8f2ce4bbc177 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:37.921575 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-179f96da-7117-4d45-96c1-b835cac6b4d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:37.952657 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f96da-7117-4d45-96c1-b835cac6b4d7 service neutron] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:37.969051 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10134c7d-0ddd-412c-925d-fe83c5c75317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:37.969941 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10134c7d-0ddd-412c-925d-fe83c5c75317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:37.970504 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10134c7d-0ddd-412c-925d-fe83c5c75317 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:37.970828 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10134c7d-0ddd-412c-925d-fe83c5c75317 admin admin] PATH_INFO: `/v3/projects/4be56389a99c4e61a4bd82656603ad7e` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:37.972442 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10134c7d-0ddd-412c-925d-fe83c5c75317 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4be56389a99c4e61a4bd82656603ad7e)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:37.976012 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10134c7d-0ddd-412c-925d-fe83c5c75317 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:38.123625 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-50568c15-8124-49bb-87a1-8f2ce4bbc177 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9147c1b182e84f66a3a839bdae173b74', 'request_id': 'req-50568c15-8124-49bb-87a1-8f2ce4bbc177'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:38.129364 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-10134c7d-0ddd-412c-925d-fe83c5c75317 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4be56389a99c4e61a4bd82656603ad7e', 'request_id': 'req-10134c7d-0ddd-412c-925d-fe83c5c75317'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:38.137402 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-50568c15-8124-49bb-87a1-8f2ce4bbc177 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9147c1b182e84f66a3a839bdae173b74', 'request_id': 'req-50568c15-8124-49bb-87a1-8f2ce4bbc177'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:38.142774 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-10134c7d-0ddd-412c-925d-fe83c5c75317 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4be56389a99c4e61a4bd82656603ad7e', 'request_id': 'req-10134c7d-0ddd-412c-925d-fe83c5c75317'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:38.169123 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-50568c15-8124-49bb-87a1-8f2ce4bbc177 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9147c1b182e84f66a3a839bdae173b74', 'request_id': 'req-50568c15-8124-49bb-87a1-8f2ce4bbc177'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:38.187646 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-10134c7d-0ddd-412c-925d-fe83c5c75317 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4be56389a99c4e61a4bd82656603ad7e', 'request_id': 'req-10134c7d-0ddd-412c-925d-fe83c5c75317'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:38.195938 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-50568c15-8124-49bb-87a1-8f2ce4bbc177 admin admin] The token cache is being invalidate because project 9147c1b182e84f66a3a839bdae173b74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:31:38.196597 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-50568c15-8124-49bb-87a1-8f2ce4bbc177 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:38.197535 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-50568c15-8124-49bb-87a1-8f2ce4bbc177 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:38.201090 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 828/1662] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:31:37 2022] DELETE /identity/v3/projects/9147c1b182e84f66a3a839bdae173b74 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:31:38.203014 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50568c15-8124-49bb-87a1-8f2ce4bbc177 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:38.207526 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-50568c15-8124-49bb-87a1-8f2ce4bbc177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:38.215426 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-10134c7d-0ddd-412c-925d-fe83c5c75317 admin admin] The token cache is being invalidate because project 4be56389a99c4e61a4bd82656603ad7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:31:38.215426 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-10134c7d-0ddd-412c-925d-fe83c5c75317 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:38.216689 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-10134c7d-0ddd-412c-925d-fe83c5c75317 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:38.224065 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 835/1663] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:31:37 2022] DELETE /identity/v3/projects/4be56389a99c4e61a4bd82656603ad7e => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:31:38.225809 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10134c7d-0ddd-412c-925d-fe83c5c75317 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:38.239800 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-10134c7d-0ddd-412c-925d-fe83c5c75317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:38.330270 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50568c15-8124-49bb-87a1-8f2ce4bbc177 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:38.366428 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10134c7d-0ddd-412c-925d-fe83c5c75317 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:38.375545 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bcba0f-f0d2-4c8b-bf3e-8bc37d803e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:38.376575 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bcba0f-f0d2-4c8b-bf3e-8bc37d803e4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:38.376859 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bcba0f-f0d2-4c8b-bf3e-8bc37d803e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:38.377247 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bcba0f-f0d2-4c8b-bf3e-8bc37d803e4a admin admin] PATH_INFO: `/v3/users/987a42f02f3c4520b8e2f4377a44bb3c` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:38.378841 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bcba0f-f0d2-4c8b-bf3e-8bc37d803e4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=987a42f02f3c4520b8e2f4377a44bb3c)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:38.381662 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bcba0f-f0d2-4c8b-bf3e-8bc37d803e4a admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:38.441778 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efffad3b-5195-43cc-9af4-86a8abb9b012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:38.442177 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffad3b-5195-43cc-9af4-86a8abb9b012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:38.442481 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffad3b-5195-43cc-9af4-86a8abb9b012 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:38.443092 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffad3b-5195-43cc-9af4-86a8abb9b012 admin admin] PATH_INFO: `/v3/users/1d367c7ea49143e3a3b23b788b256d4e` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:38.445006 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efffad3b-5195-43cc-9af4-86a8abb9b012 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d367c7ea49143e3a3b23b788b256d4e)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:38.446948 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efffad3b-5195-43cc-9af4-86a8abb9b012 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:38.473062 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-15bcba0f-f0d2-4c8b-bf3e-8bc37d803e4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '987a42f02f3c4520b8e2f4377a44bb3c'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:38.492342 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-15bcba0f-f0d2-4c8b-bf3e-8bc37d803e4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '987a42f02f3c4520b8e2f4377a44bb3c'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:38.493896 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-15bcba0f-f0d2-4c8b-bf3e-8bc37d803e4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '987a42f02f3c4520b8e2f4377a44bb3c'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:38.522083 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-15bcba0f-f0d2-4c8b-bf3e-8bc37d803e4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '987a42f02f3c4520b8e2f4377a44bb3c'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:38.543683 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-15bcba0f-f0d2-4c8b-bf3e-8bc37d803e4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '987a42f02f3c4520b8e2f4377a44bb3c'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:38.544269 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-efffad3b-5195-43cc-9af4-86a8abb9b012 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d367c7ea49143e3a3b23b788b256d4e'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:38.545169 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-efffad3b-5195-43cc-9af4-86a8abb9b012 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d367c7ea49143e3a3b23b788b256d4e'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:38.559239 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 836/1664] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:31:38 2022] DELETE /identity/v3/users/987a42f02f3c4520b8e2f4377a44bb3c => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:31:38.562141 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-efffad3b-5195-43cc-9af4-86a8abb9b012 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d367c7ea49143e3a3b23b788b256d4e'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:38.563974 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be380949-43da-49bf-8cf8-f725efa16da0 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:38.564246 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be380949-43da-49bf-8cf8-f725efa16da0 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:38.564530 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be380949-43da-49bf-8cf8-f725efa16da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:38.572641 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-efffad3b-5195-43cc-9af4-86a8abb9b012 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d367c7ea49143e3a3b23b788b256d4e'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:38.597144 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-efffad3b-5195-43cc-9af4-86a8abb9b012 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d367c7ea49143e3a3b23b788b256d4e'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:38.601746 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-be380949-43da-49bf-8cf8-f725efa16da0 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:38.603020 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-be380949-43da-49bf-8cf8-f725efa16da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:38.611859 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 829/1665] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:31:38 2022] DELETE /identity/v3/users/1d367c7ea49143e3a3b23b788b256d4e => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:31:38.612959 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efffad3b-5195-43cc-9af4-86a8abb9b012 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:38.615746 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-efffad3b-5195-43cc-9af4-86a8abb9b012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:38.720854 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 837/1666] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:38.720854 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207b59e-12fb-4f64-af3b-69e52df6847b None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:38.720854 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207b59e-12fb-4f64-af3b-69e52df6847b None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:38.720854 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207b59e-12fb-4f64-af3b-69e52df6847b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:38.763139 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-4207b59e-12fb-4f64-af3b-69e52df6847b None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:38.770771 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-4207b59e-12fb-4f64-af3b-69e52df6847b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:38.794839 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 838/1667] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:38.795028 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed7a3d-fa81-4406-a765-2575022ee2f1 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:38.795408 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed7a3d-fa81-4406-a765-2575022ee2f1 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:38.795642 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed7a3d-fa81-4406-a765-2575022ee2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:38.809716 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efffad3b-5195-43cc-9af4-86a8abb9b012 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:38.815804 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4b8d7-dfc8-4937-a5b8-a51ceefbc104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:38.817011 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4b8d7-dfc8-4937-a5b8-a51ceefbc104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:38.817449 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4b8d7-dfc8-4937-a5b8-a51ceefbc104 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:38.817913 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4b8d7-dfc8-4937-a5b8-a51ceefbc104 admin admin] PATH_INFO: `/v3/projects/8ed523732df14507bb746c141a78e20d` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:38.820767 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-60ed7a3d-fa81-4406-a765-2575022ee2f1 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:38.821718 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a4b8d7-dfc8-4937-a5b8-a51ceefbc104 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ed523732df14507bb746c141a78e20d)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:38.822178 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-60ed7a3d-fa81-4406-a765-2575022ee2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:38.825416 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a4b8d7-dfc8-4937-a5b8-a51ceefbc104 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:38.831985 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 839/1668] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:38.837141 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed7a3d-fa81-4406-a765-2575022ee2f1 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:38.882440 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed7a3d-fa81-4406-a765-2575022ee2f1 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:38.898460 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71735981-a375-4fb6-8f86-a3bc8b2a13b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:38.906584 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71735981-a375-4fb6-8f86-a3bc8b2a13b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:38.911152 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71735981-a375-4fb6-8f86-a3bc8b2a13b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:38.911656 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71735981-a375-4fb6-8f86-a3bc8b2a13b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:38.912587 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71735981-a375-4fb6-8f86-a3bc8b2a13b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:31:38.913077 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71735981-a375-4fb6-8f86-a3bc8b2a13b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:38.916191 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71735981-a375-4fb6-8f86-a3bc8b2a13b9 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:38.942906 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-50a4b8d7-dfc8-4937-a5b8-a51ceefbc104 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ed523732df14507bb746c141a78e20d', 'request_id': 'req-50a4b8d7-dfc8-4937-a5b8-a51ceefbc104'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:38.953773 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-50a4b8d7-dfc8-4937-a5b8-a51ceefbc104 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ed523732df14507bb746c141a78e20d', 'request_id': 'req-50a4b8d7-dfc8-4937-a5b8-a51ceefbc104'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:38.965820 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-50a4b8d7-dfc8-4937-a5b8-a51ceefbc104 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ed523732df14507bb746c141a78e20d', 'request_id': 'req-50a4b8d7-dfc8-4937-a5b8-a51ceefbc104'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:38.968882 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 840/1669] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:31:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:31:38.970961 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71735981-a375-4fb6-8f86-a3bc8b2a13b9 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:38.975535 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-71735981-a375-4fb6-8f86-a3bc8b2a13b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:39.011806 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-50a4b8d7-dfc8-4937-a5b8-a51ceefbc104 admin admin] The token cache is being invalidate because project 8ed523732df14507bb746c141a78e20d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:31:39.015979 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-50a4b8d7-dfc8-4937-a5b8-a51ceefbc104 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:39.018691 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-50a4b8d7-dfc8-4937-a5b8-a51ceefbc104 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:39.028528 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 830/1670] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:31:38 2022] DELETE /identity/v3/projects/8ed523732df14507bb746c141a78e20d => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:31:39.028528 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4b8d7-dfc8-4937-a5b8-a51ceefbc104 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:39.033976 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-50a4b8d7-dfc8-4937-a5b8-a51ceefbc104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:39.125586 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71735981-a375-4fb6-8f86-a3bc8b2a13b9 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:39.221173 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4b8d7-dfc8-4937-a5b8-a51ceefbc104 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:39.231861 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b7cbe-8d95-4a7f-b2f9-3f63d13f30b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:39.233698 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b7cbe-8d95-4a7f-b2f9-3f63d13f30b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:39.233943 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34aee68-542e-42c8-ae0e-157dac90ff03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:39.235911 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b7cbe-8d95-4a7f-b2f9-3f63d13f30b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:39.236230 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34aee68-542e-42c8-ae0e-157dac90ff03 service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:39.236602 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34aee68-542e-42c8-ae0e-157dac90ff03 service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:39.237011 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b7cbe-8d95-4a7f-b2f9-3f63d13f30b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:39.237876 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b7cbe-8d95-4a7f-b2f9-3f63d13f30b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:39.238267 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34aee68-542e-42c8-ae0e-157dac90ff03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:39.241489 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b7cbe-8d95-4a7f-b2f9-3f63d13f30b3 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:39.243563 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-d34aee68-542e-42c8-ae0e-157dac90ff03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:39.283543 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34aee68-542e-42c8-ae0e-157dac90ff03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:39.288123 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34aee68-542e-42c8-ae0e-157dac90ff03 service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:39.320903 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 831/1671] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:31:39 2022] POST /identity/v3/projects => generated 361 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:31:39.320903 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1b69d-f671-4235-a1c8-1231c0e5e1d0 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:39.320903 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1b69d-f671-4235-a1c8-1231c0e5e1d0 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:39.320903 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1b69d-f671-4235-a1c8-1231c0e5e1d0 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:39.324406 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 832/1672] 10.222.0.21 () {54 vars in 960 bytes} [Mon Feb 28 10:31:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:31:39.324406 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa1b69d-f671-4235-a1c8-1231c0e5e1d0 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:39.328699 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-3fa1b69d-f671-4235-a1c8-1231c0e5e1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:39.339681 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 841/1673] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:31:39.340743 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34aee68-542e-42c8-ae0e-157dac90ff03 service neutron] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:39.368662 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34aee68-542e-42c8-ae0e-157dac90ff03 service neutron] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:39.421077 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa1b69d-f671-4235-a1c8-1231c0e5e1d0 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:39.426161 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3afd88-b2f7-4382-b52f-54ad1ca565cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:39.427533 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3afd88-b2f7-4382-b52f-54ad1ca565cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:39.428135 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3afd88-b2f7-4382-b52f-54ad1ca565cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:39.428135 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3afd88-b2f7-4382-b52f-54ad1ca565cb admin admin] PATH_INFO: `/v3/users/872f5a76a3ec46418d8733084b5e9f0e` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:39.429644 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3afd88-b2f7-4382-b52f-54ad1ca565cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=872f5a76a3ec46418d8733084b5e9f0e)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:39.431625 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3afd88-b2f7-4382-b52f-54ad1ca565cb admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:39.514357 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25710e-1ed0-4128-80d6-9325cd631990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:39.515069 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25710e-1ed0-4128-80d6-9325cd631990 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:39.515352 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25710e-1ed0-4128-80d6-9325cd631990 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:39.515623 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25710e-1ed0-4128-80d6-9325cd631990 admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:39.516312 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25710e-1ed0-4128-80d6-9325cd631990 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:39.518432 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25710e-1ed0-4128-80d6-9325cd631990 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:39.539017 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-5f3afd88-b2f7-4382-b52f-54ad1ca565cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '872f5a76a3ec46418d8733084b5e9f0e'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:39.542159 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-5f3afd88-b2f7-4382-b52f-54ad1ca565cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '872f5a76a3ec46418d8733084b5e9f0e'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:39.562794 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 842/1674] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:31:39 2022] POST /identity/v3/users => generated 281 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:31:39.562794 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38d22a-caca-4bc8-a7b2-d3312c96fce7 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:39.562794 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38d22a-caca-4bc8-a7b2-d3312c96fce7 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:39.562794 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38d22a-caca-4bc8-a7b2-d3312c96fce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:39.564544 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-5f3afd88-b2f7-4382-b52f-54ad1ca565cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '872f5a76a3ec46418d8733084b5e9f0e'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:39.574269 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-5f3afd88-b2f7-4382-b52f-54ad1ca565cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '872f5a76a3ec46418d8733084b5e9f0e'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:39.583897 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-5f3afd88-b2f7-4382-b52f-54ad1ca565cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '872f5a76a3ec46418d8733084b5e9f0e'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:39.594828 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 833/1675] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:31:39 2022] DELETE /identity/v3/users/872f5a76a3ec46418d8733084b5e9f0e => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:31:39.596515 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3afd88-b2f7-4382-b52f-54ad1ca565cb admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:39.598045 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-5f3afd88-b2f7-4382-b52f-54ad1ca565cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:39.602411 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-5c38d22a-caca-4bc8-a7b2-d3312c96fce7 None None] MFA Rules not processed for user `1b2346e4de5d45a79d4bb2abb01d4827`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:39.603671 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-5c38d22a-caca-4bc8-a7b2-d3312c96fce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:39.701470 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3afd88-b2f7-4382-b52f-54ad1ca565cb admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:39.709389 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2b353-3ad1-4bb9-baa3-150b8b160757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:39.710152 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2b353-3ad1-4bb9-baa3-150b8b160757 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:39.710725 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2b353-3ad1-4bb9-baa3-150b8b160757 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:39.710868 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2b353-3ad1-4bb9-baa3-150b8b160757 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:39.711842 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca2b353-3ad1-4bb9-baa3-150b8b160757 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:39.713834 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca2b353-3ad1-4bb9-baa3-150b8b160757 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:39.719738 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 843/1676] 10.222.0.21 () {58 vars in 1057 bytes} [Mon Feb 28 10:31:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:39.727303 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c38d22a-caca-4bc8-a7b2-d3312c96fce7 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:39.733887 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 834/1677] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:31:39.738961 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c38d22a-caca-4bc8-a7b2-d3312c96fce7 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:39.741364 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2b353-3ad1-4bb9-baa3-150b8b160757 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:39.746261 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c352af-e025-437c-b9ca-46335517212b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b2346e4de5d45a79d4bb2abb01d4827', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:39.747036 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c352af-e025-437c-b9ca-46335517212b service placement] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:39.747332 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c352af-e025-437c-b9ca-46335517212b service placement] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:39.747604 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c352af-e025-437c-b9ca-46335517212b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:39.749562 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-71c352af-e025-437c-b9ca-46335517212b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:39.760524 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2b353-3ad1-4bb9-baa3-150b8b160757 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:39.767245 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae6531-d989-4504-9a6b-f0b48c47e569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:39.768273 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae6531-d989-4504-9a6b-f0b48c47e569 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:39.768553 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae6531-d989-4504-9a6b-f0b48c47e569 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:39.769649 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c352af-e025-437c-b9ca-46335517212b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:39.770673 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae6531-d989-4504-9a6b-f0b48c47e569 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:39.771272 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c352af-e025-437c-b9ca-46335517212b service placement] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:39.773043 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ae6531-d989-4504-9a6b-f0b48c47e569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:39.776015 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ae6531-d989-4504-9a6b-f0b48c47e569 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:39.794200 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 844/1678] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:31:39.795372 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 835/1679] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:31:39.796352 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c352af-e025-437c-b9ca-46335517212b service placement] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:39.820889 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c352af-e025-437c-b9ca-46335517212b service placement] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:39.833380 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c7102-3d0a-43e5-8352-9998254890e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:39.834140 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c7102-3d0a-43e5-8352-9998254890e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:39.834431 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c7102-3d0a-43e5-8352-9998254890e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:39.834725 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c7102-3d0a-43e5-8352-9998254890e0 admin admin] PATH_INFO: `/v3/projects/dc7b720f29804a9f816e2fdc4c1317a3/users/a5df10b477144385b096642c5ca14149/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:39.876308 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69c7102-3d0a-43e5-8352-9998254890e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc7b720f29804a9f816e2fdc4c1317a3, user_id=a5df10b477144385b096642c5ca14149, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:39.879179 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69c7102-3d0a-43e5-8352-9998254890e0 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:39.909840 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 845/1680] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:31:39 2022] PUT /identity/v3/projects/dc7b720f29804a9f816e2fdc4c1317a3/users/a5df10b477144385b096642c5ca14149/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:31:39.921699 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd937fd8-9518-4e52-bc74-4dbbd8bf4ce8 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:39.921983 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd937fd8-9518-4e52-bc74-4dbbd8bf4ce8 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:39.922261 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd937fd8-9518-4e52-bc74-4dbbd8bf4ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:39.975214 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-bd937fd8-9518-4e52-bc74-4dbbd8bf4ce8 None None] MFA Rules not processed for user `a5df10b477144385b096642c5ca14149`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:39.976433 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-bd937fd8-9518-4e52-bc74-4dbbd8bf4ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:40.115762 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 836/1681] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:39 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:40.117450 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c7102-3d0a-43e5-8352-9998254890e0 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:40.306080 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c7102-3d0a-43e5-8352-9998254890e0 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:40.315262 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa0b8d-584d-4278-a5d4-25695f8b9be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:40.345481 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa0b8d-584d-4278-a5d4-25695f8b9be2 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:40.345481 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa0b8d-584d-4278-a5d4-25695f8b9be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:40.345481 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa0b8d-584d-4278-a5d4-25695f8b9be2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:40.345481 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfa0b8d-584d-4278-a5d4-25695f8b9be2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:40.345481 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfa0b8d-584d-4278-a5d4-25695f8b9be2 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:40.395375 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 846/1682] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:31:40 2022] POST /identity/v3/projects => generated 363 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:31:40.398871 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd937fd8-9518-4e52-bc74-4dbbd8bf4ce8 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:40.432600 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd937fd8-9518-4e52-bc74-4dbbd8bf4ce8 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:40.569135 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b87edf5-0ac6-4173-8995-54ac5af73ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:40.570834 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b87edf5-0ac6-4173-8995-54ac5af73ecc admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:40.571185 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b87edf5-0ac6-4173-8995-54ac5af73ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:40.571597 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b87edf5-0ac6-4173-8995-54ac5af73ecc admin admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:40.574576 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b87edf5-0ac6-4173-8995-54ac5af73ecc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:40.577361 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b87edf5-0ac6-4173-8995-54ac5af73ecc admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:40.635547 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 837/1683] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:31:40 2022] POST /identity/v3/users => generated 288 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:31:40.641821 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa0b8d-584d-4278-a5d4-25695f8b9be2 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:40.658528 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa0b8d-584d-4278-a5d4-25695f8b9be2 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:40.666132 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d61e3-2fab-478c-a62c-34af872393d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:40.669990 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d61e3-2fab-478c-a62c-34af872393d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:40.671015 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d61e3-2fab-478c-a62c-34af872393d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:40.671642 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d61e3-2fab-478c-a62c-34af872393d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:40.672652 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24d61e3-2fab-478c-a62c-34af872393d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:40.676426 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24d61e3-2fab-478c-a62c-34af872393d0 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:40.692573 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 847/1684] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:31:40.696832 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b87edf5-0ac6-4173-8995-54ac5af73ecc admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:40.714353 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b87edf5-0ac6-4173-8995-54ac5af73ecc admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:40.720023 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d61e3-2fab-478c-a62c-34af872393d0 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:40.724860 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-e24d61e3-2fab-478c-a62c-34af872393d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:40.743167 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d61e3-2fab-478c-a62c-34af872393d0 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:40.744775 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c43d8-b15c-4028-b94c-28956bccc4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:40.745338 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c43d8-b15c-4028-b94c-28956bccc4d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:40.745993 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c43d8-b15c-4028-b94c-28956bccc4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:40.746629 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c43d8-b15c-4028-b94c-28956bccc4d5 admin admin] PATH_INFO: `/v3/projects/02fb28be813a480ea49f887e50e952e3/users/8d11c2295e1a43ca9858168de633de8f/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:40.753514 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06908dd8-6172-431d-9ffc-fcb7bc8d71d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:40.755036 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06908dd8-6172-431d-9ffc-fcb7bc8d71d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:40.755471 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06908dd8-6172-431d-9ffc-fcb7bc8d71d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:40.756927 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06908dd8-6172-431d-9ffc-fcb7bc8d71d2 admin admin] PATH_INFO: `/v3/projects/3a6a71f022f448c39cba213967e2b437` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:40.758993 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06908dd8-6172-431d-9ffc-fcb7bc8d71d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a6a71f022f448c39cba213967e2b437)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:40.762511 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06908dd8-6172-431d-9ffc-fcb7bc8d71d2 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:40.773681 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c43d8-b15c-4028-b94c-28956bccc4d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02fb28be813a480ea49f887e50e952e3, user_id=8d11c2295e1a43ca9858168de633de8f, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:40.776388 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c43d8-b15c-4028-b94c-28956bccc4d5 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:40.810473 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 838/1685] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:31:40 2022] PUT /identity/v3/projects/02fb28be813a480ea49f887e50e952e3/users/8d11c2295e1a43ca9858168de633de8f/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:31:40.812184 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c43d8-b15c-4028-b94c-28956bccc4d5 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:40.863086 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-06908dd8-6172-431d-9ffc-fcb7bc8d71d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a6a71f022f448c39cba213967e2b437', 'request_id': 'req-06908dd8-6172-431d-9ffc-fcb7bc8d71d2'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:40.875148 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-06908dd8-6172-431d-9ffc-fcb7bc8d71d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a6a71f022f448c39cba213967e2b437', 'request_id': 'req-06908dd8-6172-431d-9ffc-fcb7bc8d71d2'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:40.884882 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-06908dd8-6172-431d-9ffc-fcb7bc8d71d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a6a71f022f448c39cba213967e2b437', 'request_id': 'req-06908dd8-6172-431d-9ffc-fcb7bc8d71d2'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:40.909661 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-06908dd8-6172-431d-9ffc-fcb7bc8d71d2 admin admin] The token cache is being invalidate because project 3a6a71f022f448c39cba213967e2b437 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:31:40.910180 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-06908dd8-6172-431d-9ffc-fcb7bc8d71d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:40.911045 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-06908dd8-6172-431d-9ffc-fcb7bc8d71d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:40.915854 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 848/1686] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:31:40 2022] DELETE /identity/v3/projects/3a6a71f022f448c39cba213967e2b437 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:31:40.919854 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f2040-22c9-4a43-9b66-84b601736848 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:40.931409 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f2040-22c9-4a43-9b66-84b601736848 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:40.935605 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f2040-22c9-4a43-9b66-84b601736848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:40.968648 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-669f2040-22c9-4a43-9b66-84b601736848 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:40.970427 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-669f2040-22c9-4a43-9b66-84b601736848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:41.032071 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c43d8-b15c-4028-b94c-28956bccc4d5 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:41.098710 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 849/1687] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:41.103601 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee18b2e-861b-4e54-babd-5c76dfe40ce2 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:41.103974 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee18b2e-861b-4e54-babd-5c76dfe40ce2 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:41.107654 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee18b2e-861b-4e54-babd-5c76dfe40ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:41.193106 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-1ee18b2e-861b-4e54-babd-5c76dfe40ce2 None None] MFA Rules not processed for user `28641197fb9b472dbe0aecd4dac3f4f3`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:41.197919 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-1ee18b2e-861b-4e54-babd-5c76dfe40ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:41.287150 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56df90d-33ec-4167-84fe-0ebd6454574d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:41.290994 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56df90d-33ec-4167-84fe-0ebd6454574d admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:41.291253 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56df90d-33ec-4167-84fe-0ebd6454574d admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:41.291545 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56df90d-33ec-4167-84fe-0ebd6454574d admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:41.295503 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 850/1688] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:41.296984 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56df90d-33ec-4167-84fe-0ebd6454574d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:41.300030 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19717d7-32fe-479d-943b-4099c668ccdc None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:41.300323 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19717d7-32fe-479d-943b-4099c668ccdc None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:41.300656 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19717d7-32fe-479d-943b-4099c668ccdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:41.316009 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56df90d-33ec-4167-84fe-0ebd6454574d admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:41.337138 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-f19717d7-32fe-479d-943b-4099c668ccdc None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:41.338764 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-f19717d7-32fe-479d-943b-4099c668ccdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:41.349694 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 839/1689] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 538 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:31:41.353326 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56df90d-33ec-4167-84fe-0ebd6454574d admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:41.358462 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-a56df90d-33ec-4167-84fe-0ebd6454574d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:41.359521 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 851/1690] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:41.364446 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19717d7-32fe-479d-943b-4099c668ccdc None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:41.368167 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-f19717d7-32fe-479d-943b-4099c668ccdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:41.391665 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56df90d-33ec-4167-84fe-0ebd6454574d admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:41.397358 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19717d7-32fe-479d-943b-4099c668ccdc None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:41.409392 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a4506-3f7c-4074-86a7-56a641f7b858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:41.410270 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a4506-3f7c-4074-86a7-56a641f7b858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:41.410551 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a4506-3f7c-4074-86a7-56a641f7b858 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:41.410898 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a4506-3f7c-4074-86a7-56a641f7b858 admin admin] PATH_INFO: `/v3/projects/100f86b605bb41ecb2187e3dcfa2dc76` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:41.411103 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a0980-23a9-4c85-b7e7-49f86652f109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:41.412066 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6a4506-3f7c-4074-86a7-56a641f7b858 admin admin] RBAC: Authorizing `identity:delete_project(project_id=100f86b605bb41ecb2187e3dcfa2dc76)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:41.413098 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a0980-23a9-4c85-b7e7-49f86652f109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:41.413961 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6a4506-3f7c-4074-86a7-56a641f7b858 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:41.415779 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a0980-23a9-4c85-b7e7-49f86652f109 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:41.416229 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a0980-23a9-4c85-b7e7-49f86652f109 admin admin] PATH_INFO: `/v3/projects/47c88acfe79742df81c431dd8c92c7d6` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:41.417970 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944a0980-23a9-4c85-b7e7-49f86652f109 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47c88acfe79742df81c431dd8c92c7d6)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:41.421523 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944a0980-23a9-4c85-b7e7-49f86652f109 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:41.505195 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-ba6a4506-3f7c-4074-86a7-56a641f7b858 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '100f86b605bb41ecb2187e3dcfa2dc76', 'request_id': 'req-ba6a4506-3f7c-4074-86a7-56a641f7b858'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:41.528413 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-ba6a4506-3f7c-4074-86a7-56a641f7b858 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '100f86b605bb41ecb2187e3dcfa2dc76', 'request_id': 'req-ba6a4506-3f7c-4074-86a7-56a641f7b858'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:41.537706 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-944a0980-23a9-4c85-b7e7-49f86652f109 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47c88acfe79742df81c431dd8c92c7d6', 'request_id': 'req-944a0980-23a9-4c85-b7e7-49f86652f109'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:41.551368 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-ba6a4506-3f7c-4074-86a7-56a641f7b858 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '100f86b605bb41ecb2187e3dcfa2dc76', 'request_id': 'req-ba6a4506-3f7c-4074-86a7-56a641f7b858'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:41.552159 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-944a0980-23a9-4c85-b7e7-49f86652f109 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47c88acfe79742df81c431dd8c92c7d6', 'request_id': 'req-944a0980-23a9-4c85-b7e7-49f86652f109'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:41.568201 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-944a0980-23a9-4c85-b7e7-49f86652f109 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47c88acfe79742df81c431dd8c92c7d6', 'request_id': 'req-944a0980-23a9-4c85-b7e7-49f86652f109'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:41.573892 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-ba6a4506-3f7c-4074-86a7-56a641f7b858 admin admin] The token cache is being invalidate because project 100f86b605bb41ecb2187e3dcfa2dc76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:31:41.574187 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-ba6a4506-3f7c-4074-86a7-56a641f7b858 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:41.579030 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-ba6a4506-3f7c-4074-86a7-56a641f7b858 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:41.584243 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 840/1691] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:31:41 2022] DELETE /identity/v3/projects/100f86b605bb41ecb2187e3dcfa2dc76 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:31:41.588286 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22de88-c167-43bd-8673-9b7589c0995a None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:41.588286 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22de88-c167-43bd-8673-9b7589c0995a None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:41.588286 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22de88-c167-43bd-8673-9b7589c0995a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:41.600521 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-944a0980-23a9-4c85-b7e7-49f86652f109 admin admin] The token cache is being invalidate because project 47c88acfe79742df81c431dd8c92c7d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:31:41.600831 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-944a0980-23a9-4c85-b7e7-49f86652f109 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:41.602382 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-944a0980-23a9-4c85-b7e7-49f86652f109 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:41.611438 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 852/1692] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:31:41 2022] DELETE /identity/v3/projects/47c88acfe79742df81c431dd8c92c7d6 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:31:41.612732 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a0980-23a9-4c85-b7e7-49f86652f109 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:41.615632 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-944a0980-23a9-4c85-b7e7-49f86652f109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:41.646829 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-7c22de88-c167-43bd-8673-9b7589c0995a None None] MFA Rules not processed for user `28641197fb9b472dbe0aecd4dac3f4f3`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:41.652019 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-7c22de88-c167-43bd-8673-9b7589c0995a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:41.749167 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a0980-23a9-4c85-b7e7-49f86652f109 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:41.765080 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050633d-5dc9-4939-810c-e5c2e9fe7075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:41.768121 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050633d-5dc9-4939-810c-e5c2e9fe7075 admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:41.768411 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050633d-5dc9-4939-810c-e5c2e9fe7075 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:41.768690 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050633d-5dc9-4939-810c-e5c2e9fe7075 admin admin] PATH_INFO: `/v3/projects/02fb28be813a480ea49f887e50e952e3/users/8d11c2295e1a43ca9858168de633de8f/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:41.777923 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0050633d-5dc9-4939-810c-e5c2e9fe7075 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02fb28be813a480ea49f887e50e952e3, user_id=8d11c2295e1a43ca9858168de633de8f, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:41.784586 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0050633d-5dc9-4939-810c-e5c2e9fe7075 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:41.798220 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 841/1693] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:41.800441 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22de88-c167-43bd-8673-9b7589c0995a None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:41.803926 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-7c22de88-c167-43bd-8673-9b7589c0995a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:41.823574 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 853/1694] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:31:41 2022] PUT /identity/v3/projects/02fb28be813a480ea49f887e50e952e3/users/8d11c2295e1a43ca9858168de633de8f/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:31:41.823574 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b81d0d-b5fe-4572-a6e8-366f79d1689d None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:41.823574 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b81d0d-b5fe-4572-a6e8-366f79d1689d None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:41.823574 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b81d0d-b5fe-4572-a6e8-366f79d1689d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:41.845097 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22de88-c167-43bd-8673-9b7589c0995a None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:41.874468 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-66b81d0d-b5fe-4572-a6e8-366f79d1689d None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:41.877940 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-66b81d0d-b5fe-4572-a6e8-366f79d1689d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:41.994336 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba175d4d-7288-4669-9c81-34d93b0c0094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:41.995048 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba175d4d-7288-4669-9c81-34d93b0c0094 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:41.996802 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba175d4d-7288-4669-9c81-34d93b0c0094 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:41.997093 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba175d4d-7288-4669-9c81-34d93b0c0094 admin admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:41.997828 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba175d4d-7288-4669-9c81-34d93b0c0094 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:31:41.998972 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba175d4d-7288-4669-9c81-34d93b0c0094 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:42.003641 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba175d4d-7288-4669-9c81-34d93b0c0094 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:42.018639 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 854/1695] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:42.022345 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa4c98-741f-4e09-b04b-d7b8599a3868 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:42.022676 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa4c98-741f-4e09-b04b-d7b8599a3868 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:42.022963 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa4c98-741f-4e09-b04b-d7b8599a3868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:42.036047 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 842/1696] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:31:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:31:42.036985 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba175d4d-7288-4669-9c81-34d93b0c0094 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:42.048206 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-ba175d4d-7288-4669-9c81-34d93b0c0094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:42.082544 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-96aa4c98-741f-4e09-b04b-d7b8599a3868 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:42.084298 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-96aa4c98-741f-4e09-b04b-d7b8599a3868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:42.104219 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 855/1697] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:42.109563 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc040b-5941-4e63-8b26-c80f425f2972 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:42.109920 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc040b-5941-4e63-8b26-c80f425f2972 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:42.110213 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc040b-5941-4e63-8b26-c80f425f2972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:42.169009 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-aafc040b-5941-4e63-8b26-c80f425f2972 None None] MFA Rules not processed for user `8d11c2295e1a43ca9858168de633de8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:42.170482 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-aafc040b-5941-4e63-8b26-c80f425f2972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:42.210616 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba175d4d-7288-4669-9c81-34d93b0c0094 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:42.229130 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c834f2-32d6-456e-93d4-50657d49446a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec202a34db8e47f4a6c18285245e3f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:42.229890 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c834f2-32d6-456e-93d4-50657d49446a service nova] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:42.230176 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c834f2-32d6-456e-93d4-50657d49446a service nova] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:42.230452 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c834f2-32d6-456e-93d4-50657d49446a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:42.238365 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-78c834f2-32d6-456e-93d4-50657d49446a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:42.394391 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 856/1698] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:42 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:42.394391 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883721c2-ec4b-4bfd-9701-33d523cea536 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:42.394391 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883721c2-ec4b-4bfd-9701-33d523cea536 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:42.394391 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883721c2-ec4b-4bfd-9701-33d523cea536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:42.456850 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-883721c2-ec4b-4bfd-9701-33d523cea536 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:42.457996 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c834f2-32d6-456e-93d4-50657d49446a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:42.460588 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-883721c2-ec4b-4bfd-9701-33d523cea536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:42.462163 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c834f2-32d6-456e-93d4-50657d49446a service nova] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:42.478826 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 857/1699] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:42.479855 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883721c2-ec4b-4bfd-9701-33d523cea536 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:42.487135 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 843/1700] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:42 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:31:42.488664 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba92eea-919a-470c-8111-f7b96f502c5d None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:42.488942 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba92eea-919a-470c-8111-f7b96f502c5d None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:42.489202 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba92eea-919a-470c-8111-f7b96f502c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:42.499600 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883721c2-ec4b-4bfd-9701-33d523cea536 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:42.516563 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97102d1d-c757-49ab-9f0f-0058ab0b7e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:42.518669 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97102d1d-c757-49ab-9f0f-0058ab0b7e3f admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:42.521218 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97102d1d-c757-49ab-9f0f-0058ab0b7e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:42.521530 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97102d1d-c757-49ab-9f0f-0058ab0b7e3f admin admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:42.523786 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97102d1d-c757-49ab-9f0f-0058ab0b7e3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:42.534725 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97102d1d-c757-49ab-9f0f-0058ab0b7e3f admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:42.536451 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-bba92eea-919a-470c-8111-f7b96f502c5d None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:42.537700 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-bba92eea-919a-470c-8111-f7b96f502c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:42.584462 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 844/1701] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:42.585126 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba92eea-919a-470c-8111-f7b96f502c5d None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:42.592511 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-bba92eea-919a-470c-8111-f7b96f502c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:42.626577 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 858/1702] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:31:42 2022] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:31:42.631622 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97102d1d-c757-49ab-9f0f-0058ab0b7e3f admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:42.719039 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba92eea-919a-470c-8111-f7b96f502c5d None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:42.755066 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97102d1d-c757-49ab-9f0f-0058ab0b7e3f admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:42.763120 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8759e09-0056-4c4a-90e1-09f05638292e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:42.764614 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8759e09-0056-4c4a-90e1-09f05638292e admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:42.765102 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8759e09-0056-4c4a-90e1-09f05638292e admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:42.765595 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8759e09-0056-4c4a-90e1-09f05638292e admin admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:42.766853 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8759e09-0056-4c4a-90e1-09f05638292e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:31:42.768093 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8759e09-0056-4c4a-90e1-09f05638292e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:42.769978 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8759e09-0056-4c4a-90e1-09f05638292e admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:42.789890 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 859/1703] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:31:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:31:42.791143 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8759e09-0056-4c4a-90e1-09f05638292e admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:42.802714 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8759e09-0056-4c4a-90e1-09f05638292e admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:42.809853 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4424e00-8cb3-4eb3-a2ab-3313d2c85298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:42.811040 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4424e00-8cb3-4eb3-a2ab-3313d2c85298 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:42.811657 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4424e00-8cb3-4eb3-a2ab-3313d2c85298 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:42.812124 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4424e00-8cb3-4eb3-a2ab-3313d2c85298 admin admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:42.813039 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4424e00-8cb3-4eb3-a2ab-3313d2c85298 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:31:42.813530 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4424e00-8cb3-4eb3-a2ab-3313d2c85298 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:42.815416 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4424e00-8cb3-4eb3-a2ab-3313d2c85298 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:42.834550 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 860/1704] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:31:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:31:42.835713 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4424e00-8cb3-4eb3-a2ab-3313d2c85298 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:42.856219 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4910c-4038-4a0f-93c2-1a3561e2c25e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:42.856861 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4910c-4038-4a0f-93c2-1a3561e2c25e service cinder] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:42.857142 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4910c-4038-4a0f-93c2-1a3561e2c25e service cinder] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:42.857415 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4910c-4038-4a0f-93c2-1a3561e2c25e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:42.862584 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4424e00-8cb3-4eb3-a2ab-3313d2c85298 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:42.869409 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b6add3-961d-4aa3-ab12-5f70b81ae715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:42.870473 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6add3-961d-4aa3-ab12-5f70b81ae715 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:42.872085 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6add3-961d-4aa3-ab12-5f70b81ae715 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:42.872560 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6add3-961d-4aa3-ab12-5f70b81ae715 admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:42.873618 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b6add3-961d-4aa3-ab12-5f70b81ae715 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:42.875976 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b6add3-961d-4aa3-ab12-5f70b81ae715 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:42.919639 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 861/1705] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:31:42 2022] POST /identity/v3/users => generated 293 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:31:42.919639 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b6add3-961d-4aa3-ab12-5f70b81ae715 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:42.931654 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b6add3-961d-4aa3-ab12-5f70b81ae715 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:42.938869 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a33f7-bc47-4043-94dd-a95b28bc0695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:42.938869 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a33f7-bc47-4043-94dd-a95b28bc0695 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:42.939328 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a33f7-bc47-4043-94dd-a95b28bc0695 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:42.940402 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a33f7-bc47-4043-94dd-a95b28bc0695 admin admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:42.941658 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a33f7-bc47-4043-94dd-a95b28bc0695 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:42.943406 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a33f7-bc47-4043-94dd-a95b28bc0695 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:42.996405 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 862/1706] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:31:42 2022] POST /identity/v3/projects => generated 367 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:31:42.997436 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a33f7-bc47-4043-94dd-a95b28bc0695 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:43.022151 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4910c-4038-4a0f-93c2-1a3561e2c25e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:43.023537 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4910c-4038-4a0f-93c2-1a3561e2c25e service cinder] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:43.035692 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 845/1707] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:42 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:31:43.055088 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4910c-4038-4a0f-93c2-1a3561e2c25e service cinder] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:43.079876 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4910c-4038-4a0f-93c2-1a3561e2c25e service cinder] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:43.169161 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a33f7-bc47-4043-94dd-a95b28bc0695 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:43.177440 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba24837-f7f2-4a75-9a8d-933d0f509906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:43.187456 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba24837-f7f2-4a75-9a8d-933d0f509906 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:43.187771 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba24837-f7f2-4a75-9a8d-933d0f509906 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:43.188106 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba24837-f7f2-4a75-9a8d-933d0f509906 admin admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:43.189082 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba24837-f7f2-4a75-9a8d-933d0f509906 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:43.200688 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba24837-f7f2-4a75-9a8d-933d0f509906 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:43.231375 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc28ab-a4fd-49e4-bc36-c0afa84281cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:43.240488 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc28ab-a4fd-49e4-bc36-c0afa84281cc admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:43.242542 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc28ab-a4fd-49e4-bc36-c0afa84281cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:43.243071 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc28ab-a4fd-49e4-bc36-c0afa84281cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:43.247005 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc28ab-a4fd-49e4-bc36-c0afa84281cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:43.250820 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc28ab-a4fd-49e4-bc36-c0afa84281cc admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:43.252875 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 863/1708] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:31:42 2022] POST /identity/v3/projects => generated 393 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:31:43.253800 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba24837-f7f2-4a75-9a8d-933d0f509906 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:43.284991 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 846/1709] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:31:43.284991 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0a912-e61d-4131-a63e-8940329fc8c3 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:43.285657 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0a912-e61d-4131-a63e-8940329fc8c3 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:43.285657 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0a912-e61d-4131-a63e-8940329fc8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:43.331819 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-02f0a912-e61d-4131-a63e-8940329fc8c3 None None] MFA Rules not processed for user `1c1284bfe6cc43848731ed2b3d9e914b`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:43.334200 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-02f0a912-e61d-4131-a63e-8940329fc8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:43.441378 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba24837-f7f2-4a75-9a8d-933d0f509906 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:43.454350 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46908751-a92e-4c25-867a-1f28bfdbfdfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:43.458777 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46908751-a92e-4c25-867a-1f28bfdbfdfc admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:43.459122 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46908751-a92e-4c25-867a-1f28bfdbfdfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:43.459413 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46908751-a92e-4c25-867a-1f28bfdbfdfc admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:43.460144 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46908751-a92e-4c25-867a-1f28bfdbfdfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:43.463085 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46908751-a92e-4c25-867a-1f28bfdbfdfc admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:43.469084 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 847/1710] 10.222.0.21 () {58 vars in 1009 bytes} [Mon Feb 28 10:31:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:43.471068 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f0a912-e61d-4131-a63e-8940329fc8c3 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:43.519794 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f0a912-e61d-4131-a63e-8940329fc8c3 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:43.524180 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 864/1711] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:31:43 2022] POST /identity/v3/users => generated 284 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:31:43.526236 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46908751-a92e-4c25-867a-1f28bfdbfdfc admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:43.543700 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c1a1e8-952f-43c4-93c0-8ac7f2beb4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:43.546387 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1a1e8-952f-43c4-93c0-8ac7f2beb4d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:43.546756 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1a1e8-952f-43c4-93c0-8ac7f2beb4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:43.547325 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1a1e8-952f-43c4-93c0-8ac7f2beb4d1 admin admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:43.548213 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c1a1e8-952f-43c4-93c0-8ac7f2beb4d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:43.552491 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c1a1e8-952f-43c4-93c0-8ac7f2beb4d1 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:43.567272 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46908751-a92e-4c25-867a-1f28bfdbfdfc admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:43.579066 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72680512-5e32-4428-9c1e-39ffee0d3c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:43.579756 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72680512-5e32-4428-9c1e-39ffee0d3c18 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:43.580038 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72680512-5e32-4428-9c1e-39ffee0d3c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:43.580308 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72680512-5e32-4428-9c1e-39ffee0d3c18 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:43.581130 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72680512-5e32-4428-9c1e-39ffee0d3c18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:43.582639 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72680512-5e32-4428-9c1e-39ffee0d3c18 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:43.627720 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 848/1712] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:31:43 2022] POST /identity/v3/users => generated 297 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:31:43.628872 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c1a1e8-952f-43c4-93c0-8ac7f2beb4d1 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:43.633427 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 865/1713] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:31:43.634409 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72680512-5e32-4428-9c1e-39ffee0d3c18 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:43.642678 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c1a1e8-952f-43c4-93c0-8ac7f2beb4d1 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:43.648275 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359adde-a79c-4c48-9c20-74c8339cb2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:43.649223 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359adde-a79c-4c48-9c20-74c8339cb2f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:43.649687 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359adde-a79c-4c48-9c20-74c8339cb2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:43.650136 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359adde-a79c-4c48-9c20-74c8339cb2f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:43.651054 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3359adde-a79c-4c48-9c20-74c8339cb2f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:43.653894 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3359adde-a79c-4c48-9c20-74c8339cb2f0 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:43.661884 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72680512-5e32-4428-9c1e-39ffee0d3c18 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:43.675340 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 849/1714] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:31:43.675704 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df34b7-5ea3-4bcd-a7f9-7fc3f2c60c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:43.676604 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df34b7-5ea3-4bcd-a7f9-7fc3f2c60c1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:43.676882 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df34b7-5ea3-4bcd-a7f9-7fc3f2c60c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:43.677159 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df34b7-5ea3-4bcd-a7f9-7fc3f2c60c1f admin admin] PATH_INFO: `/v3/users/a5df10b477144385b096642c5ca14149` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:43.677859 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359adde-a79c-4c48-9c20-74c8339cb2f0 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:43.679388 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df34b7-5ea3-4bcd-a7f9-7fc3f2c60c1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5df10b477144385b096642c5ca14149)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:43.681306 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df34b7-5ea3-4bcd-a7f9-7fc3f2c60c1f admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:43.694713 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359adde-a79c-4c48-9c20-74c8339cb2f0 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:43.700713 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cdb917-16fd-4a4d-8ceb-a1c7bdf7c1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:43.701644 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cdb917-16fd-4a4d-8ceb-a1c7bdf7c1b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:43.705872 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cdb917-16fd-4a4d-8ceb-a1c7bdf7c1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:43.709569 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cdb917-16fd-4a4d-8ceb-a1c7bdf7c1b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:43.716119 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cdb917-16fd-4a4d-8ceb-a1c7bdf7c1b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:43.717679 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cdb917-16fd-4a4d-8ceb-a1c7bdf7c1b3 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:43.754379 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 850/1715] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:31:43.758074 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cdb917-16fd-4a4d-8ceb-a1c7bdf7c1b3 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:43.781231 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-65df34b7-5ea3-4bcd-a7f9-7fc3f2c60c1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5df10b477144385b096642c5ca14149'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:43.784057 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cdb917-16fd-4a4d-8ceb-a1c7bdf7c1b3 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:43.794629 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-65df34b7-5ea3-4bcd-a7f9-7fc3f2c60c1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5df10b477144385b096642c5ca14149'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:43.795382 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-65df34b7-5ea3-4bcd-a7f9-7fc3f2c60c1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5df10b477144385b096642c5ca14149'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:43.799592 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e1daa-8817-4c71-b96a-cf6da04329a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:43.800864 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e1daa-8817-4c71-b96a-cf6da04329a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:43.800864 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e1daa-8817-4c71-b96a-cf6da04329a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:43.801136 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e1daa-8817-4c71-b96a-cf6da04329a4 admin admin] PATH_INFO: `/v3/projects/6191872ccd434d42bc1cafaf678777a0/users/5f20b659ac394405b0eca014309d53a5/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:43.819470 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-65df34b7-5ea3-4bcd-a7f9-7fc3f2c60c1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5df10b477144385b096642c5ca14149'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:43.836688 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-65df34b7-5ea3-4bcd-a7f9-7fc3f2c60c1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5df10b477144385b096642c5ca14149'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:43.846636 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e1daa-8817-4c71-b96a-cf6da04329a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6191872ccd434d42bc1cafaf678777a0, user_id=5f20b659ac394405b0eca014309d53a5, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:43.858640 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 866/1716] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:31:43 2022] DELETE /identity/v3/users/a5df10b477144385b096642c5ca14149 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:31:43.858800 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e1daa-8817-4c71-b96a-cf6da04329a4 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:43.858880 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df34b7-5ea3-4bcd-a7f9-7fc3f2c60c1f admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:43.862370 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-65df34b7-5ea3-4bcd-a7f9-7fc3f2c60c1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:43.886576 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 851/1717] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:31:43 2022] PUT /identity/v3/projects/6191872ccd434d42bc1cafaf678777a0/users/5f20b659ac394405b0eca014309d53a5/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:31:43.898666 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e1daa-8817-4c71-b96a-cf6da04329a4 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:43.903366 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-707e1daa-8817-4c71-b96a-cf6da04329a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:44.054421 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e1daa-8817-4c71-b96a-cf6da04329a4 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:44.056234 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df34b7-5ea3-4bcd-a7f9-7fc3f2c60c1f admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:44.062447 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970bab81-66e0-4823-9f45-52bb9a09c144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:44.063870 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bab81-66e0-4823-9f45-52bb9a09c144 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:44.064352 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bab81-66e0-4823-9f45-52bb9a09c144 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:44.064822 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bab81-66e0-4823-9f45-52bb9a09c144 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:44.066271 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970bab81-66e0-4823-9f45-52bb9a09c144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:44.067885 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63debd73-6f92-42ce-b85d-cae01b65a61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:44.068547 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63debd73-6f92-42ce-b85d-cae01b65a61a admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:44.068835 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63debd73-6f92-42ce-b85d-cae01b65a61a admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:44.069113 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63debd73-6f92-42ce-b85d-cae01b65a61a admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:44.069845 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63debd73-6f92-42ce-b85d-cae01b65a61a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:44.071498 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63debd73-6f92-42ce-b85d-cae01b65a61a admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:44.093436 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970bab81-66e0-4823-9f45-52bb9a09c144 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:44.094699 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 867/1718] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:31:44.095918 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63debd73-6f92-42ce-b85d-cae01b65a61a admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:44.107083 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-63debd73-6f92-42ce-b85d-cae01b65a61a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:44.118622 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 852/1719] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:31:44.120579 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597a09d-6a75-4071-b1a6-5baa1455bc88 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:44.121108 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597a09d-6a75-4071-b1a6-5baa1455bc88 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:44.122082 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597a09d-6a75-4071-b1a6-5baa1455bc88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:44.146906 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-7597a09d-6a75-4071-b1a6-5baa1455bc88 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:44.148411 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-7597a09d-6a75-4071-b1a6-5baa1455bc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:44.159999 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 853/1720] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:44.161784 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa7e0a-7808-478a-9721-54b52b546c2e None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:44.162274 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa7e0a-7808-478a-9721-54b52b546c2e None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:44.162772 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa7e0a-7808-478a-9721-54b52b546c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:44.204694 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-cafa7e0a-7808-478a-9721-54b52b546c2e None None] MFA Rules not processed for user `5f20b659ac394405b0eca014309d53a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:44.206138 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-cafa7e0a-7808-478a-9721-54b52b546c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:44.266704 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63debd73-6f92-42ce-b85d-cae01b65a61a admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:44.272111 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9afb90-7edf-48bf-8dd6-125a07fa9f74 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8696fe8a37aa4d73a62bdc2efd35a23d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:44.273315 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9afb90-7edf-48bf-8dd6-125a07fa9f74 service swift] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:44.273315 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9afb90-7edf-48bf-8dd6-125a07fa9f74 service swift] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:44.273512 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9afb90-7edf-48bf-8dd6-125a07fa9f74 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:44.275644 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-3c9afb90-7edf-48bf-8dd6-125a07fa9f74 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:44.311265 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 854/1721] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:44.315905 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa7e0a-7808-478a-9721-54b52b546c2e None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:44.329315 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa7e0a-7808-478a-9721-54b52b546c2e None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:44.334989 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e2b00-71b8-49bc-85b7-b17867097067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:44.336188 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e2b00-71b8-49bc-85b7-b17867097067 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:44.337072 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e2b00-71b8-49bc-85b7-b17867097067 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:44.337547 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e2b00-71b8-49bc-85b7-b17867097067 admin admin] PATH_INFO: `/v3/projects/92347566f70849d593406528ced5d47a/users/2ffe146cc2584d6697be0baec0d76263/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:44.358457 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107e2b00-71b8-49bc-85b7-b17867097067 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92347566f70849d593406528ced5d47a, user_id=2ffe146cc2584d6697be0baec0d76263, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:44.362156 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107e2b00-71b8-49bc-85b7-b17867097067 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:44.390886 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 855/1722] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:31:44 2022] PUT /identity/v3/projects/92347566f70849d593406528ced5d47a/users/2ffe146cc2584d6697be0baec0d76263/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:31:44.391971 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e2b00-71b8-49bc-85b7-b17867097067 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:44.436358 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9afb90-7edf-48bf-8dd6-125a07fa9f74 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:44.438146 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9afb90-7edf-48bf-8dd6-125a07fa9f74 service swift] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:44.447808 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 868/1723] 10.222.0.21 () {60 vars in 1384 bytes} [Mon Feb 28 10:31:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 10:31:44.449452 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9afb90-7edf-48bf-8dd6-125a07fa9f74 service swift] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:44.450865 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-3c9afb90-7edf-48bf-8dd6-125a07fa9f74 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:44.578987 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9afb90-7edf-48bf-8dd6-125a07fa9f74 service swift] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:44.649050 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e2b00-71b8-49bc-85b7-b17867097067 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:44.661697 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde0776-e90a-46f7-bea8-a51103e14402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:44.668327 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde0776-e90a-46f7-bea8-a51103e14402 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:44.669009 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde0776-e90a-46f7-bea8-a51103e14402 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:44.669612 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde0776-e90a-46f7-bea8-a51103e14402 admin admin] PATH_INFO: `/v3/projects/0763c8f1415e4b01ba6da03fbb2cd637/users/4dfe4a7a3db341558dde891bc8904842/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:44.695949 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54b27d-a94f-4c07-bd2d-2fe46b6bf961 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:44.697500 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54b27d-a94f-4c07-bd2d-2fe46b6bf961 service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:44.698867 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54b27d-a94f-4c07-bd2d-2fe46b6bf961 service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:44.701018 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54b27d-a94f-4c07-bd2d-2fe46b6bf961 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:44.701397 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfde0776-e90a-46f7-bea8-a51103e14402 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0763c8f1415e4b01ba6da03fbb2cd637, user_id=4dfe4a7a3db341558dde891bc8904842, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:44.705505 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfde0776-e90a-46f7-bea8-a51103e14402 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:44.719310 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a54b27d-a94f-4c07-bd2d-2fe46b6bf961 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:44.721384 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a54b27d-a94f-4c07-bd2d-2fe46b6bf961 service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:44.734937 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 856/1724] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:31:44 2022] PUT /identity/v3/projects/0763c8f1415e4b01ba6da03fbb2cd637/users/4dfe4a7a3db341558dde891bc8904842/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:31:44.736075 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde0776-e90a-46f7-bea8-a51103e14402 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:44.739310 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-bfde0776-e90a-46f7-bea8-a51103e14402 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:44.764662 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 869/1725] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:31:44.768956 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf59d4-1579-46af-a15c-b27d69a0754c None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:44.770907 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf59d4-1579-46af-a15c-b27d69a0754c None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:44.772866 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf59d4-1579-46af-a15c-b27d69a0754c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:44.903163 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-5ddf59d4-1579-46af-a15c-b27d69a0754c None None] MFA Rules not processed for user `2ffe146cc2584d6697be0baec0d76263`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:44.909202 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-5ddf59d4-1579-46af-a15c-b27d69a0754c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:45.011888 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde0776-e90a-46f7-bea8-a51103e14402 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:45.043845 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e5eaf-1cdd-463d-84ea-27911b4577d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:45.045726 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e5eaf-1cdd-463d-84ea-27911b4577d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:45.046742 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e5eaf-1cdd-463d-84ea-27911b4577d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:45.047851 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e5eaf-1cdd-463d-84ea-27911b4577d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:45.050104 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e5eaf-1cdd-463d-84ea-27911b4577d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:45.058281 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e5eaf-1cdd-463d-84ea-27911b4577d9 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:45.195629 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 870/1726] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:44 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:45.202147 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb75d77-7c9c-4307-8f91-bdbb4bfc78fb None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:45.202717 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb75d77-7c9c-4307-8f91-bdbb4bfc78fb None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:45.203197 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb75d77-7c9c-4307-8f91-bdbb4bfc78fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:45.235815 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 857/1727] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:31:44 2022] POST /identity/v3/projects => generated 387 bytes in 500 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:31:45.237434 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e5eaf-1cdd-463d-84ea-27911b4577d9 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:45.244875 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-394e5eaf-1cdd-463d-84ea-27911b4577d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:45.254226 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-3bb75d77-7c9c-4307-8f91-bdbb4bfc78fb None None] MFA Rules not processed for user `4dfe4a7a3db341558dde891bc8904842`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:45.255738 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-3bb75d77-7c9c-4307-8f91-bdbb4bfc78fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:45.484522 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e5eaf-1cdd-463d-84ea-27911b4577d9 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:45.504321 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b6b8a-dad7-46e6-9ee9-bd69fb72790f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:45.507569 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b6b8a-dad7-46e6-9ee9-bd69fb72790f service cinder] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:45.510636 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b6b8a-dad7-46e6-9ee9-bd69fb72790f service cinder] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:45.512111 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b6b8a-dad7-46e6-9ee9-bd69fb72790f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:45.523792 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 871/1728] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:45.526224 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb75d77-7c9c-4307-8f91-bdbb4bfc78fb None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:45.741969 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb75d77-7c9c-4307-8f91-bdbb4bfc78fb None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:45.742173 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b6b8a-dad7-46e6-9ee9-bd69fb72790f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:45.746723 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b6b8a-dad7-46e6-9ee9-bd69fb72790f service cinder] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:45.770037 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44c336-be22-416a-9b13-458cf9490bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:45.771227 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44c336-be22-416a-9b13-458cf9490bfa admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:45.773975 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44c336-be22-416a-9b13-458cf9490bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:45.775758 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44c336-be22-416a-9b13-458cf9490bfa admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:45.775869 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 858/1729] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:45 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:31:45.779315 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963ca63-4874-479a-b46a-c4ad7d379684 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:45.779612 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963ca63-4874-479a-b46a-c4ad7d379684 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:45.779895 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963ca63-4874-479a-b46a-c4ad7d379684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:45.781169 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a44c336-be22-416a-9b13-458cf9490bfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:45.787967 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a44c336-be22-416a-9b13-458cf9490bfa admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:45.846814 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 872/1730] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:31:45 2022] POST /identity/v3/users => generated 300 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:31:45.847888 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44c336-be22-416a-9b13-458cf9490bfa admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:45.865277 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-f963ca63-4874-479a-b46a-c4ad7d379684 None None] MFA Rules not processed for user `da9524bba20140f694ac7cd6e8f37038`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:45.867423 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-f963ca63-4874-479a-b46a-c4ad7d379684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:45.876493 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44c336-be22-416a-9b13-458cf9490bfa admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:45.889995 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823951d-00a2-426e-a862-9e8ddb35db25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:45.893697 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823951d-00a2-426e-a862-9e8ddb35db25 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:45.894107 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823951d-00a2-426e-a862-9e8ddb35db25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:45.894552 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823951d-00a2-426e-a862-9e8ddb35db25 admin admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:45.896672 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1823951d-00a2-426e-a862-9e8ddb35db25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:45.903736 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1823951d-00a2-426e-a862-9e8ddb35db25 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:46.030901 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 873/1731] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:31:45 2022] POST /identity/v3/projects => generated 393 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:31:46.035219 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823951d-00a2-426e-a862-9e8ddb35db25 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:46.185696 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 859/1732] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:46.185696 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f963ca63-4874-479a-b46a-c4ad7d379684 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:46.210768 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f963ca63-4874-479a-b46a-c4ad7d379684 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:46.359577 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b8bc2-c76a-4043-92ef-7f2422bf4d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:46.360344 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b8bc2-c76a-4043-92ef-7f2422bf4d35 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:46.360572 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b8bc2-c76a-4043-92ef-7f2422bf4d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:46.360847 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b8bc2-c76a-4043-92ef-7f2422bf4d35 admin admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:46.361538 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b8bc2-c76a-4043-92ef-7f2422bf4d35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:46.363509 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b8bc2-c76a-4043-92ef-7f2422bf4d35 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:46.378314 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823951d-00a2-426e-a862-9e8ddb35db25 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:46.421744 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 860/1733] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:31:46 2022] POST /identity/v3/users => generated 303 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:31:46.422753 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b8bc2-c76a-4043-92ef-7f2422bf4d35 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:46.430651 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caccf5be-0ba2-46ae-9269-e41053d6d407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:46.431907 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caccf5be-0ba2-46ae-9269-e41053d6d407 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:46.434929 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caccf5be-0ba2-46ae-9269-e41053d6d407 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:46.435420 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-df4b8bc2-c76a-4043-92ef-7f2422bf4d35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:46.435976 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caccf5be-0ba2-46ae-9269-e41053d6d407 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:46.437737 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caccf5be-0ba2-46ae-9269-e41053d6d407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:46.452104 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caccf5be-0ba2-46ae-9269-e41053d6d407 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:46.503873 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 874/1734] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 472 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:31:46.507219 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caccf5be-0ba2-46ae-9269-e41053d6d407 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:46.548152 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caccf5be-0ba2-46ae-9269-e41053d6d407 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:46.579634 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e7d7e-d38c-4da9-9326-a6f6ab3f84c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:46.580440 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e7d7e-d38c-4da9-9326-a6f6ab3f84c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:46.581751 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e7d7e-d38c-4da9-9326-a6f6ab3f84c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:46.584644 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e7d7e-d38c-4da9-9326-a6f6ab3f84c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:46.586702 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e7d7e-d38c-4da9-9326-a6f6ab3f84c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:46.608221 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e7d7e-d38c-4da9-9326-a6f6ab3f84c3 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:46.621340 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b8bc2-c76a-4043-92ef-7f2422bf4d35 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:46.639978 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce0fc5b-8ac1-4f3f-bd34-1620b91a1766 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec202a34db8e47f4a6c18285245e3f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:46.640667 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0fc5b-8ac1-4f3f-bd34-1620b91a1766 service nova] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:46.640952 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0fc5b-8ac1-4f3f-bd34-1620b91a1766 service nova] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:46.641226 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0fc5b-8ac1-4f3f-bd34-1620b91a1766 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:46.668083 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 875/1735] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:31:46.669203 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e7d7e-d38c-4da9-9326-a6f6ab3f84c3 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:46.695345 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e7d7e-d38c-4da9-9326-a6f6ab3f84c3 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:46.715843 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53225ab9-a468-4be2-940b-a21d21a8b663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:46.726790 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53225ab9-a468-4be2-940b-a21d21a8b663 admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:46.727081 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53225ab9-a468-4be2-940b-a21d21a8b663 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:46.727399 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53225ab9-a468-4be2-940b-a21d21a8b663 admin admin] PATH_INFO: `/v3/projects/c167f6c60ece44bfa68473ab965726c3/users/1a41984db62844a1b50c49402b9fcde2/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:46.736935 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce0fc5b-8ac1-4f3f-bd34-1620b91a1766 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:46.739017 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce0fc5b-8ac1-4f3f-bd34-1620b91a1766 service nova] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:46.751964 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 861/1736] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:31:46.753665 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75685b6-d5c9-4762-9eba-7fa04aa133fe None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:46.754118 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75685b6-d5c9-4762-9eba-7fa04aa133fe None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:46.754415 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75685b6-d5c9-4762-9eba-7fa04aa133fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:46.798543 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53225ab9-a468-4be2-940b-a21d21a8b663 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c167f6c60ece44bfa68473ab965726c3, user_id=1a41984db62844a1b50c49402b9fcde2, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:46.807872 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-f75685b6-d5c9-4762-9eba-7fa04aa133fe None None] MFA Rules not processed for user `28641197fb9b472dbe0aecd4dac3f4f3`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:46.811016 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53225ab9-a468-4be2-940b-a21d21a8b663 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:46.813106 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-f75685b6-d5c9-4762-9eba-7fa04aa133fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:46.876932 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 876/1737] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:31:46 2022] PUT /identity/v3/projects/c167f6c60ece44bfa68473ab965726c3/users/1a41984db62844a1b50c49402b9fcde2/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:31:46.878534 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53225ab9-a468-4be2-940b-a21d21a8b663 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:46.990125 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 862/1738] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:46.999452 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75685b6-d5c9-4762-9eba-7fa04aa133fe None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:47.028148 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75685b6-d5c9-4762-9eba-7fa04aa133fe None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:47.079347 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53225ab9-a468-4be2-940b-a21d21a8b663 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:47.092287 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3f4cc-7fad-4ed7-aabe-bdb16879b39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:47.093220 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3f4cc-7fad-4ed7-aabe-bdb16879b39a admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:47.093697 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3f4cc-7fad-4ed7-aabe-bdb16879b39a admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:47.095028 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3f4cc-7fad-4ed7-aabe-bdb16879b39a admin admin] PATH_INFO: `/v3/projects/bef9d138108a4e05a7f412acd70b7759/users/1737376480f840b4a607a5ddbfc29dfd/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:47.171285 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa3f4cc-7fad-4ed7-aabe-bdb16879b39a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bef9d138108a4e05a7f412acd70b7759, user_id=1737376480f840b4a607a5ddbfc29dfd, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:47.187119 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa3f4cc-7fad-4ed7-aabe-bdb16879b39a admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:47.188373 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7b6d5-8d99-4466-8460-a0f84fca87ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:47.189188 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7b6d5-8d99-4466-8460-a0f84fca87ee admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:47.189785 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7b6d5-8d99-4466-8460-a0f84fca87ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:47.190885 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7b6d5-8d99-4466-8460-a0f84fca87ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:47.195156 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb7b6d5-8d99-4466-8460-a0f84fca87ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:47.216720 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb7b6d5-8d99-4466-8460-a0f84fca87ee admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:47.244416 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 877/1739] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:31:46 2022] PUT /identity/v3/projects/bef9d138108a4e05a7f412acd70b7759/users/1737376480f840b4a607a5ddbfc29dfd/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:31:47.246561 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 863/1740] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:31:47.248964 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3f4cc-7fad-4ed7-aabe-bdb16879b39a admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:47.251185 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7b6d5-8d99-4466-8460-a0f84fca87ee admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:47.292396 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7b6d5-8d99-4466-8460-a0f84fca87ee admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:47.534191 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3f4cc-7fad-4ed7-aabe-bdb16879b39a admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:47.552058 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c820c91-0e6e-4168-84d9-9e03a44c3148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:47.553348 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c820c91-0e6e-4168-84d9-9e03a44c3148 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:47.553639 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c820c91-0e6e-4168-84d9-9e03a44c3148 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:47.554892 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c820c91-0e6e-4168-84d9-9e03a44c3148 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:47.557423 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c820c91-0e6e-4168-84d9-9e03a44c3148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:47.566247 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d3ff7-fa44-458d-b3fd-377f812672a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:47.569017 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d3ff7-fa44-458d-b3fd-377f812672a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:47.569804 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d3ff7-fa44-458d-b3fd-377f812672a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:47.571063 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d3ff7-fa44-458d-b3fd-377f812672a6 admin admin] PATH_INFO: `/v3/projects/c167f6c60ece44bfa68473ab965726c3/users/1a41984db62844a1b50c49402b9fcde2/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:47.573438 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c820c91-0e6e-4168-84d9-9e03a44c3148 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:47.592948 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469d3ff7-fa44-458d-b3fd-377f812672a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c167f6c60ece44bfa68473ab965726c3, user_id=1a41984db62844a1b50c49402b9fcde2, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:47.597836 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469d3ff7-fa44-458d-b3fd-377f812672a6 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:47.624638 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 878/1741] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:31:47.625714 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c820c91-0e6e-4168-84d9-9e03a44c3148 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:47.650856 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 864/1742] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:31:47 2022] PUT /identity/v3/projects/c167f6c60ece44bfa68473ab965726c3/users/1a41984db62844a1b50c49402b9fcde2/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:31:47.662583 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305e9a3-acde-4869-a56d-a3ea06d4e48d None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:47.662967 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305e9a3-acde-4869-a56d-a3ea06d4e48d None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:47.663341 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305e9a3-acde-4869-a56d-a3ea06d4e48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:47.688454 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c820c91-0e6e-4168-84d9-9e03a44c3148 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:47.783889 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-3305e9a3-acde-4869-a56d-a3ea06d4e48d None None] MFA Rules not processed for user `1a41984db62844a1b50c49402b9fcde2`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:47.798873 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-3305e9a3-acde-4869-a56d-a3ea06d4e48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:48.063453 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f848abc-5d92-40d5-bf06-0d049a39411b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:48.065043 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f848abc-5d92-40d5-bf06-0d049a39411b admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:48.065494 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f848abc-5d92-40d5-bf06-0d049a39411b admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:48.066110 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f848abc-5d92-40d5-bf06-0d049a39411b admin admin] PATH_INFO: `/v3/projects/bef9d138108a4e05a7f412acd70b7759/users/1737376480f840b4a607a5ddbfc29dfd/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:48.072708 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f848abc-5d92-40d5-bf06-0d049a39411b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bef9d138108a4e05a7f412acd70b7759, user_id=1737376480f840b4a607a5ddbfc29dfd, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:48.083009 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f848abc-5d92-40d5-bf06-0d049a39411b admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:48.133083 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 879/1743] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:31:47 2022] PUT /identity/v3/projects/bef9d138108a4e05a7f412acd70b7759/users/1737376480f840b4a607a5ddbfc29dfd/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:31:48.134947 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f848abc-5d92-40d5-bf06-0d049a39411b admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:48.145188 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-1f848abc-5d92-40d5-bf06-0d049a39411b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:48.179778 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 865/1744] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:47 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 518 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:31:48.181285 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a575b-34af-4f35-aafd-498ea3ea0976 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:48.181576 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a575b-34af-4f35-aafd-498ea3ea0976 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:48.181855 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a575b-34af-4f35-aafd-498ea3ea0976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:48.314465 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-c20a575b-34af-4f35-aafd-498ea3ea0976 None None] MFA Rules not processed for user `1737376480f840b4a607a5ddbfc29dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:48.338271 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-c20a575b-34af-4f35-aafd-498ea3ea0976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:48.359114 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f848abc-5d92-40d5-bf06-0d049a39411b admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:48.400923 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110db1d-83e9-4455-84bf-0a0339f74e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:48.403399 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110db1d-83e9-4455-84bf-0a0339f74e0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:48.403699 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110db1d-83e9-4455-84bf-0a0339f74e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:48.406580 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110db1d-83e9-4455-84bf-0a0339f74e0b admin admin] PATH_INFO: `/v3/projects/dc7b720f29804a9f816e2fdc4c1317a3` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:48.410242 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1110db1d-83e9-4455-84bf-0a0339f74e0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc7b720f29804a9f816e2fdc4c1317a3)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:48.424721 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1110db1d-83e9-4455-84bf-0a0339f74e0b admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:48.625010 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-1110db1d-83e9-4455-84bf-0a0339f74e0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc7b720f29804a9f816e2fdc4c1317a3', 'request_id': 'req-1110db1d-83e9-4455-84bf-0a0339f74e0b'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:48.641961 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-1110db1d-83e9-4455-84bf-0a0339f74e0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc7b720f29804a9f816e2fdc4c1317a3', 'request_id': 'req-1110db1d-83e9-4455-84bf-0a0339f74e0b'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:48.662278 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-1110db1d-83e9-4455-84bf-0a0339f74e0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc7b720f29804a9f816e2fdc4c1317a3', 'request_id': 'req-1110db1d-83e9-4455-84bf-0a0339f74e0b'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:48.690067 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-1110db1d-83e9-4455-84bf-0a0339f74e0b admin admin] The token cache is being invalidate because project dc7b720f29804a9f816e2fdc4c1317a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:31:48.692817 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-1110db1d-83e9-4455-84bf-0a0339f74e0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:48.695511 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-1110db1d-83e9-4455-84bf-0a0339f74e0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:48.701843 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 880/1745] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:31:48 2022] DELETE /identity/v3/projects/dc7b720f29804a9f816e2fdc4c1317a3 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:31:48.701843 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110db1d-83e9-4455-84bf-0a0339f74e0b admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:48.704531 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-1110db1d-83e9-4455-84bf-0a0339f74e0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:48.782040 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 866/1746] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:48 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 602 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:48.788261 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5eb793-f3fa-4424-9834-008df719c64a None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:48.789482 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5eb793-f3fa-4424-9834-008df719c64a None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:48.789765 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5eb793-f3fa-4424-9834-008df719c64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:48.807535 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110db1d-83e9-4455-84bf-0a0339f74e0b admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:48.815753 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e74eb-9f8b-4586-82a8-4eee85f6438d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:48.816699 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e74eb-9f8b-4586-82a8-4eee85f6438d service cinder] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:48.817297 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e74eb-9f8b-4586-82a8-4eee85f6438d service cinder] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:48.817715 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e74eb-9f8b-4586-82a8-4eee85f6438d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:48.821230 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-0f9e74eb-9f8b-4586-82a8-4eee85f6438d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:48.918541 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-ac5eb793-f3fa-4424-9834-008df719c64a None None] MFA Rules not processed for user `abaa12b94c834676bb17bf997dace5d1`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:48.925342 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-ac5eb793-f3fa-4424-9834-008df719c64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:48.935532 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e74eb-9f8b-4586-82a8-4eee85f6438d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:48.937288 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e74eb-9f8b-4586-82a8-4eee85f6438d service cinder] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:48.954791 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 881/1747] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:31:48.972989 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e74eb-9f8b-4586-82a8-4eee85f6438d service cinder] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:48.978438 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-0f9e74eb-9f8b-4586-82a8-4eee85f6438d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:49.109813 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e74eb-9f8b-4586-82a8-4eee85f6438d service cinder] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:49.118772 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32b278-7871-4dfb-bdb9-9690cc3309f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:49.119856 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32b278-7871-4dfb-bdb9-9690cc3309f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:49.120604 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32b278-7871-4dfb-bdb9-9690cc3309f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:49.121112 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32b278-7871-4dfb-bdb9-9690cc3309f3 admin admin] PATH_INFO: `/v3/users/8d11c2295e1a43ca9858168de633de8f` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:49.124337 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32b278-7871-4dfb-bdb9-9690cc3309f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d11c2295e1a43ca9858168de633de8f)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:49.126514 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32b278-7871-4dfb-bdb9-9690cc3309f3 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:49.215576 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 867/1748] 10.222.0.26 () {58 vars in 1015 bytes} [Mon Feb 28 10:31:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 433 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:49.217545 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5eb793-f3fa-4424-9834-008df719c64a None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:49.247445 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5eb793-f3fa-4424-9834-008df719c64a None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:49.254261 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee0463-41c8-4015-b3cc-66a8a217afb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:49.257242 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee0463-41c8-4015-b3cc-66a8a217afb1 service cinder] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:49.258222 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee0463-41c8-4015-b3cc-66a8a217afb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:49.258817 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee0463-41c8-4015-b3cc-66a8a217afb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:49.284626 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-ff32b278-7871-4dfb-bdb9-9690cc3309f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d11c2295e1a43ca9858168de633de8f'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:49.309068 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-ff32b278-7871-4dfb-bdb9-9690cc3309f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d11c2295e1a43ca9858168de633de8f'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:49.309763 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-ff32b278-7871-4dfb-bdb9-9690cc3309f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d11c2295e1a43ca9858168de633de8f'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:49.359000 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-ff32b278-7871-4dfb-bdb9-9690cc3309f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d11c2295e1a43ca9858168de633de8f'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:49.392209 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-ff32b278-7871-4dfb-bdb9-9690cc3309f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d11c2295e1a43ca9858168de633de8f'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:49.408039 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 882/1749] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:31:48 2022] DELETE /identity/v3/users/8d11c2295e1a43ca9858168de633de8f => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:31:49.411164 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32b278-7871-4dfb-bdb9-9690cc3309f3 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:49.411164 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-ff32b278-7871-4dfb-bdb9-9690cc3309f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:49.642944 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ee0463-41c8-4015-b3cc-66a8a217afb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:49.648295 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ee0463-41c8-4015-b3cc-66a8a217afb1 service cinder] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:49.652093 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32b278-7871-4dfb-bdb9-9690cc3309f3 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:49.668569 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea41219-0c2b-4cb6-91fb-86fdd10f8361 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:49.670854 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea41219-0c2b-4cb6-91fb-86fdd10f8361 service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:49.671871 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea41219-0c2b-4cb6-91fb-86fdd10f8361 service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:49.672211 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea41219-0c2b-4cb6-91fb-86fdd10f8361 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:49.676228 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-2ea41219-0c2b-4cb6-91fb-86fdd10f8361 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:49.692051 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 868/1750] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:49 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:31:49.738652 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea41219-0c2b-4cb6-91fb-86fdd10f8361 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:49.743918 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea41219-0c2b-4cb6-91fb-86fdd10f8361 service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:49.780932 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 883/1751] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:31:49.795026 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee0463-41c8-4015-b3cc-66a8a217afb1 service cinder] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:49.796484 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-50ee0463-41c8-4015-b3cc-66a8a217afb1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:49.822415 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee0463-41c8-4015-b3cc-66a8a217afb1 service cinder] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:49.865924 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea41219-0c2b-4cb6-91fb-86fdd10f8361 service neutron] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:49.867466 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-2ea41219-0c2b-4cb6-91fb-86fdd10f8361 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:50.059938 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea41219-0c2b-4cb6-91fb-86fdd10f8361 service neutron] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:50.069950 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200da0d-bf39-418a-badf-19d484e91167 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:50.072229 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200da0d-bf39-418a-badf-19d484e91167 service cinder] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:50.074577 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd735713-6491-4f22-8d35-056f8f3d5a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:50.075037 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200da0d-bf39-418a-badf-19d484e91167 service cinder] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:50.075434 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200da0d-bf39-418a-badf-19d484e91167 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:50.076483 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd735713-6491-4f22-8d35-056f8f3d5a81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:50.076910 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd735713-6491-4f22-8d35-056f8f3d5a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:50.079042 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd735713-6491-4f22-8d35-056f8f3d5a81 admin admin] PATH_INFO: `/v3/users/5f20b659ac394405b0eca014309d53a5` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:50.081272 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd735713-6491-4f22-8d35-056f8f3d5a81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f20b659ac394405b0eca014309d53a5)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:50.083956 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd735713-6491-4f22-8d35-056f8f3d5a81 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:50.084926 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-2200da0d-bf39-418a-badf-19d484e91167 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:50.189901 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-cd735713-6491-4f22-8d35-056f8f3d5a81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f20b659ac394405b0eca014309d53a5'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:50.191478 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-cd735713-6491-4f22-8d35-056f8f3d5a81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f20b659ac394405b0eca014309d53a5'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:50.243202 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-cd735713-6491-4f22-8d35-056f8f3d5a81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f20b659ac394405b0eca014309d53a5'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:50.264003 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-cd735713-6491-4f22-8d35-056f8f3d5a81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f20b659ac394405b0eca014309d53a5'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:50.289816 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-cd735713-6491-4f22-8d35-056f8f3d5a81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f20b659ac394405b0eca014309d53a5'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:50.322281 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 869/1752] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:31:49 2022] DELETE /identity/v3/users/5f20b659ac394405b0eca014309d53a5 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:31:50.335421 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb31662-09c4-433f-b0d8-e70291c3056b None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:50.335704 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb31662-09c4-433f-b0d8-e70291c3056b None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:50.335997 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb31662-09c4-433f-b0d8-e70291c3056b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:50.345584 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2200da0d-bf39-418a-badf-19d484e91167 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:50.352832 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2200da0d-bf39-418a-badf-19d484e91167 service cinder] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:50.393056 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 884/1753] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:31:50.401160 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-ddb31662-09c4-433f-b0d8-e70291c3056b None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:50.414552 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-ddb31662-09c4-433f-b0d8-e70291c3056b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:50.679732 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 870/1754] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:50.687407 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200da0d-bf39-418a-badf-19d484e91167 service cinder] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:50.689304 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-2200da0d-bf39-418a-badf-19d484e91167 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:50.723744 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200da0d-bf39-418a-badf-19d484e91167 service cinder] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:50.852739 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac23b66-c980-4512-b0c7-0ff68d9563d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:50.853385 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac23b66-c980-4512-b0c7-0ff68d9563d4 service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:50.853669 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac23b66-c980-4512-b0c7-0ff68d9563d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:50.853944 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac23b66-c980-4512-b0c7-0ff68d9563d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:50.874907 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac23b66-c980-4512-b0c7-0ff68d9563d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:50.876647 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac23b66-c980-4512-b0c7-0ff68d9563d4 service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:50.907317 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 885/1755] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:31:51.677325 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308561e-04fa-4779-8a9e-f85f320f9e22 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:51.677938 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308561e-04fa-4779-8a9e-f85f320f9e22 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:51.677938 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308561e-04fa-4779-8a9e-f85f320f9e22 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:51.680530 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 871/1756] 10.222.0.21 () {54 vars in 912 bytes} [Mon Feb 28 10:31:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:31:51.694129 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112171d-0236-4aa0-8d53-7a2f7442751f None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:51.694576 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112171d-0236-4aa0-8d53-7a2f7442751f None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:51.694671 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112171d-0236-4aa0-8d53-7a2f7442751f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:51.754531 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-7112171d-0236-4aa0-8d53-7a2f7442751f None None] MFA Rules not processed for user `abaa12b94c834676bb17bf997dace5d1`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:51.759339 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-7112171d-0236-4aa0-8d53-7a2f7442751f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:51.815098 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 886/1757] 10.222.0.21 () {58 vars in 1009 bytes} [Mon Feb 28 10:31:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:31:52.146117 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308561e-04fa-4779-8a9e-f85f320f9e22 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:52.148002 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-0308561e-04fa-4779-8a9e-f85f320f9e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:52.183749 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308561e-04fa-4779-8a9e-f85f320f9e22 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:52.197469 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c25ea-fe02-4511-8f8e-a2216a629e08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:52.198145 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c25ea-fe02-4511-8f8e-a2216a629e08 service neutron] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:52.202531 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c25ea-fe02-4511-8f8e-a2216a629e08 service neutron] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:52.203791 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c25ea-fe02-4511-8f8e-a2216a629e08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:52.243883 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c25ea-fe02-4511-8f8e-a2216a629e08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:52.254658 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c25ea-fe02-4511-8f8e-a2216a629e08 service neutron] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:52.285449 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 872/1758] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:31:52.400608 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07abf5-3d9b-4bdf-938e-68d3980c68c8 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:52.400957 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07abf5-3d9b-4bdf-938e-68d3980c68c8 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:52.401171 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07abf5-3d9b-4bdf-938e-68d3980c68c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:52.498091 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-3a07abf5-3d9b-4bdf-938e-68d3980c68c8 None None] MFA Rules not processed for user `9f32c16ee62d441d9e5fde2b1ce0afaf`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:52.502788 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-3a07abf5-3d9b-4bdf-938e-68d3980c68c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:52.761721 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 887/1759] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:52.778495 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c25ea-fe02-4511-8f8e-a2216a629e08 service neutron] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:52.781861 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-f87c25ea-fe02-4511-8f8e-a2216a629e08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:53.129498 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c25ea-fe02-4511-8f8e-a2216a629e08 service neutron] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:53.164621 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ba981-7a77-4cd6-9903-8dde86e9642c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec202a34db8e47f4a6c18285245e3f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:53.166702 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ba981-7a77-4cd6-9903-8dde86e9642c service nova] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:53.169129 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ba981-7a77-4cd6-9903-8dde86e9642c service nova] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:53.170182 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ba981-7a77-4cd6-9903-8dde86e9642c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:53.209875 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ba981-7a77-4cd6-9903-8dde86e9642c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:53.216495 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ba981-7a77-4cd6-9903-8dde86e9642c service nova] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:53.255616 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 873/1760] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:31:53.597666 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07abf5-3d9b-4bdf-938e-68d3980c68c8 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:53.599319 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-3a07abf5-3d9b-4bdf-938e-68d3980c68c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:53.658423 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07abf5-3d9b-4bdf-938e-68d3980c68c8 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:53.672431 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27825eaf-a2a6-4a39-9b3c-5c49566e16e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:53.673408 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27825eaf-a2a6-4a39-9b3c-5c49566e16e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:53.673724 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27825eaf-a2a6-4a39-9b3c-5c49566e16e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:53.676100 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27825eaf-a2a6-4a39-9b3c-5c49566e16e8 admin admin] PATH_INFO: `/v3/projects/02fb28be813a480ea49f887e50e952e3` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:53.679260 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27825eaf-a2a6-4a39-9b3c-5c49566e16e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02fb28be813a480ea49f887e50e952e3)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:53.686671 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27825eaf-a2a6-4a39-9b3c-5c49566e16e8 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:53.864025 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-27825eaf-a2a6-4a39-9b3c-5c49566e16e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02fb28be813a480ea49f887e50e952e3', 'request_id': 'req-27825eaf-a2a6-4a39-9b3c-5c49566e16e8'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:53.910634 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-27825eaf-a2a6-4a39-9b3c-5c49566e16e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02fb28be813a480ea49f887e50e952e3', 'request_id': 'req-27825eaf-a2a6-4a39-9b3c-5c49566e16e8'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:53.957113 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-27825eaf-a2a6-4a39-9b3c-5c49566e16e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02fb28be813a480ea49f887e50e952e3', 'request_id': 'req-27825eaf-a2a6-4a39-9b3c-5c49566e16e8'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:53.996242 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-27825eaf-a2a6-4a39-9b3c-5c49566e16e8 admin admin] The token cache is being invalidate because project 02fb28be813a480ea49f887e50e952e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:31:54.002520 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-27825eaf-a2a6-4a39-9b3c-5c49566e16e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:54.005487 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-27825eaf-a2a6-4a39-9b3c-5c49566e16e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:54.012636 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 888/1761] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:31:53 2022] DELETE /identity/v3/projects/02fb28be813a480ea49f887e50e952e3 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:31:54.017722 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb321331-d635-443f-8274-de36bf7b6dc7 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:54.018276 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb321331-d635-443f-8274-de36bf7b6dc7 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:54.018276 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb321331-d635-443f-8274-de36bf7b6dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:54.104163 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-fb321331-d635-443f-8274-de36bf7b6dc7 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:54.110465 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-fb321331-d635-443f-8274-de36bf7b6dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:54.342759 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 874/1762] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:54.353917 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee5675-7df4-4895-ad80-6ceaedf6c0b5 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:54.354229 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee5675-7df4-4895-ad80-6ceaedf6c0b5 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:54.354767 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee5675-7df4-4895-ad80-6ceaedf6c0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:54.421854 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-4bee5675-7df4-4895-ad80-6ceaedf6c0b5 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:54.427402 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-4bee5675-7df4-4895-ad80-6ceaedf6c0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:54.456574 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 889/1763] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:54.457282 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb321331-d635-443f-8274-de36bf7b6dc7 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:54.470969 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb321331-d635-443f-8274-de36bf7b6dc7 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:54.488692 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d530b-89ee-464f-b606-a501a7f0ce8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:54.489928 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d530b-89ee-464f-b606-a501a7f0ce8b admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:54.490358 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d530b-89ee-464f-b606-a501a7f0ce8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:54.490905 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d530b-89ee-464f-b606-a501a7f0ce8b admin admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:54.491845 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57d530b-89ee-464f-b606-a501a7f0ce8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:31:54.492297 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57d530b-89ee-464f-b606-a501a7f0ce8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:54.498327 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57d530b-89ee-464f-b606-a501a7f0ce8b admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:54.541570 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 875/1764] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:31:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:31:54.548705 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee5675-7df4-4895-ad80-6ceaedf6c0b5 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:54.563549 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee5675-7df4-4895-ad80-6ceaedf6c0b5 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:54.576352 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb38260-546f-4f3e-94d7-21e628d8db67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:54.577160 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb38260-546f-4f3e-94d7-21e628d8db67 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:54.577855 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb38260-546f-4f3e-94d7-21e628d8db67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:54.577855 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb38260-546f-4f3e-94d7-21e628d8db67 admin admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:54.578654 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb38260-546f-4f3e-94d7-21e628d8db67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:54.581313 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb38260-546f-4f3e-94d7-21e628d8db67 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:54.661549 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d530b-89ee-464f-b606-a501a7f0ce8b admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:54.661975 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 890/1765] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:31:54 2022] POST /identity/v3/projects => generated 365 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:31:54.675775 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d530b-89ee-464f-b606-a501a7f0ce8b admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:54.791019 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb38260-546f-4f3e-94d7-21e628d8db67 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:54.794693 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-7bb38260-546f-4f3e-94d7-21e628d8db67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:54.887709 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de04dd55-edbc-4cae-8848-87e97010827d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:54.888925 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04dd55-edbc-4cae-8848-87e97010827d admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:54.889435 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04dd55-edbc-4cae-8848-87e97010827d admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:54.889933 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04dd55-edbc-4cae-8848-87e97010827d admin admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:54.890944 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de04dd55-edbc-4cae-8848-87e97010827d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:54.893901 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de04dd55-edbc-4cae-8848-87e97010827d admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:54.965083 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 876/1766] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:31:54 2022] POST /identity/v3/users => generated 283 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:31:54.966808 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de04dd55-edbc-4cae-8848-87e97010827d admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:54.989105 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb38260-546f-4f3e-94d7-21e628d8db67 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:55.005709 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6793e8-f9bc-4efd-8d10-d89c8050cca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:55.006684 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6793e8-f9bc-4efd-8d10-d89c8050cca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:55.006912 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6793e8-f9bc-4efd-8d10-d89c8050cca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:55.007187 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6793e8-f9bc-4efd-8d10-d89c8050cca9 admin admin] PATH_INFO: `/v3/projects/6191872ccd434d42bc1cafaf678777a0` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:55.013854 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6793e8-f9bc-4efd-8d10-d89c8050cca9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6191872ccd434d42bc1cafaf678777a0)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:55.016349 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6793e8-f9bc-4efd-8d10-d89c8050cca9 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:55.037249 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de04dd55-edbc-4cae-8848-87e97010827d admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:55.071791 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b9c280-83f1-41d8-aa4b-117b998f37e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:55.072479 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9c280-83f1-41d8-aa4b-117b998f37e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:55.072762 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9c280-83f1-41d8-aa4b-117b998f37e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:55.073040 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9c280-83f1-41d8-aa4b-117b998f37e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:55.074362 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b9c280-83f1-41d8-aa4b-117b998f37e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:55.099925 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b9c280-83f1-41d8-aa4b-117b998f37e3 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:55.124143 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 877/1767] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:31:55.140497 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-2c6793e8-f9bc-4efd-8d10-d89c8050cca9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6191872ccd434d42bc1cafaf678777a0', 'request_id': 'req-2c6793e8-f9bc-4efd-8d10-d89c8050cca9'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:55.145017 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b9c280-83f1-41d8-aa4b-117b998f37e3 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:55.160254 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-2c6793e8-f9bc-4efd-8d10-d89c8050cca9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6191872ccd434d42bc1cafaf678777a0', 'request_id': 'req-2c6793e8-f9bc-4efd-8d10-d89c8050cca9'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:55.168960 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b9c280-83f1-41d8-aa4b-117b998f37e3 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:55.176331 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-2c6793e8-f9bc-4efd-8d10-d89c8050cca9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6191872ccd434d42bc1cafaf678777a0', 'request_id': 'req-2c6793e8-f9bc-4efd-8d10-d89c8050cca9'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:55.204503 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-2c6793e8-f9bc-4efd-8d10-d89c8050cca9 admin admin] The token cache is being invalidate because project 6191872ccd434d42bc1cafaf678777a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:31:55.205019 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-2c6793e8-f9bc-4efd-8d10-d89c8050cca9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:55.205812 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-2c6793e8-f9bc-4efd-8d10-d89c8050cca9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:55.212033 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 891/1768] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:31:54 2022] DELETE /identity/v3/projects/6191872ccd434d42bc1cafaf678777a0 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:31:55.213133 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6793e8-f9bc-4efd-8d10-d89c8050cca9 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:55.224177 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-2c6793e8-f9bc-4efd-8d10-d89c8050cca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:55.354240 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323911b0-3b05-4c27-9e7b-26785bebb8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:55.357184 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323911b0-3b05-4c27-9e7b-26785bebb8c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:55.357471 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323911b0-3b05-4c27-9e7b-26785bebb8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:55.357760 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323911b0-3b05-4c27-9e7b-26785bebb8c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:55.358637 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323911b0-3b05-4c27-9e7b-26785bebb8c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:55.365151 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323911b0-3b05-4c27-9e7b-26785bebb8c0 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:55.419506 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 878/1769] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:31:55.420911 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323911b0-3b05-4c27-9e7b-26785bebb8c0 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:55.449835 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6793e8-f9bc-4efd-8d10-d89c8050cca9 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:55.450031 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-323911b0-3b05-4c27-9e7b-26785bebb8c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:55.466915 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e0bf1-bbeb-4679-9238-391b460a73f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:55.467924 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e0bf1-bbeb-4679-9238-391b460a73f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:55.468236 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e0bf1-bbeb-4679-9238-391b460a73f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:55.468540 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e0bf1-bbeb-4679-9238-391b460a73f6 admin admin] PATH_INFO: `/v3/users/1a41984db62844a1b50c49402b9fcde2` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:55.475493 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e0bf1-bbeb-4679-9238-391b460a73f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a41984db62844a1b50c49402b9fcde2)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:55.483650 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e0bf1-bbeb-4679-9238-391b460a73f6 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:55.527189 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323911b0-3b05-4c27-9e7b-26785bebb8c0 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:55.543287 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0877ce5-b09a-4f5e-84d7-c4bef4720301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:55.544438 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0877ce5-b09a-4f5e-84d7-c4bef4720301 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:55.545773 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0877ce5-b09a-4f5e-84d7-c4bef4720301 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:55.546152 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0877ce5-b09a-4f5e-84d7-c4bef4720301 admin admin] PATH_INFO: `/v3/projects/98e184621c824c0783bcc18a3b53af89/users/ae3c38248f57445e8cf786158691fa51/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:55.582035 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0877ce5-b09a-4f5e-84d7-c4bef4720301 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98e184621c824c0783bcc18a3b53af89, user_id=ae3c38248f57445e8cf786158691fa51, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:55.585340 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0877ce5-b09a-4f5e-84d7-c4bef4720301 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:55.631341 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 879/1770] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:31:55 2022] PUT /identity/v3/projects/98e184621c824c0783bcc18a3b53af89/users/ae3c38248f57445e8cf786158691fa51/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:31:55.638007 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076dc0f-975c-46da-b033-870910cb8450 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:55.638291 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076dc0f-975c-46da-b033-870910cb8450 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:55.638562 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076dc0f-975c-46da-b033-870910cb8450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:55.638771 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-af2e0bf1-bbeb-4679-9238-391b460a73f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a41984db62844a1b50c49402b9fcde2'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:55.656999 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-af2e0bf1-bbeb-4679-9238-391b460a73f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a41984db62844a1b50c49402b9fcde2'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:55.657680 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-af2e0bf1-bbeb-4679-9238-391b460a73f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a41984db62844a1b50c49402b9fcde2'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:55.682204 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-af2e0bf1-bbeb-4679-9238-391b460a73f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a41984db62844a1b50c49402b9fcde2'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:55.713392 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-af2e0bf1-bbeb-4679-9238-391b460a73f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a41984db62844a1b50c49402b9fcde2'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:55.728914 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 892/1771] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:31:55 2022] DELETE /identity/v3/users/1a41984db62844a1b50c49402b9fcde2 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:31:55.768407 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-9076dc0f-975c-46da-b033-870910cb8450 None None] MFA Rules not processed for user `ae3c38248f57445e8cf786158691fa51`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:55.769994 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-9076dc0f-975c-46da-b033-870910cb8450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:56.097955 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 880/1772] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:55 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:56.098945 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e0bf1-bbeb-4679-9238-391b460a73f6 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:56.100530 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-af2e0bf1-bbeb-4679-9238-391b460a73f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:56.246793 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e0bf1-bbeb-4679-9238-391b460a73f6 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:56.252280 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68384e50-e718-4b84-a243-354091f79282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:56.253316 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68384e50-e718-4b84-a243-354091f79282 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:56.253821 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68384e50-e718-4b84-a243-354091f79282 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:56.254534 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68384e50-e718-4b84-a243-354091f79282 admin admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:56.255466 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68384e50-e718-4b84-a243-354091f79282 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:56.259248 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68384e50-e718-4b84-a243-354091f79282 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:56.316988 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 893/1773] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:31:56 2022] POST /identity/v3/projects => generated 365 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:31:56.329400 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076dc0f-975c-46da-b033-870910cb8450 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:56.353364 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076dc0f-975c-46da-b033-870910cb8450 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:56.595397 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21b49e-ea20-4059-92cc-88710b820cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:56.596146 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21b49e-ea20-4059-92cc-88710b820cc8 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:56.596429 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21b49e-ea20-4059-92cc-88710b820cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:56.596744 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21b49e-ea20-4059-92cc-88710b820cc8 admin admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:56.597522 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b21b49e-ea20-4059-92cc-88710b820cc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:56.599495 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b21b49e-ea20-4059-92cc-88710b820cc8 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:56.693149 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68384e50-e718-4b84-a243-354091f79282 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:56.693986 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 881/1774] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:31:56 2022] POST /identity/v3/users => generated 289 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:31:56.707696 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68384e50-e718-4b84-a243-354091f79282 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:56.725358 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22bf09a-4f46-428e-9b0f-9a274043967b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:56.726045 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bf09a-4f46-428e-9b0f-9a274043967b admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:56.726323 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bf09a-4f46-428e-9b0f-9a274043967b admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:56.726612 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bf09a-4f46-428e-9b0f-9a274043967b admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:56.727338 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22bf09a-4f46-428e-9b0f-9a274043967b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:56.734336 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22bf09a-4f46-428e-9b0f-9a274043967b admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:56.775151 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21b49e-ea20-4059-92cc-88710b820cc8 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:56.784497 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 894/1775] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:31:56.789569 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21b49e-ea20-4059-92cc-88710b820cc8 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:56.803259 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258114e2-6e26-4fdc-8daf-04f9cece1e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:56.804231 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258114e2-6e26-4fdc-8daf-04f9cece1e58 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:56.804661 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258114e2-6e26-4fdc-8daf-04f9cece1e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:56.804998 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258114e2-6e26-4fdc-8daf-04f9cece1e58 admin admin] PATH_INFO: `/v3/projects/cc96de37a5214a94971ff0ce3d1087ca/users/a643c517130e48cd9cd213e5217f0e7b/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:56.873763 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258114e2-6e26-4fdc-8daf-04f9cece1e58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc96de37a5214a94971ff0ce3d1087ca, user_id=a643c517130e48cd9cd213e5217f0e7b, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:56.876688 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258114e2-6e26-4fdc-8daf-04f9cece1e58 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:56.881025 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22bf09a-4f46-428e-9b0f-9a274043967b admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:56.883127 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-d22bf09a-4f46-428e-9b0f-9a274043967b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:56.918027 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22bf09a-4f46-428e-9b0f-9a274043967b admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:56.943485 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 882/1776] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:31:56 2022] PUT /identity/v3/projects/cc96de37a5214a94971ff0ce3d1087ca/users/a643c517130e48cd9cd213e5217f0e7b/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:31:56.948975 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258114e2-6e26-4fdc-8daf-04f9cece1e58 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:57.158067 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258114e2-6e26-4fdc-8daf-04f9cece1e58 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:57.176507 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb26ca-d0d1-4f86-8b84-5592733c173e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:57.177458 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb26ca-d0d1-4f86-8b84-5592733c173e admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:57.177925 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb26ca-d0d1-4f86-8b84-5592733c173e admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:57.178347 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb26ca-d0d1-4f86-8b84-5592733c173e admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:57.179504 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb26ca-d0d1-4f86-8b84-5592733c173e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:57.181290 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb26ca-d0d1-4f86-8b84-5592733c173e admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:57.185884 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb18abd1-0f7b-45dd-bff3-dd150b0db700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:57.187209 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18abd1-0f7b-45dd-bff3-dd150b0db700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:57.187674 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18abd1-0f7b-45dd-bff3-dd150b0db700 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:57.188342 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18abd1-0f7b-45dd-bff3-dd150b0db700 admin admin] PATH_INFO: `/v3/users/4dfe4a7a3db341558dde891bc8904842` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:57.190656 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb18abd1-0f7b-45dd-bff3-dd150b0db700 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dfe4a7a3db341558dde891bc8904842)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:57.192757 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb18abd1-0f7b-45dd-bff3-dd150b0db700 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:57.220156 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 883/1777] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:31:57.221904 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb26ca-d0d1-4f86-8b84-5592733c173e admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:57.262066 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb26ca-d0d1-4f86-8b84-5592733c173e admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:57.281135 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb732f04-a9dd-4c6c-b678-4596a433ac11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:57.282200 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb732f04-a9dd-4c6c-b678-4596a433ac11 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:57.282488 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb732f04-a9dd-4c6c-b678-4596a433ac11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:57.282860 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb732f04-a9dd-4c6c-b678-4596a433ac11 admin admin] PATH_INFO: `/v3/projects/cc96de37a5214a94971ff0ce3d1087ca/users/a643c517130e48cd9cd213e5217f0e7b/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:57.292871 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb732f04-a9dd-4c6c-b678-4596a433ac11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc96de37a5214a94971ff0ce3d1087ca, user_id=a643c517130e48cd9cd213e5217f0e7b, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:57.295728 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb732f04-a9dd-4c6c-b678-4596a433ac11 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:57.317153 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-bb18abd1-0f7b-45dd-bff3-dd150b0db700 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dfe4a7a3db341558dde891bc8904842'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:57.332115 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-bb18abd1-0f7b-45dd-bff3-dd150b0db700 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dfe4a7a3db341558dde891bc8904842'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:57.332826 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-bb18abd1-0f7b-45dd-bff3-dd150b0db700 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dfe4a7a3db341558dde891bc8904842'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:57.336535 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 884/1778] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:31:57 2022] PUT /identity/v3/projects/cc96de37a5214a94971ff0ce3d1087ca/users/a643c517130e48cd9cd213e5217f0e7b/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:31:57.352286 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee27d47-43d6-4a39-a892-ff91aacf2132 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:57.352485 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee27d47-43d6-4a39-a892-ff91aacf2132 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:57.352759 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee27d47-43d6-4a39-a892-ff91aacf2132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:57.421632 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-bb18abd1-0f7b-45dd-bff3-dd150b0db700 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dfe4a7a3db341558dde891bc8904842'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:57.437372 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-bb18abd1-0f7b-45dd-bff3-dd150b0db700 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dfe4a7a3db341558dde891bc8904842'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:57.448231 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 895/1779] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:31:56 2022] DELETE /identity/v3/users/4dfe4a7a3db341558dde891bc8904842 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:31:57.457368 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945aa21-8b1b-4316-b427-09b2df7334b0 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:57.458201 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945aa21-8b1b-4316-b427-09b2df7334b0 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:57.459057 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945aa21-8b1b-4316-b427-09b2df7334b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:57.477446 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-fee27d47-43d6-4a39-a892-ff91aacf2132 None None] MFA Rules not processed for user `a643c517130e48cd9cd213e5217f0e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:57.478852 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-fee27d47-43d6-4a39-a892-ff91aacf2132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:57.524673 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-4945aa21-8b1b-4316-b427-09b2df7334b0 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:57.529208 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-4945aa21-8b1b-4316-b427-09b2df7334b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:57.672493 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 885/1780] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:57 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:31:57.674270 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539b422-aa99-4f08-ac2e-eea0ecdccce4 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:57.674814 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539b422-aa99-4f08-ac2e-eea0ecdccce4 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:57.675296 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539b422-aa99-4f08-ac2e-eea0ecdccce4 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:57.677376 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 886/1781] 10.222.0.21 () {54 vars in 921 bytes} [Mon Feb 28 10:31:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:31:57.686772 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539b422-aa99-4f08-ac2e-eea0ecdccce4 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:57.689721 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-c539b422-aa99-4f08-ac2e-eea0ecdccce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:57.724503 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 896/1782] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:31:57.785808 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61faf7bf-318e-4f6f-840e-8b83e5fc3c23 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:57.786320 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61faf7bf-318e-4f6f-840e-8b83e5fc3c23 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:57.787224 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61faf7bf-318e-4f6f-840e-8b83e5fc3c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:57.817187 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539b422-aa99-4f08-ac2e-eea0ecdccce4 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:57.822238 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f74ec6-22e0-47aa-adb4-416849062ff4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:57.823303 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f74ec6-22e0-47aa-adb4-416849062ff4 service cinder] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:57.824388 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f74ec6-22e0-47aa-adb4-416849062ff4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:57.824755 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f74ec6-22e0-47aa-adb4-416849062ff4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:57.858517 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f74ec6-22e0-47aa-adb4-416849062ff4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:57.859053 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-61faf7bf-318e-4f6f-840e-8b83e5fc3c23 None None] MFA Rules not processed for user `ec202a34db8e47f4a6c18285245e3f5b`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:57.862917 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f74ec6-22e0-47aa-adb4-416849062ff4 service cinder] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:57.866088 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-61faf7bf-318e-4f6f-840e-8b83e5fc3c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:57.910303 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 887/1783] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:57 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:31:57.912825 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f74ec6-22e0-47aa-adb4-416849062ff4 service cinder] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:57.916965 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-68f74ec6-22e0-47aa-adb4-416849062ff4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:58.146103 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f74ec6-22e0-47aa-adb4-416849062ff4 service cinder] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:58.150360 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 897/1784] 10.222.0.21 () {58 vars in 1018 bytes} [Mon Feb 28 10:31:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:31:58.155862 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea77a94-bcad-40b3-9348-49cb0e51f8e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:58.158071 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61faf7bf-318e-4f6f-840e-8b83e5fc3c23 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:58.162055 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea77a94-bcad-40b3-9348-49cb0e51f8e1 service neutron] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:58.162863 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea77a94-bcad-40b3-9348-49cb0e51f8e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:58.162863 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea77a94-bcad-40b3-9348-49cb0e51f8e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:58.194811 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea77a94-bcad-40b3-9348-49cb0e51f8e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:58.195229 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61faf7bf-318e-4f6f-840e-8b83e5fc3c23 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:58.198170 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea77a94-bcad-40b3-9348-49cb0e51f8e1 service neutron] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:58.202366 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b683162-4b88-4bbf-a139-c38f7ef0dbf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:58.205260 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b683162-4b88-4bbf-a139-c38f7ef0dbf8 service cinder] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:58.206542 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b683162-4b88-4bbf-a139-c38f7ef0dbf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:58.207091 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b683162-4b88-4bbf-a139-c38f7ef0dbf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:58.219342 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-0b683162-4b88-4bbf-a139-c38f7ef0dbf8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:58.225806 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 888/1785] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:31:58.364130 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b683162-4b88-4bbf-a139-c38f7ef0dbf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:58.366214 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b683162-4b88-4bbf-a139-c38f7ef0dbf8 service cinder] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:58.397571 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 898/1786] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:58 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:31:58.520683 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea77a94-bcad-40b3-9348-49cb0e51f8e1 service neutron] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:58.522501 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-5ea77a94-bcad-40b3-9348-49cb0e51f8e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:58.565476 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea77a94-bcad-40b3-9348-49cb0e51f8e1 service neutron] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:58.590284 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db5801-9ff1-4d2d-b7e5-f5846b89164b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec202a34db8e47f4a6c18285245e3f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:58.591176 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db5801-9ff1-4d2d-b7e5-f5846b89164b service nova] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:58.591489 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db5801-9ff1-4d2d-b7e5-f5846b89164b service nova] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:58.591766 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db5801-9ff1-4d2d-b7e5-f5846b89164b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:58.611700 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db5801-9ff1-4d2d-b7e5-f5846b89164b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:58.626549 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db5801-9ff1-4d2d-b7e5-f5846b89164b service nova] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:58.658894 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 889/1787] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:31:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:31:59.482369 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b683162-4b88-4bbf-a139-c38f7ef0dbf8 service cinder] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:31:59.484340 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-0b683162-4b88-4bbf-a139-c38f7ef0dbf8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:59.507697 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b683162-4b88-4bbf-a139-c38f7ef0dbf8 service cinder] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:31:59.520072 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38485939-a77b-4a44-9476-71b706772d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:31:59.520944 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38485939-a77b-4a44-9476-71b706772d52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:59.521218 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38485939-a77b-4a44-9476-71b706772d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:59.521533 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38485939-a77b-4a44-9476-71b706772d52 admin admin] PATH_INFO: `/v3/projects/c167f6c60ece44bfa68473ab965726c3` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:59.524269 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38485939-a77b-4a44-9476-71b706772d52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c167f6c60ece44bfa68473ab965726c3)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:31:59.530338 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38485939-a77b-4a44-9476-71b706772d52 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:31:59.643886 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-38485939-a77b-4a44-9476-71b706772d52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c167f6c60ece44bfa68473ab965726c3', 'request_id': 'req-38485939-a77b-4a44-9476-71b706772d52'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:59.666437 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-38485939-a77b-4a44-9476-71b706772d52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c167f6c60ece44bfa68473ab965726c3', 'request_id': 'req-38485939-a77b-4a44-9476-71b706772d52'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:59.679621 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-38485939-a77b-4a44-9476-71b706772d52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c167f6c60ece44bfa68473ab965726c3', 'request_id': 'req-38485939-a77b-4a44-9476-71b706772d52'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:59.704874 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-38485939-a77b-4a44-9476-71b706772d52 admin admin] The token cache is being invalidate because project c167f6c60ece44bfa68473ab965726c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:31:59.705449 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-38485939-a77b-4a44-9476-71b706772d52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:59.708511 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890c5ec-c1f2-4855-b73f-23a4387a6eb0 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:59.709636 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890c5ec-c1f2-4855-b73f-23a4387a6eb0 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:59.710054 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890c5ec-c1f2-4855-b73f-23a4387a6eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:59.719809 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-38485939-a77b-4a44-9476-71b706772d52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:31:59.725866 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 899/1788] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:31:59 2022] DELETE /identity/v3/projects/c167f6c60ece44bfa68473ab965726c3 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:31:59.732636 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd40d0-8e24-4e0b-b709-dae2946fe4d7 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:31:59.733140 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd40d0-8e24-4e0b-b709-dae2946fe4d7 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:31:59.733566 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd40d0-8e24-4e0b-b709-dae2946fe4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:31:59.753042 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-7890c5ec-c1f2-4855-b73f-23a4387a6eb0 None None] MFA Rules not processed for user `da9524bba20140f694ac7cd6e8f37038`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:59.756178 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-7890c5ec-c1f2-4855-b73f-23a4387a6eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:59.795720 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-d5bd40d0-8e24-4e0b-b709-dae2946fe4d7 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:31:59.797179 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-d5bd40d0-8e24-4e0b-b709-dae2946fe4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:31:59.929265 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 890/1789] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:00.029250 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 900/1790] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:31:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:32:00.038224 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a3284-6c8a-4bef-bc1e-e43f7d59939e None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:00.038889 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a3284-6c8a-4bef-bc1e-e43f7d59939e None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:00.039390 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a3284-6c8a-4bef-bc1e-e43f7d59939e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:00.096888 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-e13a3284-6c8a-4bef-bc1e-e43f7d59939e None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:00.106041 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-e13a3284-6c8a-4bef-bc1e-e43f7d59939e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:00.147136 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 891/1791] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:00.151714 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd40d0-8e24-4e0b-b709-dae2946fe4d7 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:00.166587 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd40d0-8e24-4e0b-b709-dae2946fe4d7 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:00.195888 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85839093-2226-4e5e-ba52-ae79b7b95f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:00.196580 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85839093-2226-4e5e-ba52-ae79b7b95f9b admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:00.197041 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85839093-2226-4e5e-ba52-ae79b7b95f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:00.197473 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85839093-2226-4e5e-ba52-ae79b7b95f9b admin admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:00.199122 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85839093-2226-4e5e-ba52-ae79b7b95f9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:32:00.199661 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85839093-2226-4e5e-ba52-ae79b7b95f9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:00.201548 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85839093-2226-4e5e-ba52-ae79b7b95f9b admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:00.241523 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 901/1792] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:32:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:32:00.247309 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a3284-6c8a-4bef-bc1e-e43f7d59939e None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:00.262220 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a3284-6c8a-4bef-bc1e-e43f7d59939e None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:00.281007 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8475c-0fc8-46cd-a038-8be2f5995e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:00.281542 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8475c-0fc8-46cd-a038-8be2f5995e00 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:00.282404 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8475c-0fc8-46cd-a038-8be2f5995e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:00.282708 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8475c-0fc8-46cd-a038-8be2f5995e00 admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:00.283458 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb8475c-0fc8-46cd-a038-8be2f5995e00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:00.285408 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb8475c-0fc8-46cd-a038-8be2f5995e00 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:00.337401 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 892/1793] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:32:00 2022] POST /identity/v3/projects => generated 387 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:32:00.341924 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85839093-2226-4e5e-ba52-ae79b7b95f9b admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:00.358114 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85839093-2226-4e5e-ba52-ae79b7b95f9b admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:00.441979 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5cdf68-88bd-4433-b803-33e4f2c09ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:00.442984 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5cdf68-88bd-4433-b803-33e4f2c09ab4 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:00.442984 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5cdf68-88bd-4433-b803-33e4f2c09ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:00.443264 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5cdf68-88bd-4433-b803-33e4f2c09ab4 admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:00.444002 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5cdf68-88bd-4433-b803-33e4f2c09ab4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:00.449670 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5cdf68-88bd-4433-b803-33e4f2c09ab4 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:00.486439 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 902/1794] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:32:00 2022] POST /identity/v3/users => generated 294 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:32:00.490724 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8475c-0fc8-46cd-a038-8be2f5995e00 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:00.505211 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8475c-0fc8-46cd-a038-8be2f5995e00 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:00.513185 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d121ed-8ad7-4e0f-a020-86eae05cc647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:00.515356 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d121ed-8ad7-4e0f-a020-86eae05cc647 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:00.516013 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d121ed-8ad7-4e0f-a020-86eae05cc647 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:00.518256 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d121ed-8ad7-4e0f-a020-86eae05cc647 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:00.519459 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d121ed-8ad7-4e0f-a020-86eae05cc647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:00.525778 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d121ed-8ad7-4e0f-a020-86eae05cc647 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:00.530331 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a4a8e-1282-49ba-92e3-1fd86f300375 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:00.530777 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a4a8e-1282-49ba-92e3-1fd86f300375 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:00.531266 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a4a8e-1282-49ba-92e3-1fd86f300375 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:00.533322 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 903/1795] 10.222.0.21 () {54 vars in 921 bytes} [Mon Feb 28 10:32:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 10:32:00.557665 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 893/1796] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:32:00.561606 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a4a8e-1282-49ba-92e3-1fd86f300375 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:00.582897 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19565ec8-544e-427a-85fb-da2183c1fa83 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:00.583182 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19565ec8-544e-427a-85fb-da2183c1fa83 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:00.583456 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19565ec8-544e-427a-85fb-da2183c1fa83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:00.614655 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a4a8e-1282-49ba-92e3-1fd86f300375 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:00.632071 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef009e00-ad42-4a94-b20b-985a77805937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:00.633125 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef009e00-ad42-4a94-b20b-985a77805937 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:00.633556 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef009e00-ad42-4a94-b20b-985a77805937 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:00.633977 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef009e00-ad42-4a94-b20b-985a77805937 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:00.635106 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef009e00-ad42-4a94-b20b-985a77805937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:00.637899 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef009e00-ad42-4a94-b20b-985a77805937 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:00.650136 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 904/1797] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:32:00.655115 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef009e00-ad42-4a94-b20b-985a77805937 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:00.661948 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-19565ec8-544e-427a-85fb-da2183c1fa83 None None] MFA Rules not processed for user `ec202a34db8e47f4a6c18285245e3f5b`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:00.663294 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-19565ec8-544e-427a-85fb-da2183c1fa83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:00.688212 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef009e00-ad42-4a94-b20b-985a77805937 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:00.699799 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6048f0-6433-4ac2-b472-2241ea1674b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:00.700879 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6048f0-6433-4ac2-b472-2241ea1674b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:00.701933 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6048f0-6433-4ac2-b472-2241ea1674b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:00.702216 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6048f0-6433-4ac2-b472-2241ea1674b3 admin admin] PATH_INFO: `/v3/projects/27149caff5d44002a96eff0976313eda/users/e35ca76fbaa745eab1714c90d958b460/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:00.743612 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6048f0-6433-4ac2-b472-2241ea1674b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27149caff5d44002a96eff0976313eda, user_id=e35ca76fbaa745eab1714c90d958b460, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:00.753297 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6048f0-6433-4ac2-b472-2241ea1674b3 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:00.795435 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 905/1798] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:32:00 2022] PUT /identity/v3/projects/27149caff5d44002a96eff0976313eda/users/e35ca76fbaa745eab1714c90d958b460/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:32:00.797980 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4a23a-5cd5-4297-81bd-5cfd3ca3bc44 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:00.799249 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4a23a-5cd5-4297-81bd-5cfd3ca3bc44 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:00.800078 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4a23a-5cd5-4297-81bd-5cfd3ca3bc44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:00.807591 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 894/1799] 10.222.0.21 () {58 vars in 1018 bytes} [Mon Feb 28 10:32:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:32:00.869007 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-20e4a23a-5cd5-4297-81bd-5cfd3ca3bc44 None None] MFA Rules not processed for user `e35ca76fbaa745eab1714c90d958b460`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:00.871110 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-20e4a23a-5cd5-4297-81bd-5cfd3ca3bc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:00.998532 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 906/1800] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:01.002664 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19565ec8-544e-427a-85fb-da2183c1fa83 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:01.015478 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19565ec8-544e-427a-85fb-da2183c1fa83 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:01.103661 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c8ed28-5371-4971-a358-c7526a925f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:01.105361 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8ed28-5371-4971-a358-c7526a925f42 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:01.105961 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8ed28-5371-4971-a358-c7526a925f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:01.106408 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8ed28-5371-4971-a358-c7526a925f42 admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:01.107304 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c8ed28-5371-4971-a358-c7526a925f42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:01.109774 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c8ed28-5371-4971-a358-c7526a925f42 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:01.158567 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 895/1801] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:32:01 2022] POST /identity/v3/projects => generated 387 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:32:01.162129 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e4a23a-5cd5-4297-81bd-5cfd3ca3bc44 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:01.177958 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e4a23a-5cd5-4297-81bd-5cfd3ca3bc44 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:01.247656 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc7b21-3ded-45ea-8d21-b14d5d1b7221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:01.248410 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc7b21-3ded-45ea-8d21-b14d5d1b7221 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:01.248790 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc7b21-3ded-45ea-8d21-b14d5d1b7221 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:01.249168 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc7b21-3ded-45ea-8d21-b14d5d1b7221 admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:01.249951 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bc7b21-3ded-45ea-8d21-b14d5d1b7221 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:01.251997 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bc7b21-3ded-45ea-8d21-b14d5d1b7221 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:01.277224 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 907/1802] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:32:01 2022] POST /identity/v3/users => generated 300 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:32:01.278391 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c8ed28-5371-4971-a358-c7526a925f42 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:01.288720 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c8ed28-5371-4971-a358-c7526a925f42 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:01.294081 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7cf790-2c88-47f9-a126-8b829d0af184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:01.294796 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cf790-2c88-47f9-a126-8b829d0af184 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:01.295076 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cf790-2c88-47f9-a126-8b829d0af184 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:01.295349 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cf790-2c88-47f9-a126-8b829d0af184 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:01.296400 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7cf790-2c88-47f9-a126-8b829d0af184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:01.298217 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7cf790-2c88-47f9-a126-8b829d0af184 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:01.309179 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 896/1803] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:32:01.313473 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc7b21-3ded-45ea-8d21-b14d5d1b7221 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:01.325826 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc7b21-3ded-45ea-8d21-b14d5d1b7221 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:01.326398 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7cf790-2c88-47f9-a126-8b829d0af184 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:01.330057 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-9e7cf790-2c88-47f9-a126-8b829d0af184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:01.344381 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91848a27-dfd2-4675-8ad5-faefdcdcdb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:01.345476 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91848a27-dfd2-4675-8ad5-faefdcdcdb94 admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:01.347203 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91848a27-dfd2-4675-8ad5-faefdcdcdb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:01.347486 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91848a27-dfd2-4675-8ad5-faefdcdcdb94 admin admin] PATH_INFO: `/v3/projects/b52cfc3f9db74a6fa113e8921d76b6cb/users/07f900a4d1db45ad86a9af6363f52855/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:01.362856 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7cf790-2c88-47f9-a126-8b829d0af184 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:01.370262 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91848a27-dfd2-4675-8ad5-faefdcdcdb94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b52cfc3f9db74a6fa113e8921d76b6cb, user_id=07f900a4d1db45ad86a9af6363f52855, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:01.374416 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91848a27-dfd2-4675-8ad5-faefdcdcdb94 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:01.376399 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d0a54-a513-47f2-a265-5720976aa1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:01.377348 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d0a54-a513-47f2-a265-5720976aa1e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:01.377701 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d0a54-a513-47f2-a265-5720976aa1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:01.378024 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d0a54-a513-47f2-a265-5720976aa1e2 admin admin] PATH_INFO: `/v3/users/2ffe146cc2584d6697be0baec0d76263` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:01.379508 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429d0a54-a513-47f2-a265-5720976aa1e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ffe146cc2584d6697be0baec0d76263)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:01.381643 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429d0a54-a513-47f2-a265-5720976aa1e2 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:01.399410 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 908/1804] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:32:01 2022] PUT /identity/v3/projects/b52cfc3f9db74a6fa113e8921d76b6cb/users/07f900a4d1db45ad86a9af6363f52855/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:32:01.401027 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91848a27-dfd2-4675-8ad5-faefdcdcdb94 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:01.405875 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-91848a27-dfd2-4675-8ad5-faefdcdcdb94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:01.463580 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-429d0a54-a513-47f2-a265-5720976aa1e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ffe146cc2584d6697be0baec0d76263'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:01.465702 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-429d0a54-a513-47f2-a265-5720976aa1e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ffe146cc2584d6697be0baec0d76263'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:01.488665 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-429d0a54-a513-47f2-a265-5720976aa1e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ffe146cc2584d6697be0baec0d76263'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:01.501642 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-429d0a54-a513-47f2-a265-5720976aa1e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ffe146cc2584d6697be0baec0d76263'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:01.510520 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-429d0a54-a513-47f2-a265-5720976aa1e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ffe146cc2584d6697be0baec0d76263'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:01.518975 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 897/1805] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:32:01 2022] DELETE /identity/v3/users/2ffe146cc2584d6697be0baec0d76263 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:32:01.520248 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d0a54-a513-47f2-a265-5720976aa1e2 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:01.522503 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-429d0a54-a513-47f2-a265-5720976aa1e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:01.531110 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91848a27-dfd2-4675-8ad5-faefdcdcdb94 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:01.629698 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d0a54-a513-47f2-a265-5720976aa1e2 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:01.630900 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ba1c0-a91d-4cfb-8868-4d59e6439408 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec202a34db8e47f4a6c18285245e3f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:01.632019 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ba1c0-a91d-4cfb-8868-4d59e6439408 service nova] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:01.632604 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ba1c0-a91d-4cfb-8868-4d59e6439408 service nova] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:01.633275 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ba1c0-a91d-4cfb-8868-4d59e6439408 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:01.635247 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdced6a-ca27-4339-9a37-ab770f2f5519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:01.635977 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-129ba1c0-a91d-4cfb-8868-4d59e6439408 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:01.636153 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdced6a-ca27-4339-9a37-ab770f2f5519 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:01.636374 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdced6a-ca27-4339-9a37-ab770f2f5519 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:01.636658 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdced6a-ca27-4339-9a37-ab770f2f5519 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:01.637400 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdced6a-ca27-4339-9a37-ab770f2f5519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:01.639128 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdced6a-ca27-4339-9a37-ab770f2f5519 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:01.649360 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ba1c0-a91d-4cfb-8868-4d59e6439408 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:01.650379 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 898/1806] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:32:01.651198 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ba1c0-a91d-4cfb-8868-4d59e6439408 service nova] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:01.651948 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d256a-f8d0-4f3d-8f4b-1f0e8763b715 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:01.652240 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d256a-f8d0-4f3d-8f4b-1f0e8763b715 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:01.652515 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d256a-f8d0-4f3d-8f4b-1f0e8763b715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:01.663885 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 909/1807] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:32:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:32:01.665310 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12920b8f-54fc-4ae3-83b6-e398fbed514a None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:01.669633 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12920b8f-54fc-4ae3-83b6-e398fbed514a None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:01.670036 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12920b8f-54fc-4ae3-83b6-e398fbed514a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:01.671211 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-0f8d256a-f8d0-4f3d-8f4b-1f0e8763b715 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:01.672417 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-0f8d256a-f8d0-4f3d-8f4b-1f0e8763b715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:01.680929 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 899/1808] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:01.692464 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-12920b8f-54fc-4ae3-83b6-e398fbed514a None None] MFA Rules not processed for user `9f32c16ee62d441d9e5fde2b1ce0afaf`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:01.692814 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d256a-f8d0-4f3d-8f4b-1f0e8763b715 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:01.693941 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-12920b8f-54fc-4ae3-83b6-e398fbed514a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:01.704208 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d256a-f8d0-4f3d-8f4b-1f0e8763b715 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:01.710534 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8978d-1317-436b-a508-22c37d8cc209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:01.711591 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8978d-1317-436b-a508-22c37d8cc209 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:01.711876 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8978d-1317-436b-a508-22c37d8cc209 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:01.712150 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8978d-1317-436b-a508-22c37d8cc209 admin admin] PATH_INFO: `/v3/projects/b52cfc3f9db74a6fa113e8921d76b6cb/users/07f900a4d1db45ad86a9af6363f52855/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:01.714791 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f8978d-1317-436b-a508-22c37d8cc209 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b52cfc3f9db74a6fa113e8921d76b6cb, user_id=07f900a4d1db45ad86a9af6363f52855, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:01.718346 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f8978d-1317-436b-a508-22c37d8cc209 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:01.733062 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 900/1809] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:32:01 2022] PUT /identity/v3/projects/b52cfc3f9db74a6fa113e8921d76b6cb/users/07f900a4d1db45ad86a9af6363f52855/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:32:01.734567 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8978d-1317-436b-a508-22c37d8cc209 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:01.743193 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-23f8978d-1317-436b-a508-22c37d8cc209 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:01.765640 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 910/1810] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:01.766812 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12920b8f-54fc-4ae3-83b6-e398fbed514a None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:01.768328 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-12920b8f-54fc-4ae3-83b6-e398fbed514a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:01.789408 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12920b8f-54fc-4ae3-83b6-e398fbed514a None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:01.867943 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2dd1ca-c91a-4c09-a22a-25082bd25f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:01.870543 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2dd1ca-c91a-4c09-a22a-25082bd25f00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:01.870543 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2dd1ca-c91a-4c09-a22a-25082bd25f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:01.871455 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2dd1ca-c91a-4c09-a22a-25082bd25f00 admin admin] PATH_INFO: `/v3/projects/0763c8f1415e4b01ba6da03fbb2cd637` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:01.872923 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2dd1ca-c91a-4c09-a22a-25082bd25f00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0763c8f1415e4b01ba6da03fbb2cd637)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:01.873418 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8978d-1317-436b-a508-22c37d8cc209 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:01.875099 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2dd1ca-c91a-4c09-a22a-25082bd25f00 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:01.887532 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01336a64-bc4f-49fa-9020-691ab7edc7f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:01.888594 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01336a64-bc4f-49fa-9020-691ab7edc7f7 service neutron] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:01.889042 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01336a64-bc4f-49fa-9020-691ab7edc7f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:01.889322 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01336a64-bc4f-49fa-9020-691ab7edc7f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:01.914995 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01336a64-bc4f-49fa-9020-691ab7edc7f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:01.916720 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01336a64-bc4f-49fa-9020-691ab7edc7f7 service neutron] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:01.932637 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-bd2dd1ca-c91a-4c09-a22a-25082bd25f00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0763c8f1415e4b01ba6da03fbb2cd637', 'request_id': 'req-bd2dd1ca-c91a-4c09-a22a-25082bd25f00'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:01.934616 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 901/1811] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:32:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:32:01.936732 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b7766-3488-4d40-913f-e9e3e10d5e3f None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:01.939722 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-bd2dd1ca-c91a-4c09-a22a-25082bd25f00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0763c8f1415e4b01ba6da03fbb2cd637', 'request_id': 'req-bd2dd1ca-c91a-4c09-a22a-25082bd25f00'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:01.945559 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b7766-3488-4d40-913f-e9e3e10d5e3f None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:01.946051 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b7766-3488-4d40-913f-e9e3e10d5e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:01.946412 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-bd2dd1ca-c91a-4c09-a22a-25082bd25f00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0763c8f1415e4b01ba6da03fbb2cd637', 'request_id': 'req-bd2dd1ca-c91a-4c09-a22a-25082bd25f00'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:01.975061 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-bd2dd1ca-c91a-4c09-a22a-25082bd25f00 admin admin] The token cache is being invalidate because project 0763c8f1415e4b01ba6da03fbb2cd637 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:32:01.983074 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-bd2dd1ca-c91a-4c09-a22a-25082bd25f00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:01.984003 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-bd2dd1ca-c91a-4c09-a22a-25082bd25f00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:01.989645 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 911/1812] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:32:01 2022] DELETE /identity/v3/projects/0763c8f1415e4b01ba6da03fbb2cd637 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:32:01.990946 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2dd1ca-c91a-4c09-a22a-25082bd25f00 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:01.993254 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-bd2dd1ca-c91a-4c09-a22a-25082bd25f00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:02.000361 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-d58b7766-3488-4d40-913f-e9e3e10d5e3f None None] MFA Rules not processed for user `07f900a4d1db45ad86a9af6363f52855`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:02.002078 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-d58b7766-3488-4d40-913f-e9e3e10d5e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:02.125970 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 902/1813] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:02.145277 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2dd1ca-c91a-4c09-a22a-25082bd25f00 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:02.148827 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b7766-3488-4d40-913f-e9e3e10d5e3f None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:02.150917 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc4eef-0ed6-463a-bbcc-4a1d74519966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:02.153372 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc4eef-0ed6-463a-bbcc-4a1d74519966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:02.153723 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc4eef-0ed6-463a-bbcc-4a1d74519966 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:02.154110 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc4eef-0ed6-463a-bbcc-4a1d74519966 admin admin] PATH_INFO: `/v3/users/1737376480f840b4a607a5ddbfc29dfd` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:02.155080 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-d58b7766-3488-4d40-913f-e9e3e10d5e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:02.156256 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc4eef-0ed6-463a-bbcc-4a1d74519966 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1737376480f840b4a607a5ddbfc29dfd)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:02.158428 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc4eef-0ed6-463a-bbcc-4a1d74519966 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:02.239921 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-85dc4eef-0ed6-463a-bbcc-4a1d74519966 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1737376480f840b4a607a5ddbfc29dfd'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:02.263545 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-85dc4eef-0ed6-463a-bbcc-4a1d74519966 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1737376480f840b4a607a5ddbfc29dfd'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:02.264550 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-85dc4eef-0ed6-463a-bbcc-4a1d74519966 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1737376480f840b4a607a5ddbfc29dfd'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:02.274654 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b7766-3488-4d40-913f-e9e3e10d5e3f None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:02.279851 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad68858-39bc-4cca-98de-06d57c25ab7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:02.280580 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad68858-39bc-4cca-98de-06d57c25ab7f service cinder] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:02.280924 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad68858-39bc-4cca-98de-06d57c25ab7f service cinder] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:02.281266 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad68858-39bc-4cca-98de-06d57c25ab7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:02.285106 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-85dc4eef-0ed6-463a-bbcc-4a1d74519966 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1737376480f840b4a607a5ddbfc29dfd'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:02.295290 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad68858-39bc-4cca-98de-06d57c25ab7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:02.297155 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad68858-39bc-4cca-98de-06d57c25ab7f service cinder] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:02.298426 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-85dc4eef-0ed6-463a-bbcc-4a1d74519966 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1737376480f840b4a607a5ddbfc29dfd'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:02.316038 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 912/1814] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:32:01 2022] DELETE /identity/v3/users/1737376480f840b4a607a5ddbfc29dfd => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:32:02.321503 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 903/1815] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:32:02 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:32:02.514354 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc4eef-0ed6-463a-bbcc-4a1d74519966 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:02.516359 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-85dc4eef-0ed6-463a-bbcc-4a1d74519966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:02.650551 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc4eef-0ed6-463a-bbcc-4a1d74519966 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:02.659114 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5696b4-ae65-4449-aa23-150a02a67757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:02.660136 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5696b4-ae65-4449-aa23-150a02a67757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:02.660516 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5696b4-ae65-4449-aa23-150a02a67757 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:02.660901 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5696b4-ae65-4449-aa23-150a02a67757 admin admin] PATH_INFO: `/v3/users/e35ca76fbaa745eab1714c90d958b460` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:02.663151 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5696b4-ae65-4449-aa23-150a02a67757 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e35ca76fbaa745eab1714c90d958b460)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:02.666253 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5696b4-ae65-4449-aa23-150a02a67757 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:02.763210 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-ee5696b4-ae65-4449-aa23-150a02a67757 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e35ca76fbaa745eab1714c90d958b460'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:02.772593 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-ee5696b4-ae65-4449-aa23-150a02a67757 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e35ca76fbaa745eab1714c90d958b460'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:02.773495 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-ee5696b4-ae65-4449-aa23-150a02a67757 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e35ca76fbaa745eab1714c90d958b460'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:02.794013 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-ee5696b4-ae65-4449-aa23-150a02a67757 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e35ca76fbaa745eab1714c90d958b460'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:02.819660 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-ee5696b4-ae65-4449-aa23-150a02a67757 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e35ca76fbaa745eab1714c90d958b460'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:02.827381 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 913/1816] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:32:02 2022] DELETE /identity/v3/users/e35ca76fbaa745eab1714c90d958b460 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:32:02.832055 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4b0c8-06e2-49a4-86e3-a74118f351b1 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:02.832355 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4b0c8-06e2-49a4-86e3-a74118f351b1 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:02.832617 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4b0c8-06e2-49a4-86e3-a74118f351b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:02.864129 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-31a4b0c8-06e2-49a4-86e3-a74118f351b1 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:02.866770 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-31a4b0c8-06e2-49a4-86e3-a74118f351b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:02.880757 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5696b4-ae65-4449-aa23-150a02a67757 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:02.883071 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-ee5696b4-ae65-4449-aa23-150a02a67757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:02.983333 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 904/1817] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:02.999122 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4b0c8-06e2-49a4-86e3-a74118f351b1 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:03.004612 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-31a4b0c8-06e2-49a4-86e3-a74118f351b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:03.053444 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5696b4-ae65-4449-aa23-150a02a67757 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:03.063807 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe275f0-3463-4b41-89b5-763a333edb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:03.065152 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe275f0-3463-4b41-89b5-763a333edb3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:03.065965 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe275f0-3463-4b41-89b5-763a333edb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:03.066470 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe275f0-3463-4b41-89b5-763a333edb3e admin admin] PATH_INFO: `/v3/projects/92347566f70849d593406528ced5d47a` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:03.067836 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe275f0-3463-4b41-89b5-763a333edb3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=92347566f70849d593406528ced5d47a)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:03.071389 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe275f0-3463-4b41-89b5-763a333edb3e admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:03.147137 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4b0c8-06e2-49a4-86e3-a74118f351b1 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:03.154687 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e1a82-f0a3-4264-b707-4a157b3e1b29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:03.155610 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e1a82-f0a3-4264-b707-4a157b3e1b29 service neutron] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:03.155893 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e1a82-f0a3-4264-b707-4a157b3e1b29 service neutron] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:03.156615 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e1a82-f0a3-4264-b707-4a157b3e1b29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:03.173524 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0e1a82-f0a3-4264-b707-4a157b3e1b29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:03.175716 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0e1a82-f0a3-4264-b707-4a157b3e1b29 service neutron] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:03.194535 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 905/1818] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:32:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:32:03.197138 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e1a82-f0a3-4264-b707-4a157b3e1b29 service neutron] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:03.199167 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-3c0e1a82-f0a3-4264-b707-4a157b3e1b29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:03.226815 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e1a82-f0a3-4264-b707-4a157b3e1b29 service neutron] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:03.233248 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-1fe275f0-3463-4b41-89b5-763a333edb3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92347566f70849d593406528ced5d47a', 'request_id': 'req-1fe275f0-3463-4b41-89b5-763a333edb3e'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:03.244691 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-1fe275f0-3463-4b41-89b5-763a333edb3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92347566f70849d593406528ced5d47a', 'request_id': 'req-1fe275f0-3463-4b41-89b5-763a333edb3e'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:03.252488 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-1fe275f0-3463-4b41-89b5-763a333edb3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92347566f70849d593406528ced5d47a', 'request_id': 'req-1fe275f0-3463-4b41-89b5-763a333edb3e'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:03.272520 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-1fe275f0-3463-4b41-89b5-763a333edb3e admin admin] The token cache is being invalidate because project 92347566f70849d593406528ced5d47a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:32:03.272520 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-1fe275f0-3463-4b41-89b5-763a333edb3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:03.272520 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-1fe275f0-3463-4b41-89b5-763a333edb3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:03.276507 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 914/1819] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:32:02 2022] DELETE /identity/v3/projects/92347566f70849d593406528ced5d47a => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:32:03.278910 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c2938-e4fa-412a-92ff-f41dd2aac089 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:03.279449 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c2938-e4fa-412a-92ff-f41dd2aac089 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:03.279944 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c2938-e4fa-412a-92ff-f41dd2aac089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:03.302959 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-416c2938-e4fa-412a-92ff-f41dd2aac089 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:03.304676 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-416c2938-e4fa-412a-92ff-f41dd2aac089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:03.389212 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b52f8-0e13-4f2f-a1e6-95d77e8798ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:03.390148 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b52f8-0e13-4f2f-a1e6-95d77e8798ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:03.390417 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b52f8-0e13-4f2f-a1e6-95d77e8798ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:03.390764 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b52f8-0e13-4f2f-a1e6-95d77e8798ba admin admin] PATH_INFO: `/v3/projects/bef9d138108a4e05a7f412acd70b7759` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:03.391932 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b52f8-0e13-4f2f-a1e6-95d77e8798ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=bef9d138108a4e05a7f412acd70b7759)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:03.393954 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b52f8-0e13-4f2f-a1e6-95d77e8798ba admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:03.422090 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 915/1820] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:32:03.430325 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dbc3d9-977e-47bd-9dfd-624a018ff275 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:03.430638 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dbc3d9-977e-47bd-9dfd-624a018ff275 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:03.430923 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dbc3d9-977e-47bd-9dfd-624a018ff275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:03.489259 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-e26b52f8-0e13-4f2f-a1e6-95d77e8798ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bef9d138108a4e05a7f412acd70b7759', 'request_id': 'req-e26b52f8-0e13-4f2f-a1e6-95d77e8798ba'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:03.496497 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-e26b52f8-0e13-4f2f-a1e6-95d77e8798ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bef9d138108a4e05a7f412acd70b7759', 'request_id': 'req-e26b52f8-0e13-4f2f-a1e6-95d77e8798ba'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:03.499500 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-d5dbc3d9-977e-47bd-9dfd-624a018ff275 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:03.500750 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-d5dbc3d9-977e-47bd-9dfd-624a018ff275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:03.504095 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-e26b52f8-0e13-4f2f-a1e6-95d77e8798ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bef9d138108a4e05a7f412acd70b7759', 'request_id': 'req-e26b52f8-0e13-4f2f-a1e6-95d77e8798ba'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:03.521238 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-e26b52f8-0e13-4f2f-a1e6-95d77e8798ba admin admin] The token cache is being invalidate because project bef9d138108a4e05a7f412acd70b7759 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:32:03.521533 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-e26b52f8-0e13-4f2f-a1e6-95d77e8798ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:03.522233 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-e26b52f8-0e13-4f2f-a1e6-95d77e8798ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:03.524165 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 906/1821] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:32:03 2022] DELETE /identity/v3/projects/bef9d138108a4e05a7f412acd70b7759 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:32:03.531190 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b08e8-aae8-4989-9f02-6be16d62d485 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:03.531513 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b08e8-aae8-4989-9f02-6be16d62d485 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:03.531806 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b08e8-aae8-4989-9f02-6be16d62d485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:03.554210 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-a25b08e8-aae8-4989-9f02-6be16d62d485 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:03.555431 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-a25b08e8-aae8-4989-9f02-6be16d62d485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:03.613638 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 916/1822] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:32:03.618443 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dbc3d9-977e-47bd-9dfd-624a018ff275 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:03.639301 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 907/1823] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:03.639741 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dbc3d9-977e-47bd-9dfd-624a018ff275 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:03.641617 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dcfd8-1123-46f5-a20f-910b090885bc None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:03.642116 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dcfd8-1123-46f5-a20f-910b090885bc None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:03.642400 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dcfd8-1123-46f5-a20f-910b090885bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:03.645746 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d27a4b-f07c-4e95-b1f3-51fb6c9658cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:03.646706 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d27a4b-f07c-4e95-b1f3-51fb6c9658cc admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:03.647141 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d27a4b-f07c-4e95-b1f3-51fb6c9658cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:03.647567 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d27a4b-f07c-4e95-b1f3-51fb6c9658cc admin admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:03.648520 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d27a4b-f07c-4e95-b1f3-51fb6c9658cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:32:03.649002 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d27a4b-f07c-4e95-b1f3-51fb6c9658cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:03.652863 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d27a4b-f07c-4e95-b1f3-51fb6c9658cc admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:03.667823 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 917/1824] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:32:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:32:03.671447 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d27a4b-f07c-4e95-b1f3-51fb6c9658cc admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:03.672814 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-cc6dcfd8-1123-46f5-a20f-910b090885bc None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:03.674202 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-cc6dcfd8-1123-46f5-a20f-910b090885bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:03.682361 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d27a4b-f07c-4e95-b1f3-51fb6c9658cc admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:03.688602 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1ffa0-eb31-4ae8-bdca-1fb26361c2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:03.689480 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1ffa0-eb31-4ae8-bdca-1fb26361c2d7 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:03.689903 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1ffa0-eb31-4ae8-bdca-1fb26361c2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:03.690296 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1ffa0-eb31-4ae8-bdca-1fb26361c2d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:03.691206 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c1ffa0-eb31-4ae8-bdca-1fb26361c2d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:03.693251 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c1ffa0-eb31-4ae8-bdca-1fb26361c2d7 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:03.695370 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 908/1825] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:03.696425 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6dcfd8-1123-46f5-a20f-910b090885bc None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:03.707756 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6dcfd8-1123-46f5-a20f-910b090885bc None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:03.717725 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4df2d-9ece-4b3a-ae22-12d2c37bcb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:03.722489 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4df2d-9ece-4b3a-ae22-12d2c37bcb93 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:03.723792 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4df2d-9ece-4b3a-ae22-12d2c37bcb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:03.724227 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4df2d-9ece-4b3a-ae22-12d2c37bcb93 admin admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:03.725528 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f4df2d-9ece-4b3a-ae22-12d2c37bcb93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:32:03.726404 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f4df2d-9ece-4b3a-ae22-12d2c37bcb93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:03.731682 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f4df2d-9ece-4b3a-ae22-12d2c37bcb93 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:03.737985 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 918/1826] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:32:03 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:32:03.740527 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1ffa0-eb31-4ae8-bdca-1fb26361c2d7 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:03.763420 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 909/1827] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:32:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:32:03.766284 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4df2d-9ece-4b3a-ae22-12d2c37bcb93 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:03.785098 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4df2d-9ece-4b3a-ae22-12d2c37bcb93 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:03.846273 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1ffa0-eb31-4ae8-bdca-1fb26361c2d7 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:03.857840 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270c156-758c-458b-aed5-9a8621ec18ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:03.858706 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270c156-758c-458b-aed5-9a8621ec18ee admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:03.859061 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270c156-758c-458b-aed5-9a8621ec18ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:03.859996 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270c156-758c-458b-aed5-9a8621ec18ee admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:03.860830 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9270c156-758c-458b-aed5-9a8621ec18ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:03.863875 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9270c156-758c-458b-aed5-9a8621ec18ee admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:03.880344 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93fdc0b-fe37-490f-9d50-e801bb72dc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:03.882465 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fdc0b-fe37-490f-9d50-e801bb72dc0c admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:03.883466 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fdc0b-fe37-490f-9d50-e801bb72dc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:03.883824 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fdc0b-fe37-490f-9d50-e801bb72dc0c admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:03.885028 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93fdc0b-fe37-490f-9d50-e801bb72dc0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:03.890093 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93fdc0b-fe37-490f-9d50-e801bb72dc0c admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:03.895916 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 919/1828] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:32:03 2022] POST /identity/v3/users => generated 287 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:32:03.897144 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270c156-758c-458b-aed5-9a8621ec18ee admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:03.900303 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-9270c156-758c-458b-aed5-9a8621ec18ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:03.919956 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270c156-758c-458b-aed5-9a8621ec18ee admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:03.929774 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24551762-e8ad-49a5-8f19-154ee402ee8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:03.930860 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24551762-e8ad-49a5-8f19-154ee402ee8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:03.931794 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24551762-e8ad-49a5-8f19-154ee402ee8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:03.932100 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24551762-e8ad-49a5-8f19-154ee402ee8a admin admin] PATH_INFO: `/v3/projects/27149caff5d44002a96eff0976313eda` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:03.935933 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24551762-e8ad-49a5-8f19-154ee402ee8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=27149caff5d44002a96eff0976313eda)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:03.938317 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24551762-e8ad-49a5-8f19-154ee402ee8a admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:03.946633 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 910/1829] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:32:03 2022] POST /identity/v3/projects => generated 377 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:32:03.946633 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93fdc0b-fe37-490f-9d50-e801bb72dc0c admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:04.001965 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-24551762-e8ad-49a5-8f19-154ee402ee8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27149caff5d44002a96eff0976313eda', 'request_id': 'req-24551762-e8ad-49a5-8f19-154ee402ee8a'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:04.009243 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-24551762-e8ad-49a5-8f19-154ee402ee8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27149caff5d44002a96eff0976313eda', 'request_id': 'req-24551762-e8ad-49a5-8f19-154ee402ee8a'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:04.017654 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93fdc0b-fe37-490f-9d50-e801bb72dc0c admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:04.021036 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-24551762-e8ad-49a5-8f19-154ee402ee8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27149caff5d44002a96eff0976313eda', 'request_id': 'req-24551762-e8ad-49a5-8f19-154ee402ee8a'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:04.046995 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-24551762-e8ad-49a5-8f19-154ee402ee8a admin admin] The token cache is being invalidate because project 27149caff5d44002a96eff0976313eda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:32:04.049069 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-24551762-e8ad-49a5-8f19-154ee402ee8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:04.050020 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-24551762-e8ad-49a5-8f19-154ee402ee8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:04.055075 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 920/1830] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:32:03 2022] DELETE /identity/v3/projects/27149caff5d44002a96eff0976313eda => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:32:04.055987 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24551762-e8ad-49a5-8f19-154ee402ee8a admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:04.059169 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-24551762-e8ad-49a5-8f19-154ee402ee8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:04.104979 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00449b-bc06-439a-83c8-3a5da0583971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:04.105653 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00449b-bc06-439a-83c8-3a5da0583971 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:04.105937 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00449b-bc06-439a-83c8-3a5da0583971 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:04.108758 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00449b-bc06-439a-83c8-3a5da0583971 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:04.108758 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de00449b-bc06-439a-83c8-3a5da0583971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:04.110188 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de00449b-bc06-439a-83c8-3a5da0583971 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:04.121879 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 911/1831] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:32:03 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:32:04.122560 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00449b-bc06-439a-83c8-3a5da0583971 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:04.126927 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-de00449b-bc06-439a-83c8-3a5da0583971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:04.143643 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24551762-e8ad-49a5-8f19-154ee402ee8a admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:04.146791 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00449b-bc06-439a-83c8-3a5da0583971 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:04.148528 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d9748-176d-48f2-b94d-884c0f32a265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:04.149205 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d9748-176d-48f2-b94d-884c0f32a265 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:04.149469 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d9748-176d-48f2-b94d-884c0f32a265 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:04.149742 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d9748-176d-48f2-b94d-884c0f32a265 admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:04.150717 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d9748-176d-48f2-b94d-884c0f32a265 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:04.152804 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d9748-176d-48f2-b94d-884c0f32a265 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:04.156759 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba7f8f6-8621-4e36-a42b-b384ae200c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:04.159252 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7f8f6-8621-4e36-a42b-b384ae200c50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:04.159547 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7f8f6-8621-4e36-a42b-b384ae200c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:04.159832 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7f8f6-8621-4e36-a42b-b384ae200c50 admin admin] PATH_INFO: `/v3/users/07f900a4d1db45ad86a9af6363f52855` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:04.161347 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba7f8f6-8621-4e36-a42b-b384ae200c50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07f900a4d1db45ad86a9af6363f52855)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:04.163370 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba7f8f6-8621-4e36-a42b-b384ae200c50 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:04.180544 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 921/1832] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:32:04 2022] POST /identity/v3/users => generated 289 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:32:04.181733 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d9748-176d-48f2-b94d-884c0f32a265 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:04.184449 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-a38d9748-176d-48f2-b94d-884c0f32a265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:04.200717 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d9748-176d-48f2-b94d-884c0f32a265 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:04.207030 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436066d-a0b9-4b3f-b74f-12cda32bffc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:04.207906 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436066d-a0b9-4b3f-b74f-12cda32bffc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:04.208266 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436066d-a0b9-4b3f-b74f-12cda32bffc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:04.208619 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436066d-a0b9-4b3f-b74f-12cda32bffc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:04.209998 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1436066d-a0b9-4b3f-b74f-12cda32bffc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:04.211541 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1436066d-a0b9-4b3f-b74f-12cda32bffc8 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:04.224672 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 922/1833] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:32:04.233743 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436066d-a0b9-4b3f-b74f-12cda32bffc8 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:04.235244 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-fba7f8f6-8621-4e36-a42b-b384ae200c50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07f900a4d1db45ad86a9af6363f52855'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:04.236249 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-fba7f8f6-8621-4e36-a42b-b384ae200c50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07f900a4d1db45ad86a9af6363f52855'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:04.249013 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436066d-a0b9-4b3f-b74f-12cda32bffc8 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:04.255513 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c0fc0-8962-4108-b3f8-9cada38d734a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:04.256674 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c0fc0-8962-4108-b3f8-9cada38d734a admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:04.257392 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c0fc0-8962-4108-b3f8-9cada38d734a admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:04.257767 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c0fc0-8962-4108-b3f8-9cada38d734a admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:04.258199 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-fba7f8f6-8621-4e36-a42b-b384ae200c50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07f900a4d1db45ad86a9af6363f52855'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:04.258812 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0c0fc0-8962-4108-b3f8-9cada38d734a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:04.269517 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-fba7f8f6-8621-4e36-a42b-b384ae200c50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07f900a4d1db45ad86a9af6363f52855'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:04.273831 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0c0fc0-8962-4108-b3f8-9cada38d734a admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:04.278647 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-fba7f8f6-8621-4e36-a42b-b384ae200c50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07f900a4d1db45ad86a9af6363f52855'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:04.290535 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 912/1834] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:32:04 2022] DELETE /identity/v3/users/07f900a4d1db45ad86a9af6363f52855 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:32:04.291470 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba7f8f6-8621-4e36-a42b-b384ae200c50 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:04.295419 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-fba7f8f6-8621-4e36-a42b-b384ae200c50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:04.301495 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 923/1835] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:32:04.302584 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c0fc0-8962-4108-b3f8-9cada38d734a admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:04.304971 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-ad0c0fc0-8962-4108-b3f8-9cada38d734a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:04.321753 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c0fc0-8962-4108-b3f8-9cada38d734a admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:04.381722 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba7f8f6-8621-4e36-a42b-b384ae200c50 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:04.389055 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b3b98-9c1c-4f89-a58a-33e421546516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:04.390187 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b3b98-9c1c-4f89-a58a-33e421546516 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:04.390472 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b3b98-9c1c-4f89-a58a-33e421546516 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:04.390894 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b3b98-9c1c-4f89-a58a-33e421546516 admin admin] PATH_INFO: `/v3/projects/e71c7dc93f794ea2be50a436e7a71bb9/users/a22ebe575a9b40ad9a8e25522f06e692/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:04.396099 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6adb07b-5ee9-4e3e-9cdf-355b59f82cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:04.396907 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6adb07b-5ee9-4e3e-9cdf-355b59f82cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:04.397278 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6adb07b-5ee9-4e3e-9cdf-355b59f82cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:04.397565 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6adb07b-5ee9-4e3e-9cdf-355b59f82cf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:04.398495 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6adb07b-5ee9-4e3e-9cdf-355b59f82cf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:04.400436 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6adb07b-5ee9-4e3e-9cdf-355b59f82cf4 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:04.416319 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 924/1836] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:32:04.422874 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6adb07b-5ee9-4e3e-9cdf-355b59f82cf4 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:04.428820 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9b3b98-9c1c-4f89-a58a-33e421546516 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e71c7dc93f794ea2be50a436e7a71bb9, user_id=a22ebe575a9b40ad9a8e25522f06e692, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:04.431484 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9b3b98-9c1c-4f89-a58a-33e421546516 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:04.442099 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6adb07b-5ee9-4e3e-9cdf-355b59f82cf4 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:04.462299 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 913/1837] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:32:04 2022] PUT /identity/v3/projects/e71c7dc93f794ea2be50a436e7a71bb9/users/a22ebe575a9b40ad9a8e25522f06e692/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:32:04.465241 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b115c6-3994-4953-a9a8-54f76d7b6992 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:04.465669 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b115c6-3994-4953-a9a8-54f76d7b6992 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:04.466014 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b115c6-3994-4953-a9a8-54f76d7b6992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:04.501343 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-f1b115c6-3994-4953-a9a8-54f76d7b6992 None None] MFA Rules not processed for user `a22ebe575a9b40ad9a8e25522f06e692`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:04.502673 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-f1b115c6-3994-4953-a9a8-54f76d7b6992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:04.507820 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe792b-854c-4abf-82ae-b11b879ded8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:04.508968 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe792b-854c-4abf-82ae-b11b879ded8b admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:04.509517 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe792b-854c-4abf-82ae-b11b879ded8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:04.509969 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe792b-854c-4abf-82ae-b11b879ded8b admin admin] PATH_INFO: `/v3/projects/ed8de899680b4acf86dcb75fa88cfe3b/users/255bebb52792472a9ce273a8eb58d1c9/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:04.543403 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe792b-854c-4abf-82ae-b11b879ded8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed8de899680b4acf86dcb75fa88cfe3b, user_id=255bebb52792472a9ce273a8eb58d1c9, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:04.546835 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe792b-854c-4abf-82ae-b11b879ded8b admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:04.564640 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 925/1838] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:32:04 2022] PUT /identity/v3/projects/ed8de899680b4acf86dcb75fa88cfe3b/users/255bebb52792472a9ce273a8eb58d1c9/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:32:04.574987 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9e6e1-e6ec-419e-b2e0-520b6124beb0 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:04.576559 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9e6e1-e6ec-419e-b2e0-520b6124beb0 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:04.576840 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9e6e1-e6ec-419e-b2e0-520b6124beb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:04.608862 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-ecc9e6e1-e6ec-419e-b2e0-520b6124beb0 None None] MFA Rules not processed for user `255bebb52792472a9ce273a8eb58d1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:04.610126 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-ecc9e6e1-e6ec-419e-b2e0-520b6124beb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:04.611225 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 914/1839] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:04.616060 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b115c6-3994-4953-a9a8-54f76d7b6992 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:04.646354 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b115c6-3994-4953-a9a8-54f76d7b6992 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:04.681474 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 926/1840] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:32:04.682433 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9e6e1-e6ec-419e-b2e0-520b6124beb0 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:04.683942 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-ecc9e6e1-e6ec-419e-b2e0-520b6124beb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:04.743310 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc273d6-052f-4c99-8bad-93cd7e360669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:04.743974 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc273d6-052f-4c99-8bad-93cd7e360669 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:04.744252 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc273d6-052f-4c99-8bad-93cd7e360669 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:04.744525 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc273d6-052f-4c99-8bad-93cd7e360669 admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:04.746395 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc273d6-052f-4c99-8bad-93cd7e360669 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:04.747986 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc273d6-052f-4c99-8bad-93cd7e360669 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:04.769520 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9e6e1-e6ec-419e-b2e0-520b6124beb0 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:04.776096 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908275f0-3acf-47d4-9dfb-e4bdba6c3bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:04.777071 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908275f0-3acf-47d4-9dfb-e4bdba6c3bac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:04.777442 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908275f0-3acf-47d4-9dfb-e4bdba6c3bac admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:04.777730 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908275f0-3acf-47d4-9dfb-e4bdba6c3bac admin admin] PATH_INFO: `/v3/projects/b52cfc3f9db74a6fa113e8921d76b6cb` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:04.779157 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908275f0-3acf-47d4-9dfb-e4bdba6c3bac admin admin] RBAC: Authorizing `identity:delete_project(project_id=b52cfc3f9db74a6fa113e8921d76b6cb)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:04.781266 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908275f0-3acf-47d4-9dfb-e4bdba6c3bac admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:04.790996 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 915/1841] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:32:04 2022] POST /identity/v3/projects => generated 373 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:32:04.791739 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc273d6-052f-4c99-8bad-93cd7e360669 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:04.846117 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-908275f0-3acf-47d4-9dfb-e4bdba6c3bac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b52cfc3f9db74a6fa113e8921d76b6cb', 'request_id': 'req-908275f0-3acf-47d4-9dfb-e4bdba6c3bac'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:04.856092 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-908275f0-3acf-47d4-9dfb-e4bdba6c3bac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b52cfc3f9db74a6fa113e8921d76b6cb', 'request_id': 'req-908275f0-3acf-47d4-9dfb-e4bdba6c3bac'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:04.861690 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc273d6-052f-4c99-8bad-93cd7e360669 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:04.862719 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-908275f0-3acf-47d4-9dfb-e4bdba6c3bac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b52cfc3f9db74a6fa113e8921d76b6cb', 'request_id': 'req-908275f0-3acf-47d4-9dfb-e4bdba6c3bac'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:04.876915 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-908275f0-3acf-47d4-9dfb-e4bdba6c3bac admin admin] The token cache is being invalidate because project b52cfc3f9db74a6fa113e8921d76b6cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:32:04.877197 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-908275f0-3acf-47d4-9dfb-e4bdba6c3bac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:04.877844 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-908275f0-3acf-47d4-9dfb-e4bdba6c3bac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:04.879624 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 927/1842] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:32:04 2022] DELETE /identity/v3/projects/b52cfc3f9db74a6fa113e8921d76b6cb => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:32:04.883460 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908275f0-3acf-47d4-9dfb-e4bdba6c3bac admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:04.884786 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-908275f0-3acf-47d4-9dfb-e4bdba6c3bac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:04.927588 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce7846-d1b6-46ae-8c26-adc547d7c929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:04.928387 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce7846-d1b6-46ae-8c26-adc547d7c929 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:04.928672 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce7846-d1b6-46ae-8c26-adc547d7c929 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:04.929368 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce7846-d1b6-46ae-8c26-adc547d7c929 admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:04.930056 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce7846-d1b6-46ae-8c26-adc547d7c929 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:04.932015 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce7846-d1b6-46ae-8c26-adc547d7c929 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:04.958427 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 916/1843] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:32:04 2022] POST /identity/v3/projects => generated 379 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:32:04.958427 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2219f2-8496-41c9-83cb-35d4e5cda12a None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:04.958427 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2219f2-8496-41c9-83cb-35d4e5cda12a None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:04.958427 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2219f2-8496-41c9-83cb-35d4e5cda12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:04.963240 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908275f0-3acf-47d4-9dfb-e4bdba6c3bac admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:04.987385 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-aa2219f2-8496-41c9-83cb-35d4e5cda12a None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:04.988601 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-aa2219f2-8496-41c9-83cb-35d4e5cda12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:05.039400 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4363d9-420a-4613-8f41-95a4ef9a7a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:05.040072 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4363d9-420a-4613-8f41-95a4ef9a7a80 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:05.040352 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4363d9-420a-4613-8f41-95a4ef9a7a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:05.040622 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4363d9-420a-4613-8f41-95a4ef9a7a80 admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:05.041332 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4363d9-420a-4613-8f41-95a4ef9a7a80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:05.044001 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4363d9-420a-4613-8f41-95a4ef9a7a80 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:05.051903 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 917/1844] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:05.052620 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2219f2-8496-41c9-83cb-35d4e5cda12a None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:05.054027 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-aa2219f2-8496-41c9-83cb-35d4e5cda12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:05.067508 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2219f2-8496-41c9-83cb-35d4e5cda12a None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:05.075535 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 928/1845] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:32:04 2022] POST /identity/v3/users => generated 293 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:32:05.075683 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc9c46-5f71-4e94-bb3f-ed08abb8ea8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:05.075683 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc9c46-5f71-4e94-bb3f-ed08abb8ea8a admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:05.075683 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc9c46-5f71-4e94-bb3f-ed08abb8ea8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:05.075974 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3065fe-b9d3-4fd1-91e7-e9bb1999b74c None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:05.075974 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3065fe-b9d3-4fd1-91e7-e9bb1999b74c None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:05.076105 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc9c46-5f71-4e94-bb3f-ed08abb8ea8a admin admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:05.076183 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3065fe-b9d3-4fd1-91e7-e9bb1999b74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:05.076252 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc9c46-5f71-4e94-bb3f-ed08abb8ea8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:05.077488 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc9c46-5f71-4e94-bb3f-ed08abb8ea8a admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:05.099927 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-dc3065fe-b9d3-4fd1-91e7-e9bb1999b74c None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:05.101036 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-dc3065fe-b9d3-4fd1-91e7-e9bb1999b74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:05.102122 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 918/1846] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:32:05 2022] POST /identity/v3/users => generated 296 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:32:05.102826 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc9c46-5f71-4e94-bb3f-ed08abb8ea8a admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:05.113170 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 929/1847] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:05.113805 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3065fe-b9d3-4fd1-91e7-e9bb1999b74c None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:05.117060 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc9c46-5f71-4e94-bb3f-ed08abb8ea8a admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:05.123776 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602f71a-c248-46bd-9168-4ed4f81c9825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:05.124462 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602f71a-c248-46bd-9168-4ed4f81c9825 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:05.124744 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602f71a-c248-46bd-9168-4ed4f81c9825 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:05.125012 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602f71a-c248-46bd-9168-4ed4f81c9825 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:05.125726 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a602f71a-c248-46bd-9168-4ed4f81c9825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:05.127387 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a602f71a-c248-46bd-9168-4ed4f81c9825 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:05.129786 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3065fe-b9d3-4fd1-91e7-e9bb1999b74c None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:05.141871 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 919/1848] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:32:05.142055 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f9a6e-fcdb-4011-86ec-6123a025e8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:05.142153 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602f71a-c248-46bd-9168-4ed4f81c9825 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:05.142233 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f9a6e-fcdb-4011-86ec-6123a025e8ef admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:05.142233 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f9a6e-fcdb-4011-86ec-6123a025e8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:05.142233 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f9a6e-fcdb-4011-86ec-6123a025e8ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:05.142233 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f9a6e-fcdb-4011-86ec-6123a025e8ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:05.143519 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f9a6e-fcdb-4011-86ec-6123a025e8ef admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:05.152464 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602f71a-c248-46bd-9168-4ed4f81c9825 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:05.154266 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 930/1849] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:32:05.155281 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f9a6e-fcdb-4011-86ec-6123a025e8ef admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:05.157464 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef006c-1408-4646-9d6f-dddfbf8484a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:05.158118 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef006c-1408-4646-9d6f-dddfbf8484a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:05.158377 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef006c-1408-4646-9d6f-dddfbf8484a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:05.158672 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef006c-1408-4646-9d6f-dddfbf8484a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:05.159400 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdef006c-1408-4646-9d6f-dddfbf8484a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:32:05.159719 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdef006c-1408-4646-9d6f-dddfbf8484a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:05.161255 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdef006c-1408-4646-9d6f-dddfbf8484a5 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:05.166474 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f9a6e-fcdb-4011-86ec-6123a025e8ef admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:05.172095 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663257e2-de17-498b-9034-203a365f1cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:05.173068 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663257e2-de17-498b-9034-203a365f1cb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:05.173345 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663257e2-de17-498b-9034-203a365f1cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:05.173616 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663257e2-de17-498b-9034-203a365f1cb8 admin admin] PATH_INFO: `/v3/projects/e1e023f6d9e84b47a23113d6eec63ecb/users/86dee824a08d4481b82641885aea91c0/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:05.174653 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 920/1850] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:32:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:32:05.175392 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef006c-1408-4646-9d6f-dddfbf8484a5 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:05.185203 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef006c-1408-4646-9d6f-dddfbf8484a5 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:05.189943 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e63537-3e35-4f39-a0c8-c670e31b0bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:05.190830 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e63537-3e35-4f39-a0c8-c670e31b0bdd admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:05.191112 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e63537-3e35-4f39-a0c8-c670e31b0bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:05.191383 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e63537-3e35-4f39-a0c8-c670e31b0bdd admin admin] PATH_INFO: `/v3/projects/7e8671c6c6354a288cb7384f3f7dae5a/users/680a932c33904abfb501d84bdea2e4f2/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:05.193790 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663257e2-de17-498b-9034-203a365f1cb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1e023f6d9e84b47a23113d6eec63ecb, user_id=86dee824a08d4481b82641885aea91c0, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:05.196485 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663257e2-de17-498b-9034-203a365f1cb8 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:05.207404 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e63537-3e35-4f39-a0c8-c670e31b0bdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e8671c6c6354a288cb7384f3f7dae5a, user_id=680a932c33904abfb501d84bdea2e4f2, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:05.210264 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e63537-3e35-4f39-a0c8-c670e31b0bdd admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:05.210621 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 931/1851] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:32:05 2022] PUT /identity/v3/projects/e1e023f6d9e84b47a23113d6eec63ecb/users/86dee824a08d4481b82641885aea91c0/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:32:05.211395 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663257e2-de17-498b-9034-203a365f1cb8 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:05.223822 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 921/1852] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:32:05 2022] PUT /identity/v3/projects/7e8671c6c6354a288cb7384f3f7dae5a/users/680a932c33904abfb501d84bdea2e4f2/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:32:05.227421 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e63537-3e35-4f39-a0c8-c670e31b0bdd admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:05.279553 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663257e2-de17-498b-9034-203a365f1cb8 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:05.292079 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e63537-3e35-4f39-a0c8-c670e31b0bdd admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:05.301985 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c2c85-4deb-4e65-85c7-3383bc4053d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:05.302677 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c2c85-4deb-4e65-85c7-3383bc4053d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:05.302958 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c2c85-4deb-4e65-85c7-3383bc4053d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:05.303225 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c2c85-4deb-4e65-85c7-3383bc4053d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:05.303942 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c2c85-4deb-4e65-85c7-3383bc4053d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:05.305518 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c2c85-4deb-4e65-85c7-3383bc4053d4 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:05.321350 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 922/1853] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:32:05.321350 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c2c85-4deb-4e65-85c7-3383bc4053d4 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:05.329193 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c2c85-4deb-4e65-85c7-3383bc4053d4 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:05.334086 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f57ac5-59b9-4a70-b2b3-efce63d23890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:05.334764 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f57ac5-59b9-4a70-b2b3-efce63d23890 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:05.335046 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f57ac5-59b9-4a70-b2b3-efce63d23890 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:05.335313 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f57ac5-59b9-4a70-b2b3-efce63d23890 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:05.336017 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f57ac5-59b9-4a70-b2b3-efce63d23890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:05.337577 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f57ac5-59b9-4a70-b2b3-efce63d23890 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:05.342178 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a5b35-649f-4f18-9401-7e15fe02b16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:05.342876 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a5b35-649f-4f18-9401-7e15fe02b16c admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:05.343157 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a5b35-649f-4f18-9401-7e15fe02b16c admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:05.343429 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a5b35-649f-4f18-9401-7e15fe02b16c admin admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:05.344110 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a5b35-649f-4f18-9401-7e15fe02b16c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:05.345984 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a5b35-649f-4f18-9401-7e15fe02b16c admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:05.353235 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 923/1854] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:32:05.356779 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f57ac5-59b9-4a70-b2b3-efce63d23890 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:05.374375 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f57ac5-59b9-4a70-b2b3-efce63d23890 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:05.376232 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 932/1855] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:32:05 2022] POST /identity/v3/projects => generated 407 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:32:05.377046 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a5b35-649f-4f18-9401-7e15fe02b16c admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:05.441788 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49874c33-c04e-45bb-aaf1-e38cf87d1047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:05.442674 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49874c33-c04e-45bb-aaf1-e38cf87d1047 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:05.443084 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49874c33-c04e-45bb-aaf1-e38cf87d1047 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:05.443362 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49874c33-c04e-45bb-aaf1-e38cf87d1047 admin admin] PATH_INFO: `/v3/projects/e1e023f6d9e84b47a23113d6eec63ecb/users/86dee824a08d4481b82641885aea91c0/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:05.445969 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49874c33-c04e-45bb-aaf1-e38cf87d1047 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1e023f6d9e84b47a23113d6eec63ecb, user_id=86dee824a08d4481b82641885aea91c0, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:05.449308 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49874c33-c04e-45bb-aaf1-e38cf87d1047 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:05.454682 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a5b35-649f-4f18-9401-7e15fe02b16c admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:05.460157 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 924/1856] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:32:05 2022] PUT /identity/v3/projects/e1e023f6d9e84b47a23113d6eec63ecb/users/86dee824a08d4481b82641885aea91c0/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:32:05.470725 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49874c33-c04e-45bb-aaf1-e38cf87d1047 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:05.510227 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192e4d1-ff4e-4e3f-aedc-296b31b7f94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:05.511839 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192e4d1-ff4e-4e3f-aedc-296b31b7f94c admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:05.512118 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192e4d1-ff4e-4e3f-aedc-296b31b7f94c admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:05.512392 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192e4d1-ff4e-4e3f-aedc-296b31b7f94c admin admin] PATH_INFO: `/v3/projects/7e8671c6c6354a288cb7384f3f7dae5a/users/680a932c33904abfb501d84bdea2e4f2/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:05.514371 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192e4d1-ff4e-4e3f-aedc-296b31b7f94c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e8671c6c6354a288cb7384f3f7dae5a, user_id=680a932c33904abfb501d84bdea2e4f2, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:05.517002 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192e4d1-ff4e-4e3f-aedc-296b31b7f94c admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:05.527697 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 933/1857] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:32:05 2022] PUT /identity/v3/projects/7e8671c6c6354a288cb7384f3f7dae5a/users/680a932c33904abfb501d84bdea2e4f2/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:32:05.528733 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49874c33-c04e-45bb-aaf1-e38cf87d1047 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:05.530208 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18684352-4bd5-4372-b6d3-b33bba3bcd48 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:05.530501 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18684352-4bd5-4372-b6d3-b33bba3bcd48 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:05.530802 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18684352-4bd5-4372-b6d3-b33bba3bcd48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:05.566400 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-18684352-4bd5-4372-b6d3-b33bba3bcd48 None None] MFA Rules not processed for user `86dee824a08d4481b82641885aea91c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:05.568202 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-18684352-4bd5-4372-b6d3-b33bba3bcd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:05.597038 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd2f3e-010e-4273-99a4-8eabe9eb8fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:05.597838 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd2f3e-010e-4273-99a4-8eabe9eb8fd2 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:05.598192 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd2f3e-010e-4273-99a4-8eabe9eb8fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:05.598542 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd2f3e-010e-4273-99a4-8eabe9eb8fd2 admin admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:05.599352 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fd2f3e-010e-4273-99a4-8eabe9eb8fd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:05.601713 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fd2f3e-010e-4273-99a4-8eabe9eb8fd2 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:05.640062 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 925/1858] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:32:05 2022] POST /identity/v3/users => generated 304 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:32:05.641384 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28dce8-b1c0-4f52-8d47-222edb286578 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:05.641748 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28dce8-b1c0-4f52-8d47-222edb286578 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:05.642122 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28dce8-b1c0-4f52-8d47-222edb286578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:05.662835 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 934/1859] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:05 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:05.664081 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18684352-4bd5-4372-b6d3-b33bba3bcd48 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:05.677740 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18684352-4bd5-4372-b6d3-b33bba3bcd48 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:05.680177 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-0a28dce8-b1c0-4f52-8d47-222edb286578 None None] MFA Rules not processed for user `680a932c33904abfb501d84bdea2e4f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:05.681827 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-0a28dce8-b1c0-4f52-8d47-222edb286578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:05.702235 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c70f2b-b9b0-4273-993b-6940d932627d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:05.702956 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c70f2b-b9b0-4273-993b-6940d932627d admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:05.703242 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c70f2b-b9b0-4273-993b-6940d932627d admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:05.703524 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c70f2b-b9b0-4273-993b-6940d932627d admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:05.704308 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c70f2b-b9b0-4273-993b-6940d932627d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:05.705937 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c70f2b-b9b0-4273-993b-6940d932627d admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:05.739013 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 935/1860] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:32:05.741918 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c70f2b-b9b0-4273-993b-6940d932627d admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:05.748382 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-c4c70f2b-b9b0-4273-993b-6940d932627d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:05.780687 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 926/1861] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:05 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:05.781997 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28dce8-b1c0-4f52-8d47-222edb286578 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:05.812161 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28dce8-b1c0-4f52-8d47-222edb286578 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:05.817219 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76a67e0-d845-4005-903f-d6d6e5abe5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:05.818130 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a67e0-d845-4005-903f-d6d6e5abe5eb admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:05.818952 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a67e0-d845-4005-903f-d6d6e5abe5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:05.818952 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a67e0-d845-4005-903f-d6d6e5abe5eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:05.819608 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76a67e0-d845-4005-903f-d6d6e5abe5eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:05.822282 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76a67e0-d845-4005-903f-d6d6e5abe5eb admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:05.834650 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 927/1862] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:32:05.848203 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76a67e0-d845-4005-903f-d6d6e5abe5eb admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:05.854141 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-e76a67e0-d845-4005-903f-d6d6e5abe5eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:05.856735 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c70f2b-b9b0-4273-993b-6940d932627d admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:05.861387 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65489294-7b34-4bf8-9262-3475008b176c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:05.862153 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65489294-7b34-4bf8-9262-3475008b176c service cinder] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:05.862671 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65489294-7b34-4bf8-9262-3475008b176c service cinder] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:05.863054 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65489294-7b34-4bf8-9262-3475008b176c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:05.879930 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65489294-7b34-4bf8-9262-3475008b176c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:05.883097 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65489294-7b34-4bf8-9262-3475008b176c service cinder] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:05.891736 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76a67e0-d845-4005-903f-d6d6e5abe5eb admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:05.897062 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eddd3c-a96b-432c-b1f1-6ab24b3c4938 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:05.897721 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eddd3c-a96b-432c-b1f1-6ab24b3c4938 service cinder] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:05.898009 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eddd3c-a96b-432c-b1f1-6ab24b3c4938 service cinder] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:05.898290 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eddd3c-a96b-432c-b1f1-6ab24b3c4938 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:05.898940 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 936/1863] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:32:05 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:32:05.899931 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65489294-7b34-4bf8-9262-3475008b176c service cinder] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:05.910263 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eddd3c-a96b-432c-b1f1-6ab24b3c4938 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:05.913127 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eddd3c-a96b-432c-b1f1-6ab24b3c4938 service cinder] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:05.926485 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 928/1864] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:32:05 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:32:05.931808 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65489294-7b34-4bf8-9262-3475008b176c service cinder] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:05.948574 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf80105-deab-49ae-889a-6ed2978b2217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:05.955407 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf80105-deab-49ae-889a-6ed2978b2217 admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:05.957200 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf80105-deab-49ae-889a-6ed2978b2217 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:05.957636 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf80105-deab-49ae-889a-6ed2978b2217 admin admin] PATH_INFO: `/v3/projects/4264412cdc71491880965c1858e005a8/users/d1fac8468d4e4e5c889d4406f48cead5/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:06.011757 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf80105-deab-49ae-889a-6ed2978b2217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4264412cdc71491880965c1858e005a8, user_id=d1fac8468d4e4e5c889d4406f48cead5, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:06.018395 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf80105-deab-49ae-889a-6ed2978b2217 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:06.046874 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 937/1865] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:32:05 2022] PUT /identity/v3/projects/4264412cdc71491880965c1858e005a8/users/d1fac8468d4e4e5c889d4406f48cead5/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:32:06.060570 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae242e-2b37-41d5-bc58-de355fe0159c None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:06.061644 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae242e-2b37-41d5-bc58-de355fe0159c None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:06.062331 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae242e-2b37-41d5-bc58-de355fe0159c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:06.133934 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-11ae242e-2b37-41d5-bc58-de355fe0159c None None] MFA Rules not processed for user `d1fac8468d4e4e5c889d4406f48cead5`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:06.136480 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-11ae242e-2b37-41d5-bc58-de355fe0159c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:06.147358 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf80105-deab-49ae-889a-6ed2978b2217 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:06.248777 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 929/1866] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:06 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:06.258447 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae242e-2b37-41d5-bc58-de355fe0159c None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:06.263409 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf80105-deab-49ae-889a-6ed2978b2217 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:06.273224 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53bd261-675f-4dac-b235-a74b8285f1be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:06.274044 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bd261-675f-4dac-b235-a74b8285f1be service cinder] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:06.274405 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bd261-675f-4dac-b235-a74b8285f1be service cinder] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:06.274785 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bd261-675f-4dac-b235-a74b8285f1be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:06.282071 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-b53bd261-675f-4dac-b235-a74b8285f1be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:06.350299 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae242e-2b37-41d5-bc58-de355fe0159c None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:06.364006 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eeda87-c7d6-4c4e-b64d-b3e78ec8ad28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:06.365143 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eeda87-c7d6-4c4e-b64d-b3e78ec8ad28 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:06.365717 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eeda87-c7d6-4c4e-b64d-b3e78ec8ad28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:06.366126 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eeda87-c7d6-4c4e-b64d-b3e78ec8ad28 admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:06.366940 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eeda87-c7d6-4c4e-b64d-b3e78ec8ad28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:06.369656 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eeda87-c7d6-4c4e-b64d-b3e78ec8ad28 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:06.405602 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53bd261-675f-4dac-b235-a74b8285f1be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:06.409344 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53bd261-675f-4dac-b235-a74b8285f1be service cinder] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:06.418627 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 930/1867] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:32:06 2022] POST /identity/v3/projects => generated 409 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:32:06.420091 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eeda87-c7d6-4c4e-b64d-b3e78ec8ad28 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:06.442453 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 938/1868] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:32:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:32:06.589537 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eeda87-c7d6-4c4e-b64d-b3e78ec8ad28 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:06.625204 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38264e8b-9072-4672-85f5-64983eb94fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:06.626239 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38264e8b-9072-4672-85f5-64983eb94fca admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:06.626769 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38264e8b-9072-4672-85f5-64983eb94fca admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:06.627160 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38264e8b-9072-4672-85f5-64983eb94fca admin admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:06.628715 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38264e8b-9072-4672-85f5-64983eb94fca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:06.630892 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38264e8b-9072-4672-85f5-64983eb94fca admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:06.683753 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 931/1869] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:32:06 2022] POST /identity/v3/users => generated 311 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:32:06.688654 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53bd261-675f-4dac-b235-a74b8285f1be service cinder] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:06.718988 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53bd261-675f-4dac-b235-a74b8285f1be service cinder] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:06.748428 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af12cc5-3276-44e0-9f78-1723904deb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:06.750204 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af12cc5-3276-44e0-9f78-1723904deb40 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:06.753282 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af12cc5-3276-44e0-9f78-1723904deb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:06.753730 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af12cc5-3276-44e0-9f78-1723904deb40 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:06.757389 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af12cc5-3276-44e0-9f78-1723904deb40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:06.760262 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af12cc5-3276-44e0-9f78-1723904deb40 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:06.777846 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 939/1870] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:32:06.782571 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38264e8b-9072-4672-85f5-64983eb94fca admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:06.798312 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38264e8b-9072-4672-85f5-64983eb94fca admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:06.811270 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00221300-cfda-45db-8ead-e745c31b75c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:06.813865 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00221300-cfda-45db-8ead-e745c31b75c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:06.813865 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00221300-cfda-45db-8ead-e745c31b75c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:06.815019 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00221300-cfda-45db-8ead-e745c31b75c5 admin admin] PATH_INFO: `/v3/projects/7f9e6a54970345e997e1a2c854c66e7d/users/6258b2dad8224e49b45ae461c81714d2/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:06.852570 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00221300-cfda-45db-8ead-e745c31b75c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f9e6a54970345e997e1a2c854c66e7d, user_id=6258b2dad8224e49b45ae461c81714d2, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:06.857226 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00221300-cfda-45db-8ead-e745c31b75c5 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:06.905109 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 932/1871] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:32:06 2022] PUT /identity/v3/projects/7f9e6a54970345e997e1a2c854c66e7d/users/6258b2dad8224e49b45ae461c81714d2/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:32:06.906322 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af12cc5-3276-44e0-9f78-1723904deb40 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:06.925262 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af12cc5-3276-44e0-9f78-1723904deb40 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:07.103219 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be1516b-1f4b-4eeb-86c1-73d4c1f04f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:07.105726 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1516b-1f4b-4eeb-86c1-73d4c1f04f11 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:07.105726 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1516b-1f4b-4eeb-86c1-73d4c1f04f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:07.105726 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1516b-1f4b-4eeb-86c1-73d4c1f04f11 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:07.106004 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be1516b-1f4b-4eeb-86c1-73d4c1f04f11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:07.107468 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be1516b-1f4b-4eeb-86c1-73d4c1f04f11 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:07.127561 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 940/1872] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:32:07.132519 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00221300-cfda-45db-8ead-e745c31b75c5 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:07.161588 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00221300-cfda-45db-8ead-e745c31b75c5 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:07.170746 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be1516b-1f4b-4eeb-86c1-73d4c1f04f11 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:07.196012 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e5a4a-8ad7-4225-a126-cfec67da3dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:07.197089 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be1516b-1f4b-4eeb-86c1-73d4c1f04f11 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:07.199192 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e5a4a-8ad7-4225-a126-cfec67da3dbb admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:07.200275 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e5a4a-8ad7-4225-a126-cfec67da3dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:07.200732 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e5a4a-8ad7-4225-a126-cfec67da3dbb admin admin] PATH_INFO: `/v3/projects/7f9e6a54970345e997e1a2c854c66e7d/users/6258b2dad8224e49b45ae461c81714d2/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:07.211812 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510e5a4a-8ad7-4225-a126-cfec67da3dbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f9e6a54970345e997e1a2c854c66e7d, user_id=6258b2dad8224e49b45ae461c81714d2, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:07.216676 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510e5a4a-8ad7-4225-a126-cfec67da3dbb admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:07.219943 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9dc20-52ae-4f99-b0e1-5bc882b6b65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:07.221246 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9dc20-52ae-4f99-b0e1-5bc882b6b65b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:07.221628 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9dc20-52ae-4f99-b0e1-5bc882b6b65b admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:07.221954 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9dc20-52ae-4f99-b0e1-5bc882b6b65b admin admin] PATH_INFO: `/v3/users/255bebb52792472a9ce273a8eb58d1c9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:07.223985 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9dc20-52ae-4f99-b0e1-5bc882b6b65b admin admin] RBAC: Authorizing `identity:delete_user(user_id=255bebb52792472a9ce273a8eb58d1c9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:07.227141 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9dc20-52ae-4f99-b0e1-5bc882b6b65b admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:07.269744 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 933/1873] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:32:07 2022] PUT /identity/v3/projects/7f9e6a54970345e997e1a2c854c66e7d/users/6258b2dad8224e49b45ae461c81714d2/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:32:07.282175 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821079fc-c4b5-48da-b967-02228ee0c0f9 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:07.283623 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821079fc-c4b5-48da-b967-02228ee0c0f9 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:07.283772 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821079fc-c4b5-48da-b967-02228ee0c0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:07.366431 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-821079fc-c4b5-48da-b967-02228ee0c0f9 None None] MFA Rules not processed for user `6258b2dad8224e49b45ae461c81714d2`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:07.368219 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-821079fc-c4b5-48da-b967-02228ee0c0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:07.379157 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-c0f9dc20-52ae-4f99-b0e1-5bc882b6b65b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '255bebb52792472a9ce273a8eb58d1c9'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:07.395364 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-c0f9dc20-52ae-4f99-b0e1-5bc882b6b65b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '255bebb52792472a9ce273a8eb58d1c9'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:07.396375 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-c0f9dc20-52ae-4f99-b0e1-5bc882b6b65b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '255bebb52792472a9ce273a8eb58d1c9'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:07.425080 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-c0f9dc20-52ae-4f99-b0e1-5bc882b6b65b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '255bebb52792472a9ce273a8eb58d1c9'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:07.443526 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-c0f9dc20-52ae-4f99-b0e1-5bc882b6b65b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '255bebb52792472a9ce273a8eb58d1c9'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:07.464948 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 941/1874] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:32:07 2022] DELETE /identity/v3/users/255bebb52792472a9ce273a8eb58d1c9 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:32:07.469162 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf408cc-d6a9-4ed7-9c7b-46e5d3a74dc2 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:07.469449 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf408cc-d6a9-4ed7-9c7b-46e5d3a74dc2 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:07.469772 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf408cc-d6a9-4ed7-9c7b-46e5d3a74dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:07.511083 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-0cf408cc-d6a9-4ed7-9c7b-46e5d3a74dc2 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:07.512982 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-0cf408cc-d6a9-4ed7-9c7b-46e5d3a74dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:07.546675 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 934/1875] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:07 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:32:07.560383 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821079fc-c4b5-48da-b967-02228ee0c0f9 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:07.562109 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-821079fc-c4b5-48da-b967-02228ee0c0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:07.651997 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821079fc-c4b5-48da-b967-02228ee0c0f9 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:07.686198 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 942/1876] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:32:07.743978 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb23b9-ba27-4a02-9b02-61845701055b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:07.746176 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb23b9-ba27-4a02-9b02-61845701055b service cinder] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:07.746636 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb23b9-ba27-4a02-9b02-61845701055b service cinder] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:07.747112 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb23b9-ba27-4a02-9b02-61845701055b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:07.755735 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf408cc-d6a9-4ed7-9c7b-46e5d3a74dc2 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:07.757447 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-0cf408cc-d6a9-4ed7-9c7b-46e5d3a74dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:07.891890 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf408cc-d6a9-4ed7-9c7b-46e5d3a74dc2 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:07.895772 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc91f6-ce4c-4fa1-99f5-20779ba5b848 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:07.896433 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc91f6-ce4c-4fa1-99f5-20779ba5b848 service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:07.896710 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc91f6-ce4c-4fa1-99f5-20779ba5b848 service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:07.896985 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc91f6-ce4c-4fa1-99f5-20779ba5b848 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:07.912705 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb23b9-ba27-4a02-9b02-61845701055b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:07.915390 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb23b9-ba27-4a02-9b02-61845701055b service cinder] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:07.925062 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc91f6-ce4c-4fa1-99f5-20779ba5b848 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:07.927734 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc91f6-ce4c-4fa1-99f5-20779ba5b848 service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:07.946162 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 943/1877] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:32:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:32:07.947965 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 935/1878] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:32:07 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:32:08.193513 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc91f6-ce4c-4fa1-99f5-20779ba5b848 service neutron] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:08.208555 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc91f6-ce4c-4fa1-99f5-20779ba5b848 service neutron] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:08.215460 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df68739c-bb2d-474b-baa6-b2c59f13afb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:08.216599 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68739c-bb2d-474b-baa6-b2c59f13afb3 service cinder] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:08.216874 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68739c-bb2d-474b-baa6-b2c59f13afb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:08.217151 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68739c-bb2d-474b-baa6-b2c59f13afb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:08.222334 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-df68739c-bb2d-474b-baa6-b2c59f13afb3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:08.372635 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df68739c-bb2d-474b-baa6-b2c59f13afb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:08.374315 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df68739c-bb2d-474b-baa6-b2c59f13afb3 service cinder] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:08.408104 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 944/1879] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:32:08 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:32:09.268216 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb23b9-ba27-4a02-9b02-61845701055b service cinder] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:09.270190 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-d0bb23b9-ba27-4a02-9b02-61845701055b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:09.302971 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb23b9-ba27-4a02-9b02-61845701055b service cinder] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:09.314161 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432293ca-550a-4a26-af59-8cba01466474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:09.316145 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432293ca-550a-4a26-af59-8cba01466474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:09.316429 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432293ca-550a-4a26-af59-8cba01466474 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:09.316708 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432293ca-550a-4a26-af59-8cba01466474 admin admin] PATH_INFO: `/v3/projects/ed8de899680b4acf86dcb75fa88cfe3b` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:09.323865 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432293ca-550a-4a26-af59-8cba01466474 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed8de899680b4acf86dcb75fa88cfe3b)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:09.334408 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432293ca-550a-4a26-af59-8cba01466474 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:09.456390 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-432293ca-550a-4a26-af59-8cba01466474 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed8de899680b4acf86dcb75fa88cfe3b', 'request_id': 'req-432293ca-550a-4a26-af59-8cba01466474'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:09.463186 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-432293ca-550a-4a26-af59-8cba01466474 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed8de899680b4acf86dcb75fa88cfe3b', 'request_id': 'req-432293ca-550a-4a26-af59-8cba01466474'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:09.474923 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-432293ca-550a-4a26-af59-8cba01466474 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed8de899680b4acf86dcb75fa88cfe3b', 'request_id': 'req-432293ca-550a-4a26-af59-8cba01466474'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:09.494019 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-432293ca-550a-4a26-af59-8cba01466474 admin admin] The token cache is being invalidate because project ed8de899680b4acf86dcb75fa88cfe3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:32:09.494326 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-432293ca-550a-4a26-af59-8cba01466474 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:09.495926 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-432293ca-550a-4a26-af59-8cba01466474 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:09.497636 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 936/1880] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:32:09 2022] DELETE /identity/v3/projects/ed8de899680b4acf86dcb75fa88cfe3b => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:32:09.502246 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df68739c-bb2d-474b-baa6-b2c59f13afb3 service cinder] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:09.517226 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df68739c-bb2d-474b-baa6-b2c59f13afb3 service cinder] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:09.609448 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770ed27-524a-4c37-a2e1-56ad38a07d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:09.610865 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770ed27-524a-4c37-a2e1-56ad38a07d11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:09.611357 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770ed27-524a-4c37-a2e1-56ad38a07d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:09.611849 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770ed27-524a-4c37-a2e1-56ad38a07d11 admin admin] PATH_INFO: `/v3/users/680a932c33904abfb501d84bdea2e4f2` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:09.613710 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770ed27-524a-4c37-a2e1-56ad38a07d11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=680a932c33904abfb501d84bdea2e4f2)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:09.617722 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770ed27-524a-4c37-a2e1-56ad38a07d11 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:09.683841 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-b770ed27-524a-4c37-a2e1-56ad38a07d11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '680a932c33904abfb501d84bdea2e4f2'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:09.692977 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-b770ed27-524a-4c37-a2e1-56ad38a07d11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '680a932c33904abfb501d84bdea2e4f2'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:09.694557 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-b770ed27-524a-4c37-a2e1-56ad38a07d11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '680a932c33904abfb501d84bdea2e4f2'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:09.711437 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-b770ed27-524a-4c37-a2e1-56ad38a07d11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '680a932c33904abfb501d84bdea2e4f2'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:09.720500 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-b770ed27-524a-4c37-a2e1-56ad38a07d11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '680a932c33904abfb501d84bdea2e4f2'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:09.738501 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 945/1881] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:32:09 2022] DELETE /identity/v3/users/680a932c33904abfb501d84bdea2e4f2 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:32:10.023182 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc610f7-1fcd-4efc-8ce3-6bf60b839113 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:10.023691 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc610f7-1fcd-4efc-8ce3-6bf60b839113 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:10.024111 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc610f7-1fcd-4efc-8ce3-6bf60b839113 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:10.028509 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 937/1882] 10.222.0.21 () {54 vars in 921 bytes} [Mon Feb 28 10:32:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:32:10.047668 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d75f8-eb11-45aa-8f35-009c2346e24f None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:10.047956 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d75f8-eb11-45aa-8f35-009c2346e24f None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:10.048290 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d75f8-eb11-45aa-8f35-009c2346e24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:10.075629 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-994d75f8-eb11-45aa-8f35-009c2346e24f None None] MFA Rules not processed for user `ec202a34db8e47f4a6c18285245e3f5b`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:10.077120 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-994d75f8-eb11-45aa-8f35-009c2346e24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:10.232686 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc610f7-1fcd-4efc-8ce3-6bf60b839113 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:10.237044 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-2bc610f7-1fcd-4efc-8ce3-6bf60b839113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:10.238260 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 946/1883] 10.222.0.21 () {58 vars in 1018 bytes} [Mon Feb 28 10:32:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:10.485036 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc610f7-1fcd-4efc-8ce3-6bf60b839113 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:10.503454 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c01477-bfe9-4911-843c-70c4e679e52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:10.504362 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c01477-bfe9-4911-843c-70c4e679e52e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:10.504647 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c01477-bfe9-4911-843c-70c4e679e52e admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:10.504927 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c01477-bfe9-4911-843c-70c4e679e52e admin admin] PATH_INFO: `/v3/users/ae3c38248f57445e8cf786158691fa51` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:10.506294 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c01477-bfe9-4911-843c-70c4e679e52e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae3c38248f57445e8cf786158691fa51)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:10.508416 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c01477-bfe9-4911-843c-70c4e679e52e admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:10.559924 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d75f8-eb11-45aa-8f35-009c2346e24f None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:10.563895 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-994d75f8-eb11-45aa-8f35-009c2346e24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:10.583629 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-01c01477-bfe9-4911-843c-70c4e679e52e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae3c38248f57445e8cf786158691fa51'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:10.584724 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-01c01477-bfe9-4911-843c-70c4e679e52e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae3c38248f57445e8cf786158691fa51'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:10.601347 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d75f8-eb11-45aa-8f35-009c2346e24f None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:10.609707 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-01c01477-bfe9-4911-843c-70c4e679e52e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae3c38248f57445e8cf786158691fa51'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:10.612317 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85609004-e282-4ebe-85a1-c724401a057f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:10.614122 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85609004-e282-4ebe-85a1-c724401a057f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:10.614439 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85609004-e282-4ebe-85a1-c724401a057f admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:10.614785 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85609004-e282-4ebe-85a1-c724401a057f admin admin] PATH_INFO: `/v3/projects/7e8671c6c6354a288cb7384f3f7dae5a` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:10.616468 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85609004-e282-4ebe-85a1-c724401a057f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e8671c6c6354a288cb7384f3f7dae5a)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:10.618812 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85609004-e282-4ebe-85a1-c724401a057f admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:10.626923 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-01c01477-bfe9-4911-843c-70c4e679e52e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae3c38248f57445e8cf786158691fa51'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:10.637950 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-01c01477-bfe9-4911-843c-70c4e679e52e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae3c38248f57445e8cf786158691fa51'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:10.644430 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 938/1884] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:32:10 2022] DELETE /identity/v3/users/ae3c38248f57445e8cf786158691fa51 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:32:10.649212 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291849b0-624c-49d0-bdd1-a34428032959 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:10.649507 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291849b0-624c-49d0-bdd1-a34428032959 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:10.649787 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291849b0-624c-49d0-bdd1-a34428032959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:10.668980 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-291849b0-624c-49d0-bdd1-a34428032959 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:10.670407 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-291849b0-624c-49d0-bdd1-a34428032959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:10.676551 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-85609004-e282-4ebe-85a1-c724401a057f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e8671c6c6354a288cb7384f3f7dae5a', 'request_id': 'req-85609004-e282-4ebe-85a1-c724401a057f'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:10.689749 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-85609004-e282-4ebe-85a1-c724401a057f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e8671c6c6354a288cb7384f3f7dae5a', 'request_id': 'req-85609004-e282-4ebe-85a1-c724401a057f'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:10.696372 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-85609004-e282-4ebe-85a1-c724401a057f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e8671c6c6354a288cb7384f3f7dae5a', 'request_id': 'req-85609004-e282-4ebe-85a1-c724401a057f'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:10.729550 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-85609004-e282-4ebe-85a1-c724401a057f admin admin] The token cache is being invalidate because project 7e8671c6c6354a288cb7384f3f7dae5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:32:10.729550 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-85609004-e282-4ebe-85a1-c724401a057f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:10.729550 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-85609004-e282-4ebe-85a1-c724401a057f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:10.731871 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 947/1885] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:32:10 2022] DELETE /identity/v3/projects/7e8671c6c6354a288cb7384f3f7dae5a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:32:10.736262 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ccc1a1-6aec-4408-85cf-8b017f381fc3 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:10.736555 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ccc1a1-6aec-4408-85cf-8b017f381fc3 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:10.736834 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ccc1a1-6aec-4408-85cf-8b017f381fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:10.743810 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 939/1886] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:10.754003 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291849b0-624c-49d0-bdd1-a34428032959 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:10.755462 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-291849b0-624c-49d0-bdd1-a34428032959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:10.762264 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-63ccc1a1-6aec-4408-85cf-8b017f381fc3 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:10.763752 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-63ccc1a1-6aec-4408-85cf-8b017f381fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:10.772764 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 948/1887] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:32:10.780727 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a0429-3bf5-48d4-b28e-27b5de037051 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:10.780994 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a0429-3bf5-48d4-b28e-27b5de037051 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:10.781268 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a0429-3bf5-48d4-b28e-27b5de037051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:10.801249 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-506a0429-3bf5-48d4-b28e-27b5de037051 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:10.802658 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-506a0429-3bf5-48d4-b28e-27b5de037051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:10.811959 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 949/1888] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:32:10.816265 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a0429-3bf5-48d4-b28e-27b5de037051 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:10.828318 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291849b0-624c-49d0-bdd1-a34428032959 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:10.836198 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a0429-3bf5-48d4-b28e-27b5de037051 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:10.841872 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570146b-9bd4-4447-8d8f-f14b0230fcd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:10.843805 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570146b-9bd4-4447-8d8f-f14b0230fcd1 service neutron] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:10.844951 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570146b-9bd4-4447-8d8f-f14b0230fcd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:10.845237 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570146b-9bd4-4447-8d8f-f14b0230fcd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:10.854936 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe54d7-bedc-498a-a410-b1d26f2432a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:10.855744 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe54d7-bedc-498a-a410-b1d26f2432a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:10.856626 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe54d7-bedc-498a-a410-b1d26f2432a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:10.856626 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe54d7-bedc-498a-a410-b1d26f2432a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:10.858197 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe54d7-bedc-498a-a410-b1d26f2432a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:32:10.858669 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe54d7-bedc-498a-a410-b1d26f2432a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:10.859221 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570146b-9bd4-4447-8d8f-f14b0230fcd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:10.860673 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe54d7-bedc-498a-a410-b1d26f2432a7 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:10.861118 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570146b-9bd4-4447-8d8f-f14b0230fcd1 service neutron] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:10.872457 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 940/1889] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:32:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:32:10.873462 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570146b-9bd4-4447-8d8f-f14b0230fcd1 service neutron] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:10.874989 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-e570146b-9bd4-4447-8d8f-f14b0230fcd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:10.880516 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 950/1890] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:32:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:32:10.881440 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe54d7-bedc-498a-a410-b1d26f2432a7 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:10.898643 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe54d7-bedc-498a-a410-b1d26f2432a7 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:10.906396 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164eb82-17a4-484c-8a8e-01a3a20e1a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:10.907581 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164eb82-17a4-484c-8a8e-01a3a20e1a05 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:10.908075 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164eb82-17a4-484c-8a8e-01a3a20e1a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:10.908428 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164eb82-17a4-484c-8a8e-01a3a20e1a05 admin admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:10.909140 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f164eb82-17a4-484c-8a8e-01a3a20e1a05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:10.911130 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f164eb82-17a4-484c-8a8e-01a3a20e1a05 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:10.957790 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 951/1891] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:32:10 2022] POST /identity/v3/projects => generated 361 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:32:10.959480 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164eb82-17a4-484c-8a8e-01a3a20e1a05 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:11.053406 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570146b-9bd4-4447-8d8f-f14b0230fcd1 service neutron] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:11.081089 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164eb82-17a4-484c-8a8e-01a3a20e1a05 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:11.095001 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd017b-ae2c-4b67-a10a-cfabe46db4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:11.095691 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd017b-ae2c-4b67-a10a-cfabe46db4c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:11.095967 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd017b-ae2c-4b67-a10a-cfabe46db4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:11.096233 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd017b-ae2c-4b67-a10a-cfabe46db4c0 admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:11.096925 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd017b-ae2c-4b67-a10a-cfabe46db4c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:11.099441 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd017b-ae2c-4b67-a10a-cfabe46db4c0 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:11.145208 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 952/1892] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:32:10 2022] POST /identity/v3/users => generated 281 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:32:11.146015 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd017b-ae2c-4b67-a10a-cfabe46db4c0 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:11.160745 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd017b-ae2c-4b67-a10a-cfabe46db4c0 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:11.168408 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea43cc-aea3-47b4-b3df-abdb6fc8c035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:11.169470 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea43cc-aea3-47b4-b3df-abdb6fc8c035 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:11.169782 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea43cc-aea3-47b4-b3df-abdb6fc8c035 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:11.171904 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea43cc-aea3-47b4-b3df-abdb6fc8c035 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:11.174963 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ea43cc-aea3-47b4-b3df-abdb6fc8c035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:11.182812 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ea43cc-aea3-47b4-b3df-abdb6fc8c035 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:11.193404 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe33d6-d4a0-496c-b332-fb08b7625139 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec202a34db8e47f4a6c18285245e3f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:11.194073 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe33d6-d4a0-496c-b332-fb08b7625139 service nova] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:11.194355 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe33d6-d4a0-496c-b332-fb08b7625139 service nova] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:11.194651 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe33d6-d4a0-496c-b332-fb08b7625139 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:11.197603 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-62fe33d6-d4a0-496c-b332-fb08b7625139 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:11.207052 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 953/1893] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:32:11.213164 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea43cc-aea3-47b4-b3df-abdb6fc8c035 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:11.230745 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea43cc-aea3-47b4-b3df-abdb6fc8c035 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:11.235535 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fe33d6-d4a0-496c-b332-fb08b7625139 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:11.237776 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fe33d6-d4a0-496c-b332-fb08b7625139 service nova] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:11.261604 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfbdb6c-a97c-4cee-acac-1b8999262110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:11.263090 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfbdb6c-a97c-4cee-acac-1b8999262110 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:11.263379 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfbdb6c-a97c-4cee-acac-1b8999262110 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:11.263767 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfbdb6c-a97c-4cee-acac-1b8999262110 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:11.265906 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfbdb6c-a97c-4cee-acac-1b8999262110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:11.269000 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfbdb6c-a97c-4cee-acac-1b8999262110 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:11.279489 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 941/1894] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:32:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:32:11.297612 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 954/1895] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:32:11.298410 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe33d6-d4a0-496c-b332-fb08b7625139 service nova] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:11.314247 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe33d6-d4a0-496c-b332-fb08b7625139 service nova] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:11.328694 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b60f0c-56c0-41b9-b69f-bad2fdc70d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:11.330002 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b60f0c-56c0-41b9-b69f-bad2fdc70d65 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:11.330498 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b60f0c-56c0-41b9-b69f-bad2fdc70d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:11.330972 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b60f0c-56c0-41b9-b69f-bad2fdc70d65 admin admin] PATH_INFO: `/v3/projects/64adcb6b752246788f660564132691ea/users/bca3edb471084a4cb45bd604c689a707/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:11.351099 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfbdb6c-a97c-4cee-acac-1b8999262110 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:11.353028 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-acfbdb6c-a97c-4cee-acac-1b8999262110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:11.369325 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b60f0c-56c0-41b9-b69f-bad2fdc70d65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64adcb6b752246788f660564132691ea, user_id=bca3edb471084a4cb45bd604c689a707, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:11.372366 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b60f0c-56c0-41b9-b69f-bad2fdc70d65 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:11.374945 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfbdb6c-a97c-4cee-acac-1b8999262110 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:11.389309 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae5b59-4536-46dd-9755-1614c488bf09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:11.390186 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae5b59-4536-46dd-9755-1614c488bf09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:11.390461 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae5b59-4536-46dd-9755-1614c488bf09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:11.390770 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae5b59-4536-46dd-9755-1614c488bf09 admin admin] PATH_INFO: `/v3/projects/98e184621c824c0783bcc18a3b53af89` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:11.390939 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 942/1896] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:32:11 2022] PUT /identity/v3/projects/64adcb6b752246788f660564132691ea/users/bca3edb471084a4cb45bd604c689a707/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:32:11.392472 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae5b59-4536-46dd-9755-1614c488bf09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98e184621c824c0783bcc18a3b53af89)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:11.395587 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae5b59-4536-46dd-9755-1614c488bf09 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:11.403990 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245e9d2-2ad1-4327-b3a9-3c87f143a600 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:11.403990 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245e9d2-2ad1-4327-b3a9-3c87f143a600 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:11.403990 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245e9d2-2ad1-4327-b3a9-3c87f143a600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:11.442613 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-b245e9d2-2ad1-4327-b3a9-3c87f143a600 None None] MFA Rules not processed for user `bca3edb471084a4cb45bd604c689a707`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:11.444066 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-b245e9d2-2ad1-4327-b3a9-3c87f143a600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:11.483865 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-3bae5b59-4536-46dd-9755-1614c488bf09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98e184621c824c0783bcc18a3b53af89', 'request_id': 'req-3bae5b59-4536-46dd-9755-1614c488bf09'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:11.512669 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-3bae5b59-4536-46dd-9755-1614c488bf09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98e184621c824c0783bcc18a3b53af89', 'request_id': 'req-3bae5b59-4536-46dd-9755-1614c488bf09'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:11.522353 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-3bae5b59-4536-46dd-9755-1614c488bf09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98e184621c824c0783bcc18a3b53af89', 'request_id': 'req-3bae5b59-4536-46dd-9755-1614c488bf09'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:11.534256 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 943/1897] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:11 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:11.548394 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-3bae5b59-4536-46dd-9755-1614c488bf09 admin admin] The token cache is being invalidate because project 98e184621c824c0783bcc18a3b53af89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:32:11.548690 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-3bae5b59-4536-46dd-9755-1614c488bf09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:11.553039 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-3bae5b59-4536-46dd-9755-1614c488bf09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:11.557880 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 955/1898] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:32:11 2022] DELETE /identity/v3/projects/98e184621c824c0783bcc18a3b53af89 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:32:11.559376 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245e9d2-2ad1-4327-b3a9-3c87f143a600 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:11.574467 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae5b59-4536-46dd-9755-1614c488bf09 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:11.576122 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-3bae5b59-4536-46dd-9755-1614c488bf09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:11.649181 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245e9d2-2ad1-4327-b3a9-3c87f143a600 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:11.659923 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae5b59-4536-46dd-9755-1614c488bf09 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:11.674657 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab473f2-fbe3-427b-bc9f-0d8d3249431a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:11.675575 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab473f2-fbe3-427b-bc9f-0d8d3249431a service cinder] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:11.675859 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab473f2-fbe3-427b-bc9f-0d8d3249431a service cinder] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:11.676276 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab473f2-fbe3-427b-bc9f-0d8d3249431a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:11.678690 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-bab473f2-fbe3-427b-bc9f-0d8d3249431a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:11.733599 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ca533-6973-4314-94d9-75f81d53bb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:11.735557 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ca533-6973-4314-94d9-75f81d53bb84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:11.735859 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ca533-6973-4314-94d9-75f81d53bb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:11.736138 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ca533-6973-4314-94d9-75f81d53bb84 admin admin] PATH_INFO: `/v3/users/a643c517130e48cd9cd213e5217f0e7b` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:11.737410 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797ca533-6973-4314-94d9-75f81d53bb84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a643c517130e48cd9cd213e5217f0e7b)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:11.739519 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797ca533-6973-4314-94d9-75f81d53bb84 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:11.752906 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab473f2-fbe3-427b-bc9f-0d8d3249431a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:11.754482 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab473f2-fbe3-427b-bc9f-0d8d3249431a service cinder] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:11.765925 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 956/1899] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:32:11 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:32:11.781655 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab473f2-fbe3-427b-bc9f-0d8d3249431a service cinder] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:11.783102 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-bab473f2-fbe3-427b-bc9f-0d8d3249431a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:11.790630 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-797ca533-6973-4314-94d9-75f81d53bb84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a643c517130e48cd9cd213e5217f0e7b'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:11.791751 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-797ca533-6973-4314-94d9-75f81d53bb84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a643c517130e48cd9cd213e5217f0e7b'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:11.799292 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab473f2-fbe3-427b-bc9f-0d8d3249431a service cinder] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:11.803959 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be84b22-a5ab-424e-8669-00ad2e4aabb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:11.805071 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be84b22-a5ab-424e-8669-00ad2e4aabb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:11.805071 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be84b22-a5ab-424e-8669-00ad2e4aabb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:11.805351 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be84b22-a5ab-424e-8669-00ad2e4aabb8 admin admin] PATH_INFO: `/v3/users/bca3edb471084a4cb45bd604c689a707` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:11.806537 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be84b22-a5ab-424e-8669-00ad2e4aabb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bca3edb471084a4cb45bd604c689a707)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:11.808734 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be84b22-a5ab-424e-8669-00ad2e4aabb8 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:11.809040 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-797ca533-6973-4314-94d9-75f81d53bb84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a643c517130e48cd9cd213e5217f0e7b'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:11.816122 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-797ca533-6973-4314-94d9-75f81d53bb84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a643c517130e48cd9cd213e5217f0e7b'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:11.823794 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-797ca533-6973-4314-94d9-75f81d53bb84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a643c517130e48cd9cd213e5217f0e7b'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:11.829810 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 944/1900] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:32:11 2022] DELETE /identity/v3/users/a643c517130e48cd9cd213e5217f0e7b => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:32:11.862796 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-4be84b22-a5ab-424e-8669-00ad2e4aabb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bca3edb471084a4cb45bd604c689a707'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:11.873043 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-4be84b22-a5ab-424e-8669-00ad2e4aabb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bca3edb471084a4cb45bd604c689a707'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:11.873699 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-4be84b22-a5ab-424e-8669-00ad2e4aabb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bca3edb471084a4cb45bd604c689a707'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:11.890751 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-4be84b22-a5ab-424e-8669-00ad2e4aabb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bca3edb471084a4cb45bd604c689a707'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:11.906314 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-4be84b22-a5ab-424e-8669-00ad2e4aabb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bca3edb471084a4cb45bd604c689a707'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:11.920559 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 957/1901] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:32:11 2022] DELETE /identity/v3/users/bca3edb471084a4cb45bd604c689a707 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:32:11.923928 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b0f4a-2ff7-4482-adcd-c62b829b75e2 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:11.924290 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b0f4a-2ff7-4482-adcd-c62b829b75e2 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:11.926012 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b0f4a-2ff7-4482-adcd-c62b829b75e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:11.949675 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-b95b0f4a-2ff7-4482-adcd-c62b829b75e2 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:11.952629 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-b95b0f4a-2ff7-4482-adcd-c62b829b75e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:12.040544 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 945/1902] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:32:12.053956 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be84b22-a5ab-424e-8669-00ad2e4aabb8 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:12.056198 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-4be84b22-a5ab-424e-8669-00ad2e4aabb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:12.134670 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be84b22-a5ab-424e-8669-00ad2e4aabb8 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:12.139513 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7198e57-310e-42f3-9c38-40c0e85028ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:12.140488 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7198e57-310e-42f3-9c38-40c0e85028ab service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:12.140841 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7198e57-310e-42f3-9c38-40c0e85028ab service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:12.142007 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7198e57-310e-42f3-9c38-40c0e85028ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:12.155634 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7198e57-310e-42f3-9c38-40c0e85028ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:12.157264 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7198e57-310e-42f3-9c38-40c0e85028ab service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:12.177030 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 958/1903] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:32:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:32:12.177928 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b0f4a-2ff7-4482-adcd-c62b829b75e2 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:12.179381 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-b95b0f4a-2ff7-4482-adcd-c62b829b75e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:12.200746 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b0f4a-2ff7-4482-adcd-c62b829b75e2 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:12.205998 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7e0c3-c6c9-4189-9042-11785ec805e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:12.209215 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7e0c3-c6c9-4189-9042-11785ec805e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:12.209502 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7e0c3-c6c9-4189-9042-11785ec805e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:12.209804 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7e0c3-c6c9-4189-9042-11785ec805e4 admin admin] PATH_INFO: `/v3/projects/cc96de37a5214a94971ff0ce3d1087ca` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:12.212073 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7e0c3-c6c9-4189-9042-11785ec805e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc96de37a5214a94971ff0ce3d1087ca)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:12.215082 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7e0c3-c6c9-4189-9042-11785ec805e4 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:12.267405 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-95c7e0c3-c6c9-4189-9042-11785ec805e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc96de37a5214a94971ff0ce3d1087ca', 'request_id': 'req-95c7e0c3-c6c9-4189-9042-11785ec805e4'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:12.273000 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-95c7e0c3-c6c9-4189-9042-11785ec805e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc96de37a5214a94971ff0ce3d1087ca', 'request_id': 'req-95c7e0c3-c6c9-4189-9042-11785ec805e4'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:12.279543 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-95c7e0c3-c6c9-4189-9042-11785ec805e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc96de37a5214a94971ff0ce3d1087ca', 'request_id': 'req-95c7e0c3-c6c9-4189-9042-11785ec805e4'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:12.292854 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-95c7e0c3-c6c9-4189-9042-11785ec805e4 admin admin] The token cache is being invalidate because project cc96de37a5214a94971ff0ce3d1087ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:32:12.293635 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-95c7e0c3-c6c9-4189-9042-11785ec805e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:12.293764 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-95c7e0c3-c6c9-4189-9042-11785ec805e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:12.295383 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 946/1904] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:32:12 2022] DELETE /identity/v3/projects/cc96de37a5214a94971ff0ce3d1087ca => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:32:12.303237 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e70e49-d7e0-4e8f-8780-0a4753241064 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:12.303589 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e70e49-d7e0-4e8f-8780-0a4753241064 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:12.303874 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e70e49-d7e0-4e8f-8780-0a4753241064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:12.326490 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-e8e70e49-d7e0-4e8f-8780-0a4753241064 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:12.327922 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-e8e70e49-d7e0-4e8f-8780-0a4753241064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:12.389574 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 959/1905] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:12.397255 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7f9f3-bf66-4adf-884a-d9568908c593 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:12.397544 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7f9f3-bf66-4adf-884a-d9568908c593 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:12.397819 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7f9f3-bf66-4adf-884a-d9568908c593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:12.416627 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-ecf7f9f3-bf66-4adf-884a-d9568908c593 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:12.418487 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-ecf7f9f3-bf66-4adf-884a-d9568908c593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:12.427099 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 947/1906] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:12.431257 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e70e49-d7e0-4e8f-8780-0a4753241064 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:12.440797 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e70e49-d7e0-4e8f-8780-0a4753241064 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:12.445840 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858105dd-d092-4c1e-aaf7-9ea25d4561e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:12.446572 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858105dd-d092-4c1e-aaf7-9ea25d4561e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:12.446963 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858105dd-d092-4c1e-aaf7-9ea25d4561e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:12.447310 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858105dd-d092-4c1e-aaf7-9ea25d4561e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:12.448202 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858105dd-d092-4c1e-aaf7-9ea25d4561e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:32:12.448628 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858105dd-d092-4c1e-aaf7-9ea25d4561e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:12.450287 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858105dd-d092-4c1e-aaf7-9ea25d4561e6 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:12.466771 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 960/1907] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:32:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:32:12.469005 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7f9f3-bf66-4adf-884a-d9568908c593 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:12.481146 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7f9f3-bf66-4adf-884a-d9568908c593 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:12.486186 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317cbfd-49f0-4790-afe7-f451bea006e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:12.487060 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317cbfd-49f0-4790-afe7-f451bea006e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:12.487386 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317cbfd-49f0-4790-afe7-f451bea006e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:12.487763 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317cbfd-49f0-4790-afe7-f451bea006e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:12.488519 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317cbfd-49f0-4790-afe7-f451bea006e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:12.490578 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317cbfd-49f0-4790-afe7-f451bea006e1 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:12.496495 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858105dd-d092-4c1e-aaf7-9ea25d4561e6 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:12.499443 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-858105dd-d092-4c1e-aaf7-9ea25d4561e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:12.517289 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858105dd-d092-4c1e-aaf7-9ea25d4561e6 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:12.520619 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 948/1908] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:32:12 2022] POST /identity/v3/projects => generated 369 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:32:12.524494 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317cbfd-49f0-4790-afe7-f451bea006e1 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:12.575200 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5242e3-20f2-410b-bfed-f9b7914b8435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:12.576081 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5242e3-20f2-410b-bfed-f9b7914b8435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:12.576362 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5242e3-20f2-410b-bfed-f9b7914b8435 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:12.576633 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5242e3-20f2-410b-bfed-f9b7914b8435 admin admin] PATH_INFO: `/v3/projects/64adcb6b752246788f660564132691ea` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:12.577793 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5242e3-20f2-410b-bfed-f9b7914b8435 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64adcb6b752246788f660564132691ea)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:12.579724 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5242e3-20f2-410b-bfed-f9b7914b8435 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:12.584673 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317cbfd-49f0-4790-afe7-f451bea006e1 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:12.590049 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae314c44-8882-46e5-8dac-b5ba2e1eb24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:12.590756 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae314c44-8882-46e5-8dac-b5ba2e1eb24c admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:12.591053 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae314c44-8882-46e5-8dac-b5ba2e1eb24c admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:12.591307 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae314c44-8882-46e5-8dac-b5ba2e1eb24c admin admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:12.591993 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae314c44-8882-46e5-8dac-b5ba2e1eb24c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:12.593876 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae314c44-8882-46e5-8dac-b5ba2e1eb24c admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:12.614094 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 949/1909] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:32:12 2022] POST /identity/v3/users => generated 285 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:32:12.618237 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae314c44-8882-46e5-8dac-b5ba2e1eb24c admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:12.628343 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae314c44-8882-46e5-8dac-b5ba2e1eb24c admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:12.628538 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-7f5242e3-20f2-410b-bfed-f9b7914b8435 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64adcb6b752246788f660564132691ea', 'request_id': 'req-7f5242e3-20f2-410b-bfed-f9b7914b8435'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:12.633626 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-7f5242e3-20f2-410b-bfed-f9b7914b8435 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64adcb6b752246788f660564132691ea', 'request_id': 'req-7f5242e3-20f2-410b-bfed-f9b7914b8435'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:12.640218 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-7f5242e3-20f2-410b-bfed-f9b7914b8435 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64adcb6b752246788f660564132691ea', 'request_id': 'req-7f5242e3-20f2-410b-bfed-f9b7914b8435'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:12.653660 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-7f5242e3-20f2-410b-bfed-f9b7914b8435 admin admin] The token cache is being invalidate because project 64adcb6b752246788f660564132691ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:32:12.653958 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-7f5242e3-20f2-410b-bfed-f9b7914b8435 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:12.654649 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-7f5242e3-20f2-410b-bfed-f9b7914b8435 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:12.656468 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 961/1910] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:32:12 2022] DELETE /identity/v3/projects/64adcb6b752246788f660564132691ea => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:32:12.660844 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078a200-024e-466e-a82c-ca97fd8029d5 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:12.661108 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078a200-024e-466e-a82c-ca97fd8029d5 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:12.661377 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078a200-024e-466e-a82c-ca97fd8029d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:12.679572 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-7078a200-024e-466e-a82c-ca97fd8029d5 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:12.680774 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-7078a200-024e-466e-a82c-ca97fd8029d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:12.686163 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f20764d-06f4-41ec-a331-cae24997ba29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:12.686851 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20764d-06f4-41ec-a331-cae24997ba29 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:12.687134 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20764d-06f4-41ec-a331-cae24997ba29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:12.687408 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20764d-06f4-41ec-a331-cae24997ba29 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:12.688142 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f20764d-06f4-41ec-a331-cae24997ba29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:12.689390 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 962/1911] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:12.689813 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f20764d-06f4-41ec-a331-cae24997ba29 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:12.697748 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a364f1c-7be9-4b18-adeb-9b5b25017cbd None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:12.698075 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a364f1c-7be9-4b18-adeb-9b5b25017cbd None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:12.698728 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a364f1c-7be9-4b18-adeb-9b5b25017cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:12.702769 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 950/1912] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:32:12.703755 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f20764d-06f4-41ec-a331-cae24997ba29 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:12.705402 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-0f20764d-06f4-41ec-a331-cae24997ba29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:12.716285 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-4a364f1c-7be9-4b18-adeb-9b5b25017cbd None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:12.717504 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-4a364f1c-7be9-4b18-adeb-9b5b25017cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:12.718145 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f20764d-06f4-41ec-a331-cae24997ba29 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:12.722815 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d63caf-3c48-480e-962f-fa7c63b63fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:12.723460 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d63caf-3c48-480e-962f-fa7c63b63fac admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:12.723743 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d63caf-3c48-480e-962f-fa7c63b63fac admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:12.724018 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d63caf-3c48-480e-962f-fa7c63b63fac admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:12.724735 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d63caf-3c48-480e-962f-fa7c63b63fac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:12.725884 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 963/1913] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:32:12.726297 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d63caf-3c48-480e-962f-fa7c63b63fac admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:12.734630 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a364f1c-7be9-4b18-adeb-9b5b25017cbd None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:12.737237 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 951/1914] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:32:12.740792 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d63caf-3c48-480e-962f-fa7c63b63fac admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:12.745673 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a364f1c-7be9-4b18-adeb-9b5b25017cbd None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:12.750670 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4d4ff-ba92-466e-b345-7b309929759b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:12.751329 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4d4ff-ba92-466e-b345-7b309929759b admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:12.751449 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d63caf-3c48-480e-962f-fa7c63b63fac admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:12.751648 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4d4ff-ba92-466e-b345-7b309929759b admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:12.752070 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4d4ff-ba92-466e-b345-7b309929759b admin admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:12.752790 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e4d4ff-ba92-466e-b345-7b309929759b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:32:12.753100 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e4d4ff-ba92-466e-b345-7b309929759b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:12.754719 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e4d4ff-ba92-466e-b345-7b309929759b admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:12.756321 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15676c32-66c0-493c-be49-9fa73e59c03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:12.757190 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15676c32-66c0-493c-be49-9fa73e59c03e admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:12.757470 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15676c32-66c0-493c-be49-9fa73e59c03e admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:12.757739 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15676c32-66c0-493c-be49-9fa73e59c03e admin admin] PATH_INFO: `/v3/projects/d73a559788b04d95a406302390266e0b/users/e6036a50ffc3432aa5f87a2d166c538b/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:12.775338 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 964/1915] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:32:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:32:12.775494 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15676c32-66c0-493c-be49-9fa73e59c03e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d73a559788b04d95a406302390266e0b, user_id=e6036a50ffc3432aa5f87a2d166c538b, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:12.778537 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15676c32-66c0-493c-be49-9fa73e59c03e admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:12.779493 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4d4ff-ba92-466e-b345-7b309929759b admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:12.790084 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4d4ff-ba92-466e-b345-7b309929759b admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:12.796335 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 952/1916] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:32:12 2022] PUT /identity/v3/projects/d73a559788b04d95a406302390266e0b/users/e6036a50ffc3432aa5f87a2d166c538b/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:32:12.808218 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72e0bb-0f2d-40ad-bd6f-40ea84295711 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:12.811078 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72e0bb-0f2d-40ad-bd6f-40ea84295711 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:12.811078 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72e0bb-0f2d-40ad-bd6f-40ea84295711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:12.845317 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-6a72e0bb-0f2d-40ad-bd6f-40ea84295711 None None] MFA Rules not processed for user `e6036a50ffc3432aa5f87a2d166c538b`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:12.847097 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-6a72e0bb-0f2d-40ad-bd6f-40ea84295711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:12.857393 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dccce0-a9f0-4208-8a4b-690c7359a047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:12.858061 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dccce0-a9f0-4208-8a4b-690c7359a047 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:12.858448 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dccce0-a9f0-4208-8a4b-690c7359a047 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:12.858758 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dccce0-a9f0-4208-8a4b-690c7359a047 admin admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:12.859531 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dccce0-a9f0-4208-8a4b-690c7359a047 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:12.861390 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dccce0-a9f0-4208-8a4b-690c7359a047 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:12.895736 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 965/1917] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:32:12 2022] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:32:12.900702 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dccce0-a9f0-4208-8a4b-690c7359a047 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:12.925347 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 953/1918] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:12 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:12.929420 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72e0bb-0f2d-40ad-bd6f-40ea84295711 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:12.941581 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72e0bb-0f2d-40ad-bd6f-40ea84295711 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:12.991406 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dccce0-a9f0-4208-8a4b-690c7359a047 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:12.999315 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e25a0-fa7c-4a90-aec2-bf22fd53ba3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:13.000054 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e25a0-fa7c-4a90-aec2-bf22fd53ba3e admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:13.000331 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e25a0-fa7c-4a90-aec2-bf22fd53ba3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:13.000596 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e25a0-fa7c-4a90-aec2-bf22fd53ba3e admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:13.001570 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e25a0-fa7c-4a90-aec2-bf22fd53ba3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:13.003928 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e25a0-fa7c-4a90-aec2-bf22fd53ba3e admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:13.020610 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0691fba3-a14f-405c-a3ee-29653ee20a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:13.021544 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691fba3-a14f-405c-a3ee-29653ee20a23 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:13.021996 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691fba3-a14f-405c-a3ee-29653ee20a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:13.022860 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691fba3-a14f-405c-a3ee-29653ee20a23 admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:13.023008 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0691fba3-a14f-405c-a3ee-29653ee20a23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:13.025039 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0691fba3-a14f-405c-a3ee-29653ee20a23 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:13.043372 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 966/1919] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:32:12 2022] POST /identity/v3/users => generated 288 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:32:13.044910 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e25a0-fa7c-4a90-aec2-bf22fd53ba3e admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:13.056805 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e25a0-fa7c-4a90-aec2-bf22fd53ba3e admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:13.064080 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abee3a3-2af1-4a30-849d-3659a8c6dcfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:13.065229 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abee3a3-2af1-4a30-849d-3659a8c6dcfa admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:13.065597 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abee3a3-2af1-4a30-849d-3659a8c6dcfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:13.065911 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abee3a3-2af1-4a30-849d-3659a8c6dcfa admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:13.067200 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abee3a3-2af1-4a30-849d-3659a8c6dcfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:13.067312 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 954/1920] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:32:12 2022] POST /identity/v3/projects => generated 369 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:32:13.069059 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abee3a3-2af1-4a30-849d-3659a8c6dcfa admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:13.070156 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0691fba3-a14f-405c-a3ee-29653ee20a23 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:13.086546 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 967/1921] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:32:13.087070 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abee3a3-2af1-4a30-849d-3659a8c6dcfa admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:13.110860 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abee3a3-2af1-4a30-849d-3659a8c6dcfa admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:13.173634 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0691fba3-a14f-405c-a3ee-29653ee20a23 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:13.199433 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c7d1f-594f-4003-82e0-b2243ac2878d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:13.200142 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c7d1f-594f-4003-82e0-b2243ac2878d admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:13.200427 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c7d1f-594f-4003-82e0-b2243ac2878d admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:13.200701 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c7d1f-594f-4003-82e0-b2243ac2878d admin admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:13.201547 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861c7d1f-594f-4003-82e0-b2243ac2878d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:13.203522 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861c7d1f-594f-4003-82e0-b2243ac2878d admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:13.249020 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 955/1922] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:32:13 2022] POST /identity/v3/users => generated 291 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:32:13.251015 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c7d1f-594f-4003-82e0-b2243ac2878d admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:13.265084 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c7d1f-594f-4003-82e0-b2243ac2878d admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:13.272694 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df580cd0-f914-4c3e-98d1-d3f0f2cb5323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:13.273637 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df580cd0-f914-4c3e-98d1-d3f0f2cb5323 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:13.274020 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df580cd0-f914-4c3e-98d1-d3f0f2cb5323 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:13.274448 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df580cd0-f914-4c3e-98d1-d3f0f2cb5323 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:13.275735 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df580cd0-f914-4c3e-98d1-d3f0f2cb5323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:13.278069 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df580cd0-f914-4c3e-98d1-d3f0f2cb5323 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:13.281552 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3f6e6-0564-4335-bfd7-5ac34f8c0ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:13.282309 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3f6e6-0564-4335-bfd7-5ac34f8c0ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:13.287858 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3f6e6-0564-4335-bfd7-5ac34f8c0ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:13.288200 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3f6e6-0564-4335-bfd7-5ac34f8c0ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:13.288948 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f3f6e6-0564-4335-bfd7-5ac34f8c0ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:13.290572 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f3f6e6-0564-4335-bfd7-5ac34f8c0ff5 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:13.299786 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 956/1923] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:32:13.300671 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df580cd0-f914-4c3e-98d1-d3f0f2cb5323 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:13.312897 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 968/1924] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:32:13.317959 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3f6e6-0564-4335-bfd7-5ac34f8c0ff5 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:13.319063 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df580cd0-f914-4c3e-98d1-d3f0f2cb5323 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:13.324736 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aae80b-4c87-4fbc-a23b-1cd3e8d88170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:13.325798 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aae80b-4c87-4fbc-a23b-1cd3e8d88170 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:13.326089 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aae80b-4c87-4fbc-a23b-1cd3e8d88170 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:13.326367 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aae80b-4c87-4fbc-a23b-1cd3e8d88170 admin admin] PATH_INFO: `/v3/projects/5e430cf4931a4e448ed41ae91576ec8d/users/d6652bae02ee4ed7a5dc08a912b3fff1/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:13.328046 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3f6e6-0564-4335-bfd7-5ac34f8c0ff5 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:13.333060 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457494e-d627-418c-bf4d-5093d7776dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:13.335125 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457494e-d627-418c-bf4d-5093d7776dd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:13.335783 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457494e-d627-418c-bf4d-5093d7776dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:13.335783 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457494e-d627-418c-bf4d-5093d7776dd9 admin admin] PATH_INFO: `/v3/projects/b80bb92bf7c047509a38185e7928e032/users/1b3066dcfc2848dcbcc62e3bc5146665/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:13.345639 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aae80b-4c87-4fbc-a23b-1cd3e8d88170 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e430cf4931a4e448ed41ae91576ec8d, user_id=d6652bae02ee4ed7a5dc08a912b3fff1, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:13.349180 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aae80b-4c87-4fbc-a23b-1cd3e8d88170 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:13.366879 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f457494e-d627-418c-bf4d-5093d7776dd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b80bb92bf7c047509a38185e7928e032, user_id=1b3066dcfc2848dcbcc62e3bc5146665, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:13.368590 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 957/1925] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:32:13 2022] PUT /identity/v3/projects/5e430cf4931a4e448ed41ae91576ec8d/users/d6652bae02ee4ed7a5dc08a912b3fff1/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:32:13.373066 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aae80b-4c87-4fbc-a23b-1cd3e8d88170 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:13.373249 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f457494e-d627-418c-bf4d-5093d7776dd9 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:13.406635 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 969/1926] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:32:13 2022] PUT /identity/v3/projects/b80bb92bf7c047509a38185e7928e032/users/1b3066dcfc2848dcbcc62e3bc5146665/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:32:13.414998 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e9a1a-3ac9-4d57-9328-e299080cfc97 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:13.415621 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e9a1a-3ac9-4d57-9328-e299080cfc97 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:13.416208 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e9a1a-3ac9-4d57-9328-e299080cfc97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:13.462953 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aae80b-4c87-4fbc-a23b-1cd3e8d88170 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:13.475442 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-2d8e9a1a-3ac9-4d57-9328-e299080cfc97 None None] MFA Rules not processed for user `1b3066dcfc2848dcbcc62e3bc5146665`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:13.477583 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-2d8e9a1a-3ac9-4d57-9328-e299080cfc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:13.534567 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be1d7d-d302-43c6-9d11-98a9aff27223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:13.535293 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be1d7d-d302-43c6-9d11-98a9aff27223 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:13.535577 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be1d7d-d302-43c6-9d11-98a9aff27223 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:13.535854 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be1d7d-d302-43c6-9d11-98a9aff27223 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:13.536664 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be1d7d-d302-43c6-9d11-98a9aff27223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:13.538204 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be1d7d-d302-43c6-9d11-98a9aff27223 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:13.551302 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 970/1927] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:13.551474 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 958/1928] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:32:13.554752 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e9a1a-3ac9-4d57-9328-e299080cfc97 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:13.559494 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be1d7d-d302-43c6-9d11-98a9aff27223 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:13.561427 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-61be1d7d-d302-43c6-9d11-98a9aff27223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:13.566030 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e9a1a-3ac9-4d57-9328-e299080cfc97 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:13.572759 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c6589b-24be-45d9-b463-fbcb9226be49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:13.574486 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6589b-24be-45d9-b463-fbcb9226be49 admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:13.574795 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6589b-24be-45d9-b463-fbcb9226be49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:13.575071 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6589b-24be-45d9-b463-fbcb9226be49 admin admin] PATH_INFO: `/v3/projects/5e430cf4931a4e448ed41ae91576ec8d/users/d6652bae02ee4ed7a5dc08a912b3fff1/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:13.577201 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c6589b-24be-45d9-b463-fbcb9226be49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e430cf4931a4e448ed41ae91576ec8d, user_id=d6652bae02ee4ed7a5dc08a912b3fff1, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:13.579883 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c6589b-24be-45d9-b463-fbcb9226be49 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:13.591461 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 971/1929] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:32:13 2022] PUT /identity/v3/projects/5e430cf4931a4e448ed41ae91576ec8d/users/d6652bae02ee4ed7a5dc08a912b3fff1/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:32:13.601451 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e366c-7bb1-4c2f-9672-0b9259caa29f None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:13.601722 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e366c-7bb1-4c2f-9672-0b9259caa29f None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:13.601992 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e366c-7bb1-4c2f-9672-0b9259caa29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:13.635795 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be1d7d-d302-43c6-9d11-98a9aff27223 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:13.636924 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-624e366c-7bb1-4c2f-9672-0b9259caa29f None None] MFA Rules not processed for user `d6652bae02ee4ed7a5dc08a912b3fff1`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:13.638685 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-624e366c-7bb1-4c2f-9672-0b9259caa29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:13.693530 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01976595-e616-4028-9164-aa99e24c8cea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:13.694392 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01976595-e616-4028-9164-aa99e24c8cea service cinder] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:13.694772 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01976595-e616-4028-9164-aa99e24c8cea service cinder] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:13.695047 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01976595-e616-4028-9164-aa99e24c8cea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:13.713944 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 972/1930] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:13 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:32:13.760315 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01976595-e616-4028-9164-aa99e24c8cea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:13.762378 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01976595-e616-4028-9164-aa99e24c8cea service cinder] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:13.763464 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e366c-7bb1-4c2f-9672-0b9259caa29f None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:13.765046 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-624e366c-7bb1-4c2f-9672-0b9259caa29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:13.771479 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 959/1931] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:32:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:32:13.779341 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e366c-7bb1-4c2f-9672-0b9259caa29f None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:13.783709 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca940de-59ea-431b-ae65-11b46e094520 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:13.784341 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca940de-59ea-431b-ae65-11b46e094520 service cinder] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:13.784624 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca940de-59ea-431b-ae65-11b46e094520 service cinder] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:13.784899 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca940de-59ea-431b-ae65-11b46e094520 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:13.795915 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca940de-59ea-431b-ae65-11b46e094520 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:13.797329 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca940de-59ea-431b-ae65-11b46e094520 service cinder] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:13.807076 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 973/1932] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:32:13 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:32:13.960123 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01976595-e616-4028-9164-aa99e24c8cea service cinder] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:13.971279 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01976595-e616-4028-9164-aa99e24c8cea service cinder] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:13.975696 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed2475-96c6-446f-8476-3fb0b4c53a73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:13.976335 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed2475-96c6-446f-8476-3fb0b4c53a73 service cinder] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:13.976616 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed2475-96c6-446f-8476-3fb0b4c53a73 service cinder] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:13.976889 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed2475-96c6-446f-8476-3fb0b4c53a73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:14.050455 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfed2475-96c6-446f-8476-3fb0b4c53a73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:14.051990 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfed2475-96c6-446f-8476-3fb0b4c53a73 service cinder] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:14.062400 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 960/1933] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:32:13 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:32:17.502450 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca940de-59ea-431b-ae65-11b46e094520 service cinder] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:17.570678 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca940de-59ea-431b-ae65-11b46e094520 service cinder] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:17.575216 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57ef91-636a-460e-be6c-95bef4a7573c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:17.576226 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57ef91-636a-460e-be6c-95bef4a7573c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:17.576350 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57ef91-636a-460e-be6c-95bef4a7573c admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:17.576628 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57ef91-636a-460e-be6c-95bef4a7573c admin admin] PATH_INFO: `/v3/users/e6036a50ffc3432aa5f87a2d166c538b` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:17.577814 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a57ef91-636a-460e-be6c-95bef4a7573c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6036a50ffc3432aa5f87a2d166c538b)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:17.579740 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a57ef91-636a-460e-be6c-95bef4a7573c admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:17.633443 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-3a57ef91-636a-460e-be6c-95bef4a7573c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6036a50ffc3432aa5f87a2d166c538b'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:17.641310 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-3a57ef91-636a-460e-be6c-95bef4a7573c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6036a50ffc3432aa5f87a2d166c538b'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:17.641936 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-3a57ef91-636a-460e-be6c-95bef4a7573c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6036a50ffc3432aa5f87a2d166c538b'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:17.655334 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-3a57ef91-636a-460e-be6c-95bef4a7573c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6036a50ffc3432aa5f87a2d166c538b'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:17.662338 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-3a57ef91-636a-460e-be6c-95bef4a7573c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6036a50ffc3432aa5f87a2d166c538b'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:17.669704 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 974/1934] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:32:17 2022] DELETE /identity/v3/users/e6036a50ffc3432aa5f87a2d166c538b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:32:17.674274 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edda00c-7dd7-4ab7-b157-423783376be4 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:17.674830 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edda00c-7dd7-4ab7-b157-423783376be4 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:17.674924 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edda00c-7dd7-4ab7-b157-423783376be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:17.694492 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-7edda00c-7dd7-4ab7-b157-423783376be4 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:17.695915 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-7edda00c-7dd7-4ab7-b157-423783376be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:17.772604 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 961/1935] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:32:17.784179 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57ef91-636a-460e-be6c-95bef4a7573c admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:17.785595 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-3a57ef91-636a-460e-be6c-95bef4a7573c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:17.841321 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57ef91-636a-460e-be6c-95bef4a7573c admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:17.846784 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ce32c-bf68-473d-9ecf-00b394cf474d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:17.847438 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ce32c-bf68-473d-9ecf-00b394cf474d service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:17.850193 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ce32c-bf68-473d-9ecf-00b394cf474d service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:17.850193 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ce32c-bf68-473d-9ecf-00b394cf474d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:17.860832 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966ce32c-bf68-473d-9ecf-00b394cf474d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:17.862327 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966ce32c-bf68-473d-9ecf-00b394cf474d service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:17.872302 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 975/1936] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:32:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:32:18.233668 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edda00c-7dd7-4ab7-b157-423783376be4 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:18.235719 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-7edda00c-7dd7-4ab7-b157-423783376be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:18.249623 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edda00c-7dd7-4ab7-b157-423783376be4 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:18.255217 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02676122-9ceb-4a4b-9993-6050cbab0046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:18.256073 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02676122-9ceb-4a4b-9993-6050cbab0046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:18.256444 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02676122-9ceb-4a4b-9993-6050cbab0046 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:18.256767 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02676122-9ceb-4a4b-9993-6050cbab0046 admin admin] PATH_INFO: `/v3/projects/d73a559788b04d95a406302390266e0b` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:18.258059 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02676122-9ceb-4a4b-9993-6050cbab0046 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d73a559788b04d95a406302390266e0b)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:18.261483 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02676122-9ceb-4a4b-9993-6050cbab0046 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:18.305433 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-02676122-9ceb-4a4b-9993-6050cbab0046 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd73a559788b04d95a406302390266e0b', 'request_id': 'req-02676122-9ceb-4a4b-9993-6050cbab0046'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:18.311558 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-02676122-9ceb-4a4b-9993-6050cbab0046 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd73a559788b04d95a406302390266e0b', 'request_id': 'req-02676122-9ceb-4a4b-9993-6050cbab0046'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:18.317819 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-02676122-9ceb-4a4b-9993-6050cbab0046 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd73a559788b04d95a406302390266e0b', 'request_id': 'req-02676122-9ceb-4a4b-9993-6050cbab0046'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:18.331295 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-02676122-9ceb-4a4b-9993-6050cbab0046 admin admin] The token cache is being invalidate because project d73a559788b04d95a406302390266e0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:32:18.331563 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-02676122-9ceb-4a4b-9993-6050cbab0046 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:18.332173 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-02676122-9ceb-4a4b-9993-6050cbab0046 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:18.333683 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 962/1937] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:32:18 2022] DELETE /identity/v3/projects/d73a559788b04d95a406302390266e0b => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:32:18.338052 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ce32c-bf68-473d-9ecf-00b394cf474d service neutron] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:18.347563 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ce32c-bf68-473d-9ecf-00b394cf474d service neutron] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:18.403461 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25898e67-2758-4b6f-8c11-456384145ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:18.404329 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25898e67-2758-4b6f-8c11-456384145ce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:18.404610 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25898e67-2758-4b6f-8c11-456384145ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:18.404885 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25898e67-2758-4b6f-8c11-456384145ce3 admin admin] PATH_INFO: `/v3/users/d6652bae02ee4ed7a5dc08a912b3fff1` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:18.406081 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25898e67-2758-4b6f-8c11-456384145ce3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6652bae02ee4ed7a5dc08a912b3fff1)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:18.408015 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25898e67-2758-4b6f-8c11-456384145ce3 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:18.454106 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-25898e67-2758-4b6f-8c11-456384145ce3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6652bae02ee4ed7a5dc08a912b3fff1'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:18.464569 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-25898e67-2758-4b6f-8c11-456384145ce3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6652bae02ee4ed7a5dc08a912b3fff1'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:18.465306 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-25898e67-2758-4b6f-8c11-456384145ce3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6652bae02ee4ed7a5dc08a912b3fff1'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:18.478719 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-25898e67-2758-4b6f-8c11-456384145ce3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6652bae02ee4ed7a5dc08a912b3fff1'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:18.485566 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-25898e67-2758-4b6f-8c11-456384145ce3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6652bae02ee4ed7a5dc08a912b3fff1'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:18.491848 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 976/1938] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:32:18 2022] DELETE /identity/v3/users/d6652bae02ee4ed7a5dc08a912b3fff1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:32:19.016542 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02676122-9ceb-4a4b-9993-6050cbab0046 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:19.018045 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-02676122-9ceb-4a4b-9993-6050cbab0046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:19.031981 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02676122-9ceb-4a4b-9993-6050cbab0046 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:19.090180 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109df53-5174-4a58-857c-8136a2993279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:19.090984 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109df53-5174-4a58-857c-8136a2993279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:19.091256 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109df53-5174-4a58-857c-8136a2993279 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:19.091524 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109df53-5174-4a58-857c-8136a2993279 admin admin] PATH_INFO: `/v3/projects/5e430cf4931a4e448ed41ae91576ec8d` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:19.092684 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109df53-5174-4a58-857c-8136a2993279 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e430cf4931a4e448ed41ae91576ec8d)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:19.094591 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109df53-5174-4a58-857c-8136a2993279 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:19.144548 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-8109df53-5174-4a58-857c-8136a2993279 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e430cf4931a4e448ed41ae91576ec8d', 'request_id': 'req-8109df53-5174-4a58-857c-8136a2993279'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:19.150025 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-8109df53-5174-4a58-857c-8136a2993279 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e430cf4931a4e448ed41ae91576ec8d', 'request_id': 'req-8109df53-5174-4a58-857c-8136a2993279'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:19.156685 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-8109df53-5174-4a58-857c-8136a2993279 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e430cf4931a4e448ed41ae91576ec8d', 'request_id': 'req-8109df53-5174-4a58-857c-8136a2993279'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:19.170892 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-8109df53-5174-4a58-857c-8136a2993279 admin admin] The token cache is being invalidate because project 5e430cf4931a4e448ed41ae91576ec8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:32:19.171182 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-8109df53-5174-4a58-857c-8136a2993279 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:19.171820 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-8109df53-5174-4a58-857c-8136a2993279 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:19.173343 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 963/1939] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:32:19 2022] DELETE /identity/v3/projects/5e430cf4931a4e448ed41ae91576ec8d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:32:19.178375 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b95f516-af43-4663-b6f3-32d84941e9f2 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:19.178896 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b95f516-af43-4663-b6f3-32d84941e9f2 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:19.179126 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b95f516-af43-4663-b6f3-32d84941e9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:19.196727 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-0b95f516-af43-4663-b6f3-32d84941e9f2 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:19.198116 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-0b95f516-af43-4663-b6f3-32d84941e9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:19.264158 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 977/1940] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:32:19.272246 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fceaa0-3482-4651-b205-8334efd8294b None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:19.272534 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fceaa0-3482-4651-b205-8334efd8294b None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:19.272808 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fceaa0-3482-4651-b205-8334efd8294b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:19.290960 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-20fceaa0-3482-4651-b205-8334efd8294b None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:19.292921 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-20fceaa0-3482-4651-b205-8334efd8294b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:19.301070 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 964/1941] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:19.305451 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b95f516-af43-4663-b6f3-32d84941e9f2 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:19.315758 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b95f516-af43-4663-b6f3-32d84941e9f2 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:19.320567 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645623a-43f9-49f0-aa30-b9411ac8df7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:19.321218 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645623a-43f9-49f0-aa30-b9411ac8df7e admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:19.321497 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645623a-43f9-49f0-aa30-b9411ac8df7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:19.321769 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645623a-43f9-49f0-aa30-b9411ac8df7e admin admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:19.322481 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f645623a-43f9-49f0-aa30-b9411ac8df7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:32:19.322810 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f645623a-43f9-49f0-aa30-b9411ac8df7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:19.324731 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f645623a-43f9-49f0-aa30-b9411ac8df7e admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:19.336415 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 978/1942] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:32:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:32:19.341760 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fceaa0-3482-4651-b205-8334efd8294b None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:19.350544 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fceaa0-3482-4651-b205-8334efd8294b None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:19.356008 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230ec89-0283-4797-97d0-6b82ea76ec8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:19.356652 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230ec89-0283-4797-97d0-6b82ea76ec8a admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:19.356930 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230ec89-0283-4797-97d0-6b82ea76ec8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:19.357199 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230ec89-0283-4797-97d0-6b82ea76ec8a admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:19.357888 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d230ec89-0283-4797-97d0-6b82ea76ec8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:19.359799 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d230ec89-0283-4797-97d0-6b82ea76ec8a admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:19.385359 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 965/1943] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:32:19 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:32:19.389909 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645623a-43f9-49f0-aa30-b9411ac8df7e admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:19.399798 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645623a-43f9-49f0-aa30-b9411ac8df7e admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:19.455554 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6c5807-43b1-4db8-9b69-09d7eea5e110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:19.456207 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c5807-43b1-4db8-9b69-09d7eea5e110 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:19.456497 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c5807-43b1-4db8-9b69-09d7eea5e110 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:19.456751 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c5807-43b1-4db8-9b69-09d7eea5e110 admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:19.457429 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6c5807-43b1-4db8-9b69-09d7eea5e110 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:19.459608 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6c5807-43b1-4db8-9b69-09d7eea5e110 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:19.479429 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 979/1944] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:32:19 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:32:19.483839 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230ec89-0283-4797-97d0-6b82ea76ec8a admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:19.494098 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230ec89-0283-4797-97d0-6b82ea76ec8a admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:19.499075 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857182b8-5dec-4eb9-80fe-5b15c312c72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:19.499733 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857182b8-5dec-4eb9-80fe-5b15c312c72c admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:19.500012 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857182b8-5dec-4eb9-80fe-5b15c312c72c admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:19.500283 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857182b8-5dec-4eb9-80fe-5b15c312c72c admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:19.500998 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857182b8-5dec-4eb9-80fe-5b15c312c72c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:19.502574 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857182b8-5dec-4eb9-80fe-5b15c312c72c admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:19.513879 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 966/1945] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:32:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:32:19.517856 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6c5807-43b1-4db8-9b69-09d7eea5e110 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:19.528404 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6c5807-43b1-4db8-9b69-09d7eea5e110 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:19.533023 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4135f188-e69d-4086-a62f-0aa23333950b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:19.533679 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135f188-e69d-4086-a62f-0aa23333950b admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:19.533960 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135f188-e69d-4086-a62f-0aa23333950b admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:19.534234 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135f188-e69d-4086-a62f-0aa23333950b admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:19.535014 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4135f188-e69d-4086-a62f-0aa23333950b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:19.536617 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4135f188-e69d-4086-a62f-0aa23333950b admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:19.547024 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 980/1946] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:32:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:32:19.552607 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857182b8-5dec-4eb9-80fe-5b15c312c72c admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:19.563013 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857182b8-5dec-4eb9-80fe-5b15c312c72c admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:19.568729 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a4ce5-d6c5-450b-a623-1f476ab7f0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:19.569618 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a4ce5-d6c5-450b-a623-1f476ab7f0b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:19.569913 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a4ce5-d6c5-450b-a623-1f476ab7f0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:19.570197 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a4ce5-d6c5-450b-a623-1f476ab7f0b3 admin admin] PATH_INFO: `/v3/projects/bbdd1eba83af4919bf37c2c0c65b1ad4/users/06c369a4d8fc41d1a73f4b67f353ed0f/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:19.588311 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a4ce5-d6c5-450b-a623-1f476ab7f0b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbdd1eba83af4919bf37c2c0c65b1ad4, user_id=06c369a4d8fc41d1a73f4b67f353ed0f, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:19.592491 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a4ce5-d6c5-450b-a623-1f476ab7f0b3 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:19.606531 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 967/1947] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:32:19 2022] PUT /identity/v3/projects/bbdd1eba83af4919bf37c2c0c65b1ad4/users/06c369a4d8fc41d1a73f4b67f353ed0f/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:32:19.617112 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075489e-d9aa-4625-ac24-1c64500e2e0e None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:19.617455 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075489e-d9aa-4625-ac24-1c64500e2e0e None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:19.617732 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075489e-d9aa-4625-ac24-1c64500e2e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:19.645693 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-7075489e-d9aa-4625-ac24-1c64500e2e0e None None] MFA Rules not processed for user `06c369a4d8fc41d1a73f4b67f353ed0f`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:19.647052 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-7075489e-d9aa-4625-ac24-1c64500e2e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:19.710167 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 981/1948] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:19.715600 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a4ce5-d6c5-450b-a623-1f476ab7f0b3 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:19.774172 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a4ce5-d6c5-450b-a623-1f476ab7f0b3 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:19.779318 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb304b44-252c-4c6d-9b25-7dc7c80456a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:19.779952 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb304b44-252c-4c6d-9b25-7dc7c80456a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:19.780228 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb304b44-252c-4c6d-9b25-7dc7c80456a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:19.780497 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb304b44-252c-4c6d-9b25-7dc7c80456a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:19.781174 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb304b44-252c-4c6d-9b25-7dc7c80456a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:19.783097 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb304b44-252c-4c6d-9b25-7dc7c80456a5 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:19.807844 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 968/1949] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:32:19 2022] POST /identity/v3/projects => generated 381 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:32:19.812073 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075489e-d9aa-4625-ac24-1c64500e2e0e None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:19.822394 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075489e-d9aa-4625-ac24-1c64500e2e0e None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:19.877667 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be15a60-c211-4b8e-8e7e-2ed06c91c0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:19.878356 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be15a60-c211-4b8e-8e7e-2ed06c91c0f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:19.878653 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be15a60-c211-4b8e-8e7e-2ed06c91c0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:19.878933 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be15a60-c211-4b8e-8e7e-2ed06c91c0f4 admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:19.879631 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be15a60-c211-4b8e-8e7e-2ed06c91c0f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:19.881517 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be15a60-c211-4b8e-8e7e-2ed06c91c0f4 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:19.903001 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 982/1950] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:32:19 2022] POST /identity/v3/users => generated 291 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:32:19.907197 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb304b44-252c-4c6d-9b25-7dc7c80456a5 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:19.918666 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb304b44-252c-4c6d-9b25-7dc7c80456a5 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:19.923369 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5cb14-5c04-4721-8057-2204a708e253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:19.924035 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5cb14-5c04-4721-8057-2204a708e253 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:19.924339 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5cb14-5c04-4721-8057-2204a708e253 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:19.924656 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5cb14-5c04-4721-8057-2204a708e253 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:19.925419 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d5cb14-5c04-4721-8057-2204a708e253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:19.927460 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d5cb14-5c04-4721-8057-2204a708e253 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:19.939447 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 969/1951] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:32:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:32:19.943641 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be15a60-c211-4b8e-8e7e-2ed06c91c0f4 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:19.954105 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be15a60-c211-4b8e-8e7e-2ed06c91c0f4 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:19.958801 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016639c7-2a5a-4c25-9433-9b79559aaba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:19.959695 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016639c7-2a5a-4c25-9433-9b79559aaba4 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:19.959974 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016639c7-2a5a-4c25-9433-9b79559aaba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:19.960254 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016639c7-2a5a-4c25-9433-9b79559aaba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:19.960970 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016639c7-2a5a-4c25-9433-9b79559aaba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:19.962535 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016639c7-2a5a-4c25-9433-9b79559aaba4 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:19.972613 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 983/1952] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:32:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:32:19.976734 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5cb14-5c04-4721-8057-2204a708e253 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:19.986418 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5cb14-5c04-4721-8057-2204a708e253 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:19.991106 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea8b5d8-5ef3-4d30-8804-454d09e74aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:19.991964 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8b5d8-5ef3-4d30-8804-454d09e74aa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:19.992242 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8b5d8-5ef3-4d30-8804-454d09e74aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:19.992511 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8b5d8-5ef3-4d30-8804-454d09e74aa2 admin admin] PATH_INFO: `/v3/projects/e6e4aff8a0ba4fafb51cce08afee14f4/users/a7891c4edab646948acef1a01fbcf8f3/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:20.006961 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea8b5d8-5ef3-4d30-8804-454d09e74aa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6e4aff8a0ba4fafb51cce08afee14f4, user_id=a7891c4edab646948acef1a01fbcf8f3, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:20.009575 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea8b5d8-5ef3-4d30-8804-454d09e74aa2 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:20.023124 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 970/1953] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:32:19 2022] PUT /identity/v3/projects/e6e4aff8a0ba4fafb51cce08afee14f4/users/a7891c4edab646948acef1a01fbcf8f3/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:32:20.033584 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1bb303-c7b4-41ba-9b70-cdda7b9a170b None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:20.033869 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1bb303-c7b4-41ba-9b70-cdda7b9a170b None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:20.034143 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1bb303-c7b4-41ba-9b70-cdda7b9a170b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:20.062480 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-7a1bb303-c7b4-41ba-9b70-cdda7b9a170b None None] MFA Rules not processed for user `a7891c4edab646948acef1a01fbcf8f3`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:20.063713 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-7a1bb303-c7b4-41ba-9b70-cdda7b9a170b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:20.127723 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 984/1954] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:20.132326 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea8b5d8-5ef3-4d30-8804-454d09e74aa2 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:20.194886 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea8b5d8-5ef3-4d30-8804-454d09e74aa2 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:20.200051 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfffee6b-0ff4-4f29-b0d5-a33970adbdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:20.200694 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffee6b-0ff4-4f29-b0d5-a33970adbdf8 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:20.200970 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffee6b-0ff4-4f29-b0d5-a33970adbdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:20.201239 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffee6b-0ff4-4f29-b0d5-a33970adbdf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:20.201940 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffee6b-0ff4-4f29-b0d5-a33970adbdf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:20.203847 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffee6b-0ff4-4f29-b0d5-a33970adbdf8 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:20.229762 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 971/1955] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:32:20 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:32:20.233812 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1bb303-c7b4-41ba-9b70-cdda7b9a170b None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:20.244244 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1bb303-c7b4-41ba-9b70-cdda7b9a170b None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:20.307196 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccbbf36-aba8-4e12-a064-328eacba4d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:20.308099 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbbf36-aba8-4e12-a064-328eacba4d8c admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:20.308425 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbbf36-aba8-4e12-a064-328eacba4d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:20.308822 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbbf36-aba8-4e12-a064-328eacba4d8c admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:20.309627 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccbbf36-aba8-4e12-a064-328eacba4d8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:20.311682 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccbbf36-aba8-4e12-a064-328eacba4d8c admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:20.332786 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 985/1956] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:32:20 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:32:20.336630 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfffee6b-0ff4-4f29-b0d5-a33970adbdf8 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:20.347299 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfffee6b-0ff4-4f29-b0d5-a33970adbdf8 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:20.351930 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479e340-657f-467e-8bc7-ee502151cac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:20.352592 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479e340-657f-467e-8bc7-ee502151cac3 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:20.352871 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479e340-657f-467e-8bc7-ee502151cac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:20.353145 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479e340-657f-467e-8bc7-ee502151cac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:20.353858 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479e340-657f-467e-8bc7-ee502151cac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:20.355535 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479e340-657f-467e-8bc7-ee502151cac3 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:20.365589 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 972/1957] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:32:20.369738 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccbbf36-aba8-4e12-a064-328eacba4d8c admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:20.380019 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccbbf36-aba8-4e12-a064-328eacba4d8c admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:20.384951 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c448d51-c762-497f-ade4-e869f4f5ab8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:20.386486 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c448d51-c762-497f-ade4-e869f4f5ab8c admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:20.386871 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c448d51-c762-497f-ade4-e869f4f5ab8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:20.387214 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c448d51-c762-497f-ade4-e869f4f5ab8c admin admin] PATH_INFO: `/v3/projects/0d9d451d08824ecabb4fef86ac0068cc/users/78650d893a8a46d6ab2851ffdcd13709/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:20.402756 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c448d51-c762-497f-ade4-e869f4f5ab8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d9d451d08824ecabb4fef86ac0068cc, user_id=78650d893a8a46d6ab2851ffdcd13709, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:20.405793 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c448d51-c762-497f-ade4-e869f4f5ab8c admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:20.419326 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 986/1958] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:32:20 2022] PUT /identity/v3/projects/0d9d451d08824ecabb4fef86ac0068cc/users/78650d893a8a46d6ab2851ffdcd13709/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:32:20.423440 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479e340-657f-467e-8bc7-ee502151cac3 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:20.434443 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479e340-657f-467e-8bc7-ee502151cac3 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:20.490296 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e49e2a-10e9-4470-b0be-3707135b2006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:20.491032 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e49e2a-10e9-4470-b0be-3707135b2006 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:20.491316 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e49e2a-10e9-4470-b0be-3707135b2006 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:20.491590 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e49e2a-10e9-4470-b0be-3707135b2006 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:20.492312 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e49e2a-10e9-4470-b0be-3707135b2006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:20.493934 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e49e2a-10e9-4470-b0be-3707135b2006 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:20.504665 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 973/1959] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:32:20.508642 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c448d51-c762-497f-ade4-e869f4f5ab8c admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:20.519807 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c448d51-c762-497f-ade4-e869f4f5ab8c admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:20.524539 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e461be-7694-4f2e-bd98-ce90bedd7c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:20.525288 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e461be-7694-4f2e-bd98-ce90bedd7c7b admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:20.525567 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e461be-7694-4f2e-bd98-ce90bedd7c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:20.525837 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e461be-7694-4f2e-bd98-ce90bedd7c7b admin admin] PATH_INFO: `/v3/projects/0d9d451d08824ecabb4fef86ac0068cc/users/78650d893a8a46d6ab2851ffdcd13709/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:20.528924 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e461be-7694-4f2e-bd98-ce90bedd7c7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d9d451d08824ecabb4fef86ac0068cc, user_id=78650d893a8a46d6ab2851ffdcd13709, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:20.531539 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e461be-7694-4f2e-bd98-ce90bedd7c7b admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:20.542437 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 987/1960] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:32:20 2022] PUT /identity/v3/projects/0d9d451d08824ecabb4fef86ac0068cc/users/78650d893a8a46d6ab2851ffdcd13709/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:32:20.553577 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f216d67-c81d-4c2f-8297-17c4fac2f53b None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:20.553864 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f216d67-c81d-4c2f-8297-17c4fac2f53b None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:20.554137 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f216d67-c81d-4c2f-8297-17c4fac2f53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:20.581130 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-0f216d67-c81d-4c2f-8297-17c4fac2f53b None None] MFA Rules not processed for user `78650d893a8a46d6ab2851ffdcd13709`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:20.582323 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-0f216d67-c81d-4c2f-8297-17c4fac2f53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:20.659609 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 974/1961] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:20.672231 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e461be-7694-4f2e-bd98-ce90bedd7c7b admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:20.674575 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-13e461be-7694-4f2e-bd98-ce90bedd7c7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:20.738027 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e461be-7694-4f2e-bd98-ce90bedd7c7b admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:20.741825 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc063f-1bbf-4de4-8256-dcd573163813 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:20.742466 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc063f-1bbf-4de4-8256-dcd573163813 service cinder] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:20.742781 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc063f-1bbf-4de4-8256-dcd573163813 service cinder] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:20.743050 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc063f-1bbf-4de4-8256-dcd573163813 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:20.811316 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc063f-1bbf-4de4-8256-dcd573163813 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:20.813235 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc063f-1bbf-4de4-8256-dcd573163813 service cinder] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:20.825919 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 988/1962] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:32:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:32:22.346058 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f216d67-c81d-4c2f-8297-17c4fac2f53b None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:22.347495 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-0f216d67-c81d-4c2f-8297-17c4fac2f53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:22.359518 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f216d67-c81d-4c2f-8297-17c4fac2f53b None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:22.363058 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0dd9d0-1026-47ce-b8da-346122112f57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:22.363692 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0dd9d0-1026-47ce-b8da-346122112f57 service cinder] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:22.363974 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0dd9d0-1026-47ce-b8da-346122112f57 service cinder] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:22.364245 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0dd9d0-1026-47ce-b8da-346122112f57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:22.434484 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0dd9d0-1026-47ce-b8da-346122112f57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:22.436298 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0dd9d0-1026-47ce-b8da-346122112f57 service cinder] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:22.445474 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 975/1963] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:32:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:32:22.678396 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc063f-1bbf-4de4-8256-dcd573163813 service cinder] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:22.679893 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-d1fc063f-1bbf-4de4-8256-dcd573163813 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:22.752188 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc063f-1bbf-4de4-8256-dcd573163813 service cinder] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:22.757468 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0813b3-a8c8-4cd9-9c77-da9682695d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:22.758621 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0813b3-a8c8-4cd9-9c77-da9682695d20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:22.759003 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0813b3-a8c8-4cd9-9c77-da9682695d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:22.759366 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0813b3-a8c8-4cd9-9c77-da9682695d20 admin admin] PATH_INFO: `/v3/users/d1fac8468d4e4e5c889d4406f48cead5` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:22.760573 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0813b3-a8c8-4cd9-9c77-da9682695d20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1fac8468d4e4e5c889d4406f48cead5)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:22.763184 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0813b3-a8c8-4cd9-9c77-da9682695d20 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:22.809961 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-9b0813b3-a8c8-4cd9-9c77-da9682695d20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1fac8468d4e4e5c889d4406f48cead5'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:22.818508 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-9b0813b3-a8c8-4cd9-9c77-da9682695d20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1fac8468d4e4e5c889d4406f48cead5'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:22.819158 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-9b0813b3-a8c8-4cd9-9c77-da9682695d20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1fac8468d4e4e5c889d4406f48cead5'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:22.831711 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-9b0813b3-a8c8-4cd9-9c77-da9682695d20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1fac8468d4e4e5c889d4406f48cead5'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:22.838573 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-9b0813b3-a8c8-4cd9-9c77-da9682695d20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1fac8468d4e4e5c889d4406f48cead5'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:22.844582 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 989/1964] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:32:22 2022] DELETE /identity/v3/users/d1fac8468d4e4e5c889d4406f48cead5 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:32:22.849634 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8ee49-d6cd-4e21-9515-299b1620502c None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:22.850120 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8ee49-d6cd-4e21-9515-299b1620502c None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:22.850613 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8ee49-d6cd-4e21-9515-299b1620502c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:22.868482 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-b8d8ee49-d6cd-4e21-9515-299b1620502c None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:22.869817 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-b8d8ee49-d6cd-4e21-9515-299b1620502c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:22.931111 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 976/1965] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:22.941489 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0813b3-a8c8-4cd9-9c77-da9682695d20 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:22.942938 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-9b0813b3-a8c8-4cd9-9c77-da9682695d20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:22.999869 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0813b3-a8c8-4cd9-9c77-da9682695d20 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:23.003710 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a73a2a-a042-482e-9f39-0fba48c442c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:23.004344 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a73a2a-a042-482e-9f39-0fba48c442c6 service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:23.004638 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a73a2a-a042-482e-9f39-0fba48c442c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:23.004893 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a73a2a-a042-482e-9f39-0fba48c442c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:23.015571 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a73a2a-a042-482e-9f39-0fba48c442c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:23.017091 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a73a2a-a042-482e-9f39-0fba48c442c6 service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:23.027683 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 990/1966] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:32:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:32:23.323198 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8ee49-d6cd-4e21-9515-299b1620502c None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:23.325991 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-b8d8ee49-d6cd-4e21-9515-299b1620502c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:23.346559 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8ee49-d6cd-4e21-9515-299b1620502c None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:23.352695 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e538c02-f74c-4a51-a43d-6173621143ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:23.353577 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e538c02-f74c-4a51-a43d-6173621143ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:23.353859 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e538c02-f74c-4a51-a43d-6173621143ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:23.354136 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e538c02-f74c-4a51-a43d-6173621143ab admin admin] PATH_INFO: `/v3/projects/4264412cdc71491880965c1858e005a8` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:23.355995 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e538c02-f74c-4a51-a43d-6173621143ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=4264412cdc71491880965c1858e005a8)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:23.357902 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e538c02-f74c-4a51-a43d-6173621143ab admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:23.402470 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-7e538c02-f74c-4a51-a43d-6173621143ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4264412cdc71491880965c1858e005a8', 'request_id': 'req-7e538c02-f74c-4a51-a43d-6173621143ab'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:23.407647 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-7e538c02-f74c-4a51-a43d-6173621143ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4264412cdc71491880965c1858e005a8', 'request_id': 'req-7e538c02-f74c-4a51-a43d-6173621143ab'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:23.414184 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-7e538c02-f74c-4a51-a43d-6173621143ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4264412cdc71491880965c1858e005a8', 'request_id': 'req-7e538c02-f74c-4a51-a43d-6173621143ab'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:23.426661 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-7e538c02-f74c-4a51-a43d-6173621143ab admin admin] The token cache is being invalidate because project 4264412cdc71491880965c1858e005a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:32:23.426947 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-7e538c02-f74c-4a51-a43d-6173621143ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:23.427567 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-7e538c02-f74c-4a51-a43d-6173621143ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:23.429084 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 977/1967] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:32:23 2022] DELETE /identity/v3/projects/4264412cdc71491880965c1858e005a8 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:32:23.433147 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a73a2a-a042-482e-9f39-0fba48c442c6 service neutron] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:23.443454 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a73a2a-a042-482e-9f39-0fba48c442c6 service neutron] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:23.497042 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a68203-7cc0-4e88-9737-5e032f2d801e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:23.497901 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a68203-7cc0-4e88-9737-5e032f2d801e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:23.498186 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a68203-7cc0-4e88-9737-5e032f2d801e admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:23.498480 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a68203-7cc0-4e88-9737-5e032f2d801e admin admin] PATH_INFO: `/v3/users/6258b2dad8224e49b45ae461c81714d2` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:23.499679 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a68203-7cc0-4e88-9737-5e032f2d801e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6258b2dad8224e49b45ae461c81714d2)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:23.501547 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a68203-7cc0-4e88-9737-5e032f2d801e admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:23.544829 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-95a68203-7cc0-4e88-9737-5e032f2d801e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6258b2dad8224e49b45ae461c81714d2'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:23.551484 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-95a68203-7cc0-4e88-9737-5e032f2d801e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6258b2dad8224e49b45ae461c81714d2'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:23.552095 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-95a68203-7cc0-4e88-9737-5e032f2d801e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6258b2dad8224e49b45ae461c81714d2'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:23.563447 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-95a68203-7cc0-4e88-9737-5e032f2d801e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6258b2dad8224e49b45ae461c81714d2'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:23.570273 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-95a68203-7cc0-4e88-9737-5e032f2d801e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6258b2dad8224e49b45ae461c81714d2'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:23.576028 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 991/1968] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:32:23 2022] DELETE /identity/v3/users/6258b2dad8224e49b45ae461c81714d2 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:32:23.975571 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e538c02-f74c-4a51-a43d-6173621143ab admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:23.977241 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-7e538c02-f74c-4a51-a43d-6173621143ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:23.989763 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e538c02-f74c-4a51-a43d-6173621143ab admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:24.048459 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba2dd0-359e-472a-a731-adb520becfbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:24.049326 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba2dd0-359e-472a-a731-adb520becfbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:24.049619 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba2dd0-359e-472a-a731-adb520becfbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:24.049883 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba2dd0-359e-472a-a731-adb520becfbb admin admin] PATH_INFO: `/v3/projects/7f9e6a54970345e997e1a2c854c66e7d` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:24.051083 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba2dd0-359e-472a-a731-adb520becfbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f9e6a54970345e997e1a2c854c66e7d)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:24.053055 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba2dd0-359e-472a-a731-adb520becfbb admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:24.099036 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-ccba2dd0-359e-472a-a731-adb520becfbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f9e6a54970345e997e1a2c854c66e7d', 'request_id': 'req-ccba2dd0-359e-472a-a731-adb520becfbb'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:24.104621 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-ccba2dd0-359e-472a-a731-adb520becfbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f9e6a54970345e997e1a2c854c66e7d', 'request_id': 'req-ccba2dd0-359e-472a-a731-adb520becfbb'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:24.111679 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-ccba2dd0-359e-472a-a731-adb520becfbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f9e6a54970345e997e1a2c854c66e7d', 'request_id': 'req-ccba2dd0-359e-472a-a731-adb520becfbb'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:24.126987 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-ccba2dd0-359e-472a-a731-adb520becfbb admin admin] The token cache is being invalidate because project 7f9e6a54970345e997e1a2c854c66e7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:32:24.127274 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-ccba2dd0-359e-472a-a731-adb520becfbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:24.127935 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-ccba2dd0-359e-472a-a731-adb520becfbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:24.129814 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 978/1969] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:32:23 2022] DELETE /identity/v3/projects/7f9e6a54970345e997e1a2c854c66e7d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:32:24.135038 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b86dd-cf08-4c19-af43-8183dc4c8767 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:24.135590 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b86dd-cf08-4c19-af43-8183dc4c8767 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:24.135870 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b86dd-cf08-4c19-af43-8183dc4c8767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:24.156786 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-601b86dd-cf08-4c19-af43-8183dc4c8767 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:24.158033 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-601b86dd-cf08-4c19-af43-8183dc4c8767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:24.226936 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 992/1970] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:24.235405 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2641ee4-95fa-41fd-a410-e6dd2a109926 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:24.235692 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2641ee4-95fa-41fd-a410-e6dd2a109926 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:24.235973 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2641ee4-95fa-41fd-a410-e6dd2a109926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:24.255920 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-c2641ee4-95fa-41fd-a410-e6dd2a109926 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:24.257137 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-c2641ee4-95fa-41fd-a410-e6dd2a109926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:24.266744 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 979/1971] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:24.271247 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b86dd-cf08-4c19-af43-8183dc4c8767 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:24.282259 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b86dd-cf08-4c19-af43-8183dc4c8767 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:24.289880 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d0ee3-0c0e-4074-a9c7-ad86e13c867b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:24.290943 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d0ee3-0c0e-4074-a9c7-ad86e13c867b admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:24.291446 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d0ee3-0c0e-4074-a9c7-ad86e13c867b admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:24.291933 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d0ee3-0c0e-4074-a9c7-ad86e13c867b admin admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:24.292811 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d0ee3-0c0e-4074-a9c7-ad86e13c867b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:32:24.293366 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d0ee3-0c0e-4074-a9c7-ad86e13c867b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:24.295507 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d0ee3-0c0e-4074-a9c7-ad86e13c867b admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:24.316601 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 993/1972] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:32:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:32:24.321078 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2641ee4-95fa-41fd-a410-e6dd2a109926 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:24.334027 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2641ee4-95fa-41fd-a410-e6dd2a109926 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:24.340925 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f550c16-2c51-43bc-9fbd-02d14cfa5dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:24.341591 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f550c16-2c51-43bc-9fbd-02d14cfa5dfb admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:24.341882 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f550c16-2c51-43bc-9fbd-02d14cfa5dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:24.342333 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f550c16-2c51-43bc-9fbd-02d14cfa5dfb admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:24.343120 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f550c16-2c51-43bc-9fbd-02d14cfa5dfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:24.345130 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f550c16-2c51-43bc-9fbd-02d14cfa5dfb admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:24.393144 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 980/1973] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:32:24 2022] POST /identity/v3/projects => generated 371 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:32:24.397190 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d0ee3-0c0e-4074-a9c7-ad86e13c867b admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:24.406992 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d0ee3-0c0e-4074-a9c7-ad86e13c867b admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:24.465240 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3c0d0-4637-4eb5-b59e-71a474011dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:24.465990 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3c0d0-4637-4eb5-b59e-71a474011dd1 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:24.466275 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3c0d0-4637-4eb5-b59e-71a474011dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:24.466551 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3c0d0-4637-4eb5-b59e-71a474011dd1 admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:24.467267 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb3c0d0-4637-4eb5-b59e-71a474011dd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:24.469197 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb3c0d0-4637-4eb5-b59e-71a474011dd1 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:24.489690 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 994/1974] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:32:24 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:32:24.494273 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f550c16-2c51-43bc-9fbd-02d14cfa5dfb admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:24.498882 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3c0d0-4637-4eb5-b59e-71a474011dd1 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:24.500527 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-ccb3c0d0-4637-4eb5-b59e-71a474011dd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:24.505376 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f550c16-2c51-43bc-9fbd-02d14cfa5dfb admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:24.510210 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d068fd0e-9101-4e68-b121-7298481ee6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:24.511021 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068fd0e-9101-4e68-b121-7298481ee6ce admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:24.511424 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068fd0e-9101-4e68-b121-7298481ee6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:24.512275 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068fd0e-9101-4e68-b121-7298481ee6ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:24.513060 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d068fd0e-9101-4e68-b121-7298481ee6ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:24.514751 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d068fd0e-9101-4e68-b121-7298481ee6ce admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:24.525147 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 981/1975] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:32:24.529493 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d068fd0e-9101-4e68-b121-7298481ee6ce admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:24.538950 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d068fd0e-9101-4e68-b121-7298481ee6ce admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:24.544478 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8864e-f073-4681-809c-51ff73437b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:24.545114 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8864e-f073-4681-809c-51ff73437b15 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:24.545397 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8864e-f073-4681-809c-51ff73437b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:24.545671 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8864e-f073-4681-809c-51ff73437b15 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:24.546377 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c8864e-f073-4681-809c-51ff73437b15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:24.547992 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c8864e-f073-4681-809c-51ff73437b15 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:24.556497 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3c0d0-4637-4eb5-b59e-71a474011dd1 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:24.557708 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 982/1976] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:32:24.561072 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212329e3-19f0-4a9b-9a60-e343c5dadadf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:24.561711 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212329e3-19f0-4a9b-9a60-e343c5dadadf service cinder] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:24.561928 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8864e-f073-4681-809c-51ff73437b15 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:24.562025 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212329e3-19f0-4a9b-9a60-e343c5dadadf service cinder] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:24.562256 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212329e3-19f0-4a9b-9a60-e343c5dadadf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:24.564054 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-212329e3-19f0-4a9b-9a60-e343c5dadadf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:24.571341 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8864e-f073-4681-809c-51ff73437b15 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:24.575995 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027276a0-d4be-4835-ab6e-39efece71ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:24.576897 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027276a0-d4be-4835-ab6e-39efece71ce8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:24.577228 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027276a0-d4be-4835-ab6e-39efece71ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:24.577521 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027276a0-d4be-4835-ab6e-39efece71ce8 admin admin] PATH_INFO: `/v3/projects/6098811200df4998b4c983c44640d16f/users/2c32548c092048afaf0a89eaccdc05cd/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:24.593366 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027276a0-d4be-4835-ab6e-39efece71ce8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6098811200df4998b4c983c44640d16f, user_id=2c32548c092048afaf0a89eaccdc05cd, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:24.596217 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027276a0-d4be-4835-ab6e-39efece71ce8 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:24.609174 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 983/1977] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:32:24 2022] PUT /identity/v3/projects/6098811200df4998b4c983c44640d16f/users/2c32548c092048afaf0a89eaccdc05cd/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:32:24.615671 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff006a4-bba6-4ef1-97db-f0caa9c7930e None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:24.616156 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff006a4-bba6-4ef1-97db-f0caa9c7930e None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:24.616696 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff006a4-bba6-4ef1-97db-f0caa9c7930e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:24.634337 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212329e3-19f0-4a9b-9a60-e343c5dadadf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:24.637220 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212329e3-19f0-4a9b-9a60-e343c5dadadf service cinder] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:24.643417 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-4ff006a4-bba6-4ef1-97db-f0caa9c7930e None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:24.645080 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-4ff006a4-bba6-4ef1-97db-f0caa9c7930e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:24.652959 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 995/1978] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:32:24 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:32:24.708470 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 984/1979] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:32:24.719297 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212329e3-19f0-4a9b-9a60-e343c5dadadf service cinder] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:24.720690 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-212329e3-19f0-4a9b-9a60-e343c5dadadf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:24.774951 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212329e3-19f0-4a9b-9a60-e343c5dadadf service cinder] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:24.823505 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c095c5-e889-4d70-8c14-385b85fb0ae8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:24.824680 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c095c5-e889-4d70-8c14-385b85fb0ae8 service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:24.824930 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c095c5-e889-4d70-8c14-385b85fb0ae8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:24.825221 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c095c5-e889-4d70-8c14-385b85fb0ae8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:24.835059 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c095c5-e889-4d70-8c14-385b85fb0ae8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:24.836532 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c095c5-e889-4d70-8c14-385b85fb0ae8 service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:24.847184 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 996/1980] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:32:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:32:25.642889 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d2117-9612-4e8f-bf3d-0bd04d00fdc0 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:25.643482 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d2117-9612-4e8f-bf3d-0bd04d00fdc0 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:25.643584 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d2117-9612-4e8f-bf3d-0bd04d00fdc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:25.672036 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-b94d2117-9612-4e8f-bf3d-0bd04d00fdc0 None None] MFA Rules not processed for user `2c32548c092048afaf0a89eaccdc05cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:25.673268 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-b94d2117-9612-4e8f-bf3d-0bd04d00fdc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:25.750402 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 985/1981] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:25.762839 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c095c5-e889-4d70-8c14-385b85fb0ae8 service neutron] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:25.765677 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-a0c095c5-e889-4d70-8c14-385b85fb0ae8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:25.842864 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c095c5-e889-4d70-8c14-385b85fb0ae8 service neutron] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:25.847594 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1aebba-1f95-49b3-9b66-a9ba074a88a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:25.848246 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1aebba-1f95-49b3-9b66-a9ba074a88a2 service cinder] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:25.848521 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1aebba-1f95-49b3-9b66-a9ba074a88a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:25.848791 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1aebba-1f95-49b3-9b66-a9ba074a88a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:25.857770 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1aebba-1f95-49b3-9b66-a9ba074a88a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:25.859229 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1aebba-1f95-49b3-9b66-a9ba074a88a2 service cinder] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:25.869584 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 997/1982] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:32:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:32:27.349728 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a7e24-dee6-4de0-956d-ec042da94c7d None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:27.350733 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a7e24-dee6-4de0-956d-ec042da94c7d None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:27.351220 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a7e24-dee6-4de0-956d-ec042da94c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:27.373414 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-ad4a7e24-dee6-4de0-956d-ec042da94c7d None None] MFA Rules not processed for user `2c32548c092048afaf0a89eaccdc05cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:27.374881 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-ad4a7e24-dee6-4de0-956d-ec042da94c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:27.384905 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 986/1983] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:29.944210 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1aebba-1f95-49b3-9b66-a9ba074a88a2 service cinder] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:29.945638 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-de1aebba-1f95-49b3-9b66-a9ba074a88a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:29.972305 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1aebba-1f95-49b3-9b66-a9ba074a88a2 service cinder] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:29.981029 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf42639-60f1-46f0-a6d3-cfeb1319115a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:29.981906 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf42639-60f1-46f0-a6d3-cfeb1319115a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:29.982183 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf42639-60f1-46f0-a6d3-cfeb1319115a admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:29.982469 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf42639-60f1-46f0-a6d3-cfeb1319115a admin admin] PATH_INFO: `/v3/users/06c369a4d8fc41d1a73f4b67f353ed0f` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:29.983698 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf42639-60f1-46f0-a6d3-cfeb1319115a admin admin] RBAC: Authorizing `identity:delete_user(user_id=06c369a4d8fc41d1a73f4b67f353ed0f)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:29.985602 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf42639-60f1-46f0-a6d3-cfeb1319115a admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:30.057052 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-fbf42639-60f1-46f0-a6d3-cfeb1319115a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06c369a4d8fc41d1a73f4b67f353ed0f'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:30.071056 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-fbf42639-60f1-46f0-a6d3-cfeb1319115a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06c369a4d8fc41d1a73f4b67f353ed0f'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:30.072269 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-fbf42639-60f1-46f0-a6d3-cfeb1319115a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06c369a4d8fc41d1a73f4b67f353ed0f'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:30.092833 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-fbf42639-60f1-46f0-a6d3-cfeb1319115a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06c369a4d8fc41d1a73f4b67f353ed0f'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:30.102659 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-fbf42639-60f1-46f0-a6d3-cfeb1319115a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06c369a4d8fc41d1a73f4b67f353ed0f'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:30.111025 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 998/1984] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:32:29 2022] DELETE /identity/v3/users/06c369a4d8fc41d1a73f4b67f353ed0f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:32:30.118904 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d048a0b-79cd-4fb4-b818-153b6562c4a8 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:30.120096 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d048a0b-79cd-4fb4-b818-153b6562c4a8 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:30.120821 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d048a0b-79cd-4fb4-b818-153b6562c4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:30.143739 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-0d048a0b-79cd-4fb4-b818-153b6562c4a8 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:30.145495 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-0d048a0b-79cd-4fb4-b818-153b6562c4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:30.235470 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 987/1985] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:30.248736 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf42639-60f1-46f0-a6d3-cfeb1319115a admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:30.251375 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-fbf42639-60f1-46f0-a6d3-cfeb1319115a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:30.358742 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf42639-60f1-46f0-a6d3-cfeb1319115a admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:30.362958 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d1677-8a78-418c-ac6f-7f93025d980d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:30.363854 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d1677-8a78-418c-ac6f-7f93025d980d service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:30.364370 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d1677-8a78-418c-ac6f-7f93025d980d service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:30.364679 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d1677-8a78-418c-ac6f-7f93025d980d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:30.375170 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33d1677-8a78-418c-ac6f-7f93025d980d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:30.377027 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33d1677-8a78-418c-ac6f-7f93025d980d service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:30.388131 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 999/1986] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:32:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:32:31.240298 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d048a0b-79cd-4fb4-b818-153b6562c4a8 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:31.242387 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-0d048a0b-79cd-4fb4-b818-153b6562c4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:31.255302 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d048a0b-79cd-4fb4-b818-153b6562c4a8 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:31.260235 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099798f-ecc3-47bf-b52d-c839f08ab454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:31.263016 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099798f-ecc3-47bf-b52d-c839f08ab454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:31.263505 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099798f-ecc3-47bf-b52d-c839f08ab454 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:31.263849 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099798f-ecc3-47bf-b52d-c839f08ab454 admin admin] PATH_INFO: `/v3/projects/bbdd1eba83af4919bf37c2c0c65b1ad4` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:31.265296 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099798f-ecc3-47bf-b52d-c839f08ab454 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbdd1eba83af4919bf37c2c0c65b1ad4)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:31.267448 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099798f-ecc3-47bf-b52d-c839f08ab454 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:31.401634 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-a099798f-ecc3-47bf-b52d-c839f08ab454 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbdd1eba83af4919bf37c2c0c65b1ad4', 'request_id': 'req-a099798f-ecc3-47bf-b52d-c839f08ab454'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:31.408976 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-a099798f-ecc3-47bf-b52d-c839f08ab454 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbdd1eba83af4919bf37c2c0c65b1ad4', 'request_id': 'req-a099798f-ecc3-47bf-b52d-c839f08ab454'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:31.437736 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-a099798f-ecc3-47bf-b52d-c839f08ab454 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbdd1eba83af4919bf37c2c0c65b1ad4', 'request_id': 'req-a099798f-ecc3-47bf-b52d-c839f08ab454'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:31.459287 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-a099798f-ecc3-47bf-b52d-c839f08ab454 admin admin] The token cache is being invalidate because project bbdd1eba83af4919bf37c2c0c65b1ad4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:32:31.460139 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-a099798f-ecc3-47bf-b52d-c839f08ab454 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:31.462794 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-a099798f-ecc3-47bf-b52d-c839f08ab454 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:31.467764 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 988/1987] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:32:31 2022] DELETE /identity/v3/projects/bbdd1eba83af4919bf37c2c0c65b1ad4 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:32:31.469842 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d1677-8a78-418c-ac6f-7f93025d980d service neutron] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:31.484054 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d1677-8a78-418c-ac6f-7f93025d980d service neutron] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:31.575852 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c336af8-d66d-469f-89c7-fc41bd07f9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:31.577429 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c336af8-d66d-469f-89c7-fc41bd07f9dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:31.578024 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c336af8-d66d-469f-89c7-fc41bd07f9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:31.579222 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c336af8-d66d-469f-89c7-fc41bd07f9dc admin admin] PATH_INFO: `/v3/users/a7891c4edab646948acef1a01fbcf8f3` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:31.580741 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c336af8-d66d-469f-89c7-fc41bd07f9dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7891c4edab646948acef1a01fbcf8f3)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:31.583274 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c336af8-d66d-469f-89c7-fc41bd07f9dc admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:31.677591 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-5c336af8-d66d-469f-89c7-fc41bd07f9dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7891c4edab646948acef1a01fbcf8f3'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:31.697513 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-5c336af8-d66d-469f-89c7-fc41bd07f9dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7891c4edab646948acef1a01fbcf8f3'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:31.698274 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-5c336af8-d66d-469f-89c7-fc41bd07f9dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7891c4edab646948acef1a01fbcf8f3'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:31.730923 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-5c336af8-d66d-469f-89c7-fc41bd07f9dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7891c4edab646948acef1a01fbcf8f3'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:31.753764 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-5c336af8-d66d-469f-89c7-fc41bd07f9dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7891c4edab646948acef1a01fbcf8f3'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:31.767232 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1000/1988] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:32:31 2022] DELETE /identity/v3/users/a7891c4edab646948acef1a01fbcf8f3 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:32:32.515316 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099798f-ecc3-47bf-b52d-c839f08ab454 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:32.517875 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-a099798f-ecc3-47bf-b52d-c839f08ab454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:32.536342 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099798f-ecc3-47bf-b52d-c839f08ab454 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:32.663257 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e7d4f-c88e-4678-a216-3eb200b64ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:32.664556 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e7d4f-c88e-4678-a216-3eb200b64ad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:32.664840 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e7d4f-c88e-4678-a216-3eb200b64ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:32.665116 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e7d4f-c88e-4678-a216-3eb200b64ad6 admin admin] PATH_INFO: `/v3/projects/e6e4aff8a0ba4fafb51cce08afee14f4` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:32.666726 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e7d4f-c88e-4678-a216-3eb200b64ad6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6e4aff8a0ba4fafb51cce08afee14f4)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:32.669517 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e7d4f-c88e-4678-a216-3eb200b64ad6 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:32.731666 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-3b5e7d4f-c88e-4678-a216-3eb200b64ad6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6e4aff8a0ba4fafb51cce08afee14f4', 'request_id': 'req-3b5e7d4f-c88e-4678-a216-3eb200b64ad6'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:32.740011 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-3b5e7d4f-c88e-4678-a216-3eb200b64ad6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6e4aff8a0ba4fafb51cce08afee14f4', 'request_id': 'req-3b5e7d4f-c88e-4678-a216-3eb200b64ad6'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:32.747823 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-3b5e7d4f-c88e-4678-a216-3eb200b64ad6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6e4aff8a0ba4fafb51cce08afee14f4', 'request_id': 'req-3b5e7d4f-c88e-4678-a216-3eb200b64ad6'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:32.765442 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-3b5e7d4f-c88e-4678-a216-3eb200b64ad6 admin admin] The token cache is being invalidate because project e6e4aff8a0ba4fafb51cce08afee14f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:32:32.766238 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-3b5e7d4f-c88e-4678-a216-3eb200b64ad6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:32.767147 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-3b5e7d4f-c88e-4678-a216-3eb200b64ad6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:32.769464 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 989/1989] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:32:32 2022] DELETE /identity/v3/projects/e6e4aff8a0ba4fafb51cce08afee14f4 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:32:32.773308 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c336af8-d66d-469f-89c7-fc41bd07f9dc admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:32.774982 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-5c336af8-d66d-469f-89c7-fc41bd07f9dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:32.797337 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c336af8-d66d-469f-89c7-fc41bd07f9dc admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:32.890488 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88090800-1561-45d1-ad9e-f288d9be44bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:32.891624 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88090800-1561-45d1-ad9e-f288d9be44bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:32.891898 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88090800-1561-45d1-ad9e-f288d9be44bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:32.892168 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88090800-1561-45d1-ad9e-f288d9be44bb admin admin] PATH_INFO: `/v3/users/78650d893a8a46d6ab2851ffdcd13709` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:32.893566 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88090800-1561-45d1-ad9e-f288d9be44bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=78650d893a8a46d6ab2851ffdcd13709)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:32.895547 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88090800-1561-45d1-ad9e-f288d9be44bb admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:32.950766 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-88090800-1561-45d1-ad9e-f288d9be44bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78650d893a8a46d6ab2851ffdcd13709'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:32.959838 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-88090800-1561-45d1-ad9e-f288d9be44bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78650d893a8a46d6ab2851ffdcd13709'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:32.960604 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-88090800-1561-45d1-ad9e-f288d9be44bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78650d893a8a46d6ab2851ffdcd13709'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:32.974076 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-88090800-1561-45d1-ad9e-f288d9be44bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78650d893a8a46d6ab2851ffdcd13709'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:32.980775 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-88090800-1561-45d1-ad9e-f288d9be44bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78650d893a8a46d6ab2851ffdcd13709'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:32.987287 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1001/1990] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:32:32 2022] DELETE /identity/v3/users/78650d893a8a46d6ab2851ffdcd13709 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:32:33.422478 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e7d4f-c88e-4678-a216-3eb200b64ad6 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:33.425293 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-3b5e7d4f-c88e-4678-a216-3eb200b64ad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:33.440278 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e7d4f-c88e-4678-a216-3eb200b64ad6 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:33.525318 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c2f8ba-bc8f-4c41-99c5-8796618b24fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:33.525318 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2f8ba-bc8f-4c41-99c5-8796618b24fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:33.525965 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2f8ba-bc8f-4c41-99c5-8796618b24fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:33.525965 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2f8ba-bc8f-4c41-99c5-8796618b24fc admin admin] PATH_INFO: `/v3/projects/0d9d451d08824ecabb4fef86ac0068cc` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:33.528441 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c2f8ba-bc8f-4c41-99c5-8796618b24fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d9d451d08824ecabb4fef86ac0068cc)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:33.531663 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c2f8ba-bc8f-4c41-99c5-8796618b24fc admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:33.602895 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-75c2f8ba-bc8f-4c41-99c5-8796618b24fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d9d451d08824ecabb4fef86ac0068cc', 'request_id': 'req-75c2f8ba-bc8f-4c41-99c5-8796618b24fc'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:33.615054 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-75c2f8ba-bc8f-4c41-99c5-8796618b24fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d9d451d08824ecabb4fef86ac0068cc', 'request_id': 'req-75c2f8ba-bc8f-4c41-99c5-8796618b24fc'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:33.625974 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-75c2f8ba-bc8f-4c41-99c5-8796618b24fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d9d451d08824ecabb4fef86ac0068cc', 'request_id': 'req-75c2f8ba-bc8f-4c41-99c5-8796618b24fc'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:33.670753 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-75c2f8ba-bc8f-4c41-99c5-8796618b24fc admin admin] The token cache is being invalidate because project 0d9d451d08824ecabb4fef86ac0068cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:32:33.671049 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-75c2f8ba-bc8f-4c41-99c5-8796618b24fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:33.672076 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-75c2f8ba-bc8f-4c41-99c5-8796618b24fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:33.673789 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 990/1991] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:32:33 2022] DELETE /identity/v3/projects/0d9d451d08824ecabb4fef86ac0068cc => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:32:33.678850 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c7e58-6cb6-4379-aea2-d1272c74b122 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:33.679136 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c7e58-6cb6-4379-aea2-d1272c74b122 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:33.679414 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c7e58-6cb6-4379-aea2-d1272c74b122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:33.697554 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-643c7e58-6cb6-4379-aea2-d1272c74b122 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:33.699415 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-643c7e58-6cb6-4379-aea2-d1272c74b122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:33.765399 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1002/1992] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:33.772981 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc8958-1b14-4142-8ecd-0772576b6b7b None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:33.773366 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc8958-1b14-4142-8ecd-0772576b6b7b None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:33.773806 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc8958-1b14-4142-8ecd-0772576b6b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:33.793006 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-6ebc8958-1b14-4142-8ecd-0772576b6b7b None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:33.794317 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-6ebc8958-1b14-4142-8ecd-0772576b6b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:33.802619 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 991/1993] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:32:33.807568 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c7e58-6cb6-4379-aea2-d1272c74b122 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:33.820124 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c7e58-6cb6-4379-aea2-d1272c74b122 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:33.828385 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e2fe0-d816-4398-a55a-a2901522a562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:33.828907 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e2fe0-d816-4398-a55a-a2901522a562 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:33.829187 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e2fe0-d816-4398-a55a-a2901522a562 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:33.829460 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e2fe0-d816-4398-a55a-a2901522a562 admin admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:33.830174 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e2fe0-d816-4398-a55a-a2901522a562 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:32:33.830652 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e2fe0-d816-4398-a55a-a2901522a562 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:33.832097 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e2fe0-d816-4398-a55a-a2901522a562 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:33.848144 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1003/1994] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:32:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:32:33.854645 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc8958-1b14-4142-8ecd-0772576b6b7b None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:33.867534 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc8958-1b14-4142-8ecd-0772576b6b7b None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:33.873155 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9038d-3185-4193-ae2c-aa04a035eb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:33.873814 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9038d-3185-4193-ae2c-aa04a035eb57 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:33.874097 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9038d-3185-4193-ae2c-aa04a035eb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:33.874370 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9038d-3185-4193-ae2c-aa04a035eb57 admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:33.875095 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf9038d-3185-4193-ae2c-aa04a035eb57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:33.876993 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf9038d-3185-4193-ae2c-aa04a035eb57 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:33.915910 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 992/1995] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:32:33 2022] POST /identity/v3/projects => generated 397 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:32:33.919870 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e2fe0-d816-4398-a55a-a2901522a562 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:33.929498 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e2fe0-d816-4398-a55a-a2901522a562 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:33.986726 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a436edf-12fb-4dfd-b8d0-eb3712ac45bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:33.987394 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a436edf-12fb-4dfd-b8d0-eb3712ac45bc admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:33.987670 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a436edf-12fb-4dfd-b8d0-eb3712ac45bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:33.987937 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a436edf-12fb-4dfd-b8d0-eb3712ac45bc admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:33.988634 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a436edf-12fb-4dfd-b8d0-eb3712ac45bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:33.990584 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a436edf-12fb-4dfd-b8d0-eb3712ac45bc admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:34.012371 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1004/1996] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:32:33 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:32:34.016463 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9038d-3185-4193-ae2c-aa04a035eb57 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:34.026519 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9038d-3185-4193-ae2c-aa04a035eb57 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:34.031792 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f5fbd-7c9e-429d-95ab-deb0acec276d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:34.032443 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f5fbd-7c9e-429d-95ab-deb0acec276d admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:34.032720 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f5fbd-7c9e-429d-95ab-deb0acec276d admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:34.033021 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f5fbd-7c9e-429d-95ab-deb0acec276d admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:34.033735 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f5fbd-7c9e-429d-95ab-deb0acec276d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:34.035346 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f5fbd-7c9e-429d-95ab-deb0acec276d admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:34.047309 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 993/1997] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:32:34.053245 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a436edf-12fb-4dfd-b8d0-eb3712ac45bc admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:34.071000 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a436edf-12fb-4dfd-b8d0-eb3712ac45bc admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:34.081761 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9fc743-f784-4417-8e7c-615dd19cf8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:34.083096 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fc743-f784-4417-8e7c-615dd19cf8a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:34.083601 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fc743-f784-4417-8e7c-615dd19cf8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:34.084113 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fc743-f784-4417-8e7c-615dd19cf8a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:34.085769 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9fc743-f784-4417-8e7c-615dd19cf8a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:34.088848 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9fc743-f784-4417-8e7c-615dd19cf8a8 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:34.106081 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1005/1998] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:32:34.107550 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f5fbd-7c9e-429d-95ab-deb0acec276d admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:34.117478 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f5fbd-7c9e-429d-95ab-deb0acec276d admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:34.122472 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a6095b-de6e-4a81-9a57-b6c218105718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:34.123621 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6095b-de6e-4a81-9a57-b6c218105718 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:34.124085 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6095b-de6e-4a81-9a57-b6c218105718 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:34.124557 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6095b-de6e-4a81-9a57-b6c218105718 admin admin] PATH_INFO: `/v3/projects/025f6f4d862540c9bdd2076da432a83c/users/c251b768117f4bf3857779c8098765e0/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:34.146715 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a6095b-de6e-4a81-9a57-b6c218105718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=025f6f4d862540c9bdd2076da432a83c, user_id=c251b768117f4bf3857779c8098765e0, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:34.148646 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a6095b-de6e-4a81-9a57-b6c218105718 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:34.163212 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 994/1999] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:32:34 2022] PUT /identity/v3/projects/025f6f4d862540c9bdd2076da432a83c/users/c251b768117f4bf3857779c8098765e0/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:32:34.174201 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa643638-cb87-45f7-9b77-717ed6d341d5 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:34.174429 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa643638-cb87-45f7-9b77-717ed6d341d5 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:34.174810 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa643638-cb87-45f7-9b77-717ed6d341d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:34.201052 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-fa643638-cb87-45f7-9b77-717ed6d341d5 None None] MFA Rules not processed for user `c251b768117f4bf3857779c8098765e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:34.202260 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-fa643638-cb87-45f7-9b77-717ed6d341d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:34.267738 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1006/2000] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:34.283264 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a6095b-de6e-4a81-9a57-b6c218105718 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:34.283264 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-c1a6095b-de6e-4a81-9a57-b6c218105718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:34.347266 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a6095b-de6e-4a81-9a57-b6c218105718 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:34.358704 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493652a6-c8ed-47b2-9b95-4f68d789ea8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:34.358704 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493652a6-c8ed-47b2-9b95-4f68d789ea8d service cinder] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:34.358704 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493652a6-c8ed-47b2-9b95-4f68d789ea8d service cinder] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:34.358704 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493652a6-c8ed-47b2-9b95-4f68d789ea8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:34.361852 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493652a6-c8ed-47b2-9b95-4f68d789ea8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:34.363336 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493652a6-c8ed-47b2-9b95-4f68d789ea8d service cinder] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:34.372349 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 995/2001] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:32:34 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:32:48.883444 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa643638-cb87-45f7-9b77-717ed6d341d5 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:48.967446 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa643638-cb87-45f7-9b77-717ed6d341d5 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:48.971930 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3159209d-c941-4bc2-abab-ec61377fa01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:48.972787 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159209d-c941-4bc2-abab-ec61377fa01c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:48.973063 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159209d-c941-4bc2-abab-ec61377fa01c admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:48.973333 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159209d-c941-4bc2-abab-ec61377fa01c admin admin] PATH_INFO: `/v3/users/c251b768117f4bf3857779c8098765e0` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:48.974508 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3159209d-c941-4bc2-abab-ec61377fa01c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c251b768117f4bf3857779c8098765e0)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:48.976453 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3159209d-c941-4bc2-abab-ec61377fa01c admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:49.029505 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-3159209d-c941-4bc2-abab-ec61377fa01c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c251b768117f4bf3857779c8098765e0'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:49.038836 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-3159209d-c941-4bc2-abab-ec61377fa01c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c251b768117f4bf3857779c8098765e0'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:49.039676 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-3159209d-c941-4bc2-abab-ec61377fa01c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c251b768117f4bf3857779c8098765e0'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:49.052577 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-3159209d-c941-4bc2-abab-ec61377fa01c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c251b768117f4bf3857779c8098765e0'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:49.059096 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-3159209d-c941-4bc2-abab-ec61377fa01c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c251b768117f4bf3857779c8098765e0'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:49.065270 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1007/2002] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:32:48 2022] DELETE /identity/v3/users/c251b768117f4bf3857779c8098765e0 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:32:49.069768 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2eb98-b0f6-4742-9c63-ead808e8cd57 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:49.070321 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2eb98-b0f6-4742-9c63-ead808e8cd57 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:49.070529 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2eb98-b0f6-4742-9c63-ead808e8cd57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:49.087612 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-6ff2eb98-b0f6-4742-9c63-ead808e8cd57 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:49.088819 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-6ff2eb98-b0f6-4742-9c63-ead808e8cd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:49.148321 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 996/2003] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:32:49.179954 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3159209d-c941-4bc2-abab-ec61377fa01c admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:49.181620 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-3159209d-c941-4bc2-abab-ec61377fa01c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:49.248375 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3159209d-c941-4bc2-abab-ec61377fa01c admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:49.252485 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b1ed7-f2eb-44e9-ab7e-17f3f716a6a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:49.253160 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b1ed7-f2eb-44e9-ab7e-17f3f716a6a4 service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:49.253452 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b1ed7-f2eb-44e9-ab7e-17f3f716a6a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:49.253731 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b1ed7-f2eb-44e9-ab7e-17f3f716a6a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:49.269646 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b1ed7-f2eb-44e9-ab7e-17f3f716a6a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:49.270686 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b1ed7-f2eb-44e9-ab7e-17f3f716a6a4 service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:49.281972 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1008/2004] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:32:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:32:49.705701 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2eb98-b0f6-4742-9c63-ead808e8cd57 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:49.707234 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-6ff2eb98-b0f6-4742-9c63-ead808e8cd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:49.711739 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b1ed7-f2eb-44e9-ab7e-17f3f716a6a4 service neutron] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:49.713169 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-145b1ed7-f2eb-44e9-ab7e-17f3f716a6a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:49.722902 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2eb98-b0f6-4742-9c63-ead808e8cd57 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:49.729369 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa5e8b-4404-4c67-ac4e-a57b8285ada8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:49.729790 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b1ed7-f2eb-44e9-ab7e-17f3f716a6a4 service neutron] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:49.730484 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa5e8b-4404-4c67-ac4e-a57b8285ada8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:49.730870 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa5e8b-4404-4c67-ac4e-a57b8285ada8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:49.731245 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa5e8b-4404-4c67-ac4e-a57b8285ada8 admin admin] PATH_INFO: `/v3/projects/025f6f4d862540c9bdd2076da432a83c` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:49.733854 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa5e8b-4404-4c67-ac4e-a57b8285ada8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=025f6f4d862540c9bdd2076da432a83c)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:49.736653 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7ad9c-f6d5-4bc1-96a3-ba2fec76e165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:49.736974 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa5e8b-4404-4c67-ac4e-a57b8285ada8 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:49.737499 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7ad9c-f6d5-4bc1-96a3-ba2fec76e165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:49.737880 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7ad9c-f6d5-4bc1-96a3-ba2fec76e165 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:49.738065 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7ad9c-f6d5-4bc1-96a3-ba2fec76e165 admin admin] PATH_INFO: `/v3/users/1b3066dcfc2848dcbcc62e3bc5146665` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:49.739293 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc7ad9c-f6d5-4bc1-96a3-ba2fec76e165 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b3066dcfc2848dcbcc62e3bc5146665)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:49.741405 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc7ad9c-f6d5-4bc1-96a3-ba2fec76e165 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:49.794213 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-cbc7ad9c-f6d5-4bc1-96a3-ba2fec76e165 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b3066dcfc2848dcbcc62e3bc5146665'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:49.796706 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-a9fa5e8b-4404-4c67-ac4e-a57b8285ada8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '025f6f4d862540c9bdd2076da432a83c', 'request_id': 'req-a9fa5e8b-4404-4c67-ac4e-a57b8285ada8'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:49.802372 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-cbc7ad9c-f6d5-4bc1-96a3-ba2fec76e165 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b3066dcfc2848dcbcc62e3bc5146665'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:49.803010 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-cbc7ad9c-f6d5-4bc1-96a3-ba2fec76e165 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b3066dcfc2848dcbcc62e3bc5146665'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:49.804036 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-a9fa5e8b-4404-4c67-ac4e-a57b8285ada8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '025f6f4d862540c9bdd2076da432a83c', 'request_id': 'req-a9fa5e8b-4404-4c67-ac4e-a57b8285ada8'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:49.811128 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-a9fa5e8b-4404-4c67-ac4e-a57b8285ada8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '025f6f4d862540c9bdd2076da432a83c', 'request_id': 'req-a9fa5e8b-4404-4c67-ac4e-a57b8285ada8'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:49.817126 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-cbc7ad9c-f6d5-4bc1-96a3-ba2fec76e165 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b3066dcfc2848dcbcc62e3bc5146665'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:49.824231 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-a9fa5e8b-4404-4c67-ac4e-a57b8285ada8 admin admin] The token cache is being invalidate because project 025f6f4d862540c9bdd2076da432a83c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:32:49.824514 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-a9fa5e8b-4404-4c67-ac4e-a57b8285ada8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:49.825279 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-a9fa5e8b-4404-4c67-ac4e-a57b8285ada8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:49.827670 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-cbc7ad9c-f6d5-4bc1-96a3-ba2fec76e165 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b3066dcfc2848dcbcc62e3bc5146665'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:49.827788 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 997/2005] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:32:49 2022] DELETE /identity/v3/projects/025f6f4d862540c9bdd2076da432a83c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:32:49.834636 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1009/2006] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:32:49 2022] DELETE /identity/v3/users/1b3066dcfc2848dcbcc62e3bc5146665 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:32:49.839887 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca18e94-7d88-422c-a233-84734d74ca6c None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:49.840372 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca18e94-7d88-422c-a233-84734d74ca6c None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:49.840652 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca18e94-7d88-422c-a233-84734d74ca6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:49.868736 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-eca18e94-7d88-422c-a233-84734d74ca6c None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:49.869972 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-eca18e94-7d88-422c-a233-84734d74ca6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:49.946171 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 998/2007] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:49.961597 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7ad9c-f6d5-4bc1-96a3-ba2fec76e165 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:49.963737 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-cbc7ad9c-f6d5-4bc1-96a3-ba2fec76e165 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:50.041574 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7ad9c-f6d5-4bc1-96a3-ba2fec76e165 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:50.048739 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03157e46-b812-4eaa-a5fd-78b3a2c5d335 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:50.049457 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03157e46-b812-4eaa-a5fd-78b3a2c5d335 service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:50.049742 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03157e46-b812-4eaa-a5fd-78b3a2c5d335 service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:50.050054 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03157e46-b812-4eaa-a5fd-78b3a2c5d335 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:50.072331 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03157e46-b812-4eaa-a5fd-78b3a2c5d335 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:50.078432 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03157e46-b812-4eaa-a5fd-78b3a2c5d335 service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:50.098978 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1010/2008] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:32:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:32:50.450008 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca18e94-7d88-422c-a233-84734d74ca6c None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:50.451568 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-eca18e94-7d88-422c-a233-84734d74ca6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:50.463873 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca18e94-7d88-422c-a233-84734d74ca6c None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:50.472292 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd4d52-abf0-41b5-ab70-65d6950738cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:50.473471 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd4d52-abf0-41b5-ab70-65d6950738cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:50.473915 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd4d52-abf0-41b5-ab70-65d6950738cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:50.474343 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd4d52-abf0-41b5-ab70-65d6950738cb admin admin] PATH_INFO: `/v3/projects/b80bb92bf7c047509a38185e7928e032` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:50.475895 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dd4d52-abf0-41b5-ab70-65d6950738cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b80bb92bf7c047509a38185e7928e032)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:50.477976 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dd4d52-abf0-41b5-ab70-65d6950738cb admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:50.532815 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-d6dd4d52-abf0-41b5-ab70-65d6950738cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b80bb92bf7c047509a38185e7928e032', 'request_id': 'req-d6dd4d52-abf0-41b5-ab70-65d6950738cb'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:50.539924 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-d6dd4d52-abf0-41b5-ab70-65d6950738cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b80bb92bf7c047509a38185e7928e032', 'request_id': 'req-d6dd4d52-abf0-41b5-ab70-65d6950738cb'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:50.547179 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-d6dd4d52-abf0-41b5-ab70-65d6950738cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b80bb92bf7c047509a38185e7928e032', 'request_id': 'req-d6dd4d52-abf0-41b5-ab70-65d6950738cb'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:50.562172 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-d6dd4d52-abf0-41b5-ab70-65d6950738cb admin admin] The token cache is being invalidate because project b80bb92bf7c047509a38185e7928e032 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:32:50.562680 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-d6dd4d52-abf0-41b5-ab70-65d6950738cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:50.563375 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-d6dd4d52-abf0-41b5-ab70-65d6950738cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:50.565008 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 999/2009] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:32:50 2022] DELETE /identity/v3/projects/b80bb92bf7c047509a38185e7928e032 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:32:50.570553 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1ac21-6b89-4e3e-aac0-cd49d84cf243 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:50.570901 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1ac21-6b89-4e3e-aac0-cd49d84cf243 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:50.571235 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1ac21-6b89-4e3e-aac0-cd49d84cf243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:50.589614 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-89b1ac21-6b89-4e3e-aac0-cd49d84cf243 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:50.590884 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-89b1ac21-6b89-4e3e-aac0-cd49d84cf243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:50.662206 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1011/2010] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:32:50.670538 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f48d06-7e13-4c1d-9ab5-955c7f7f644b None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:50.670776 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f48d06-7e13-4c1d-9ab5-955c7f7f644b None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:50.671052 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f48d06-7e13-4c1d-9ab5-955c7f7f644b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:50.690791 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-56f48d06-7e13-4c1d-9ab5-955c7f7f644b None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:50.691858 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-56f48d06-7e13-4c1d-9ab5-955c7f7f644b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:50.700964 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1000/2011] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:50.705000 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b1ac21-6b89-4e3e-aac0-cd49d84cf243 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:50.714981 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b1ac21-6b89-4e3e-aac0-cd49d84cf243 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:50.720754 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8de76-0db6-4993-a083-81c520ba55fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:50.721822 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8de76-0db6-4993-a083-81c520ba55fb admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:50.722100 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8de76-0db6-4993-a083-81c520ba55fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:50.722442 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8de76-0db6-4993-a083-81c520ba55fb admin admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:50.723228 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e8de76-0db6-4993-a083-81c520ba55fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:32:50.723534 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e8de76-0db6-4993-a083-81c520ba55fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:50.725322 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e8de76-0db6-4993-a083-81c520ba55fb admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:50.738905 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1012/2012] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:32:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:32:50.743773 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f48d06-7e13-4c1d-9ab5-955c7f7f644b None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:50.755960 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f48d06-7e13-4c1d-9ab5-955c7f7f644b None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:50.761617 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0597f489-a828-44a6-9536-6e9bfb304652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:50.762271 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597f489-a828-44a6-9536-6e9bfb304652 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:50.762619 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597f489-a828-44a6-9536-6e9bfb304652 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:50.763591 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597f489-a828-44a6-9536-6e9bfb304652 admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:50.764312 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0597f489-a828-44a6-9536-6e9bfb304652 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:50.766429 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0597f489-a828-44a6-9536-6e9bfb304652 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:50.791141 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1001/2013] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:32:50 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:32:50.796070 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8de76-0db6-4993-a083-81c520ba55fb admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:50.805829 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8de76-0db6-4993-a083-81c520ba55fb admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:50.863604 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d7389-046e-49cc-b7d2-f583f25c1a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:50.864273 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d7389-046e-49cc-b7d2-f583f25c1a41 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:50.864555 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d7389-046e-49cc-b7d2-f583f25c1a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:50.864828 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d7389-046e-49cc-b7d2-f583f25c1a41 admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:50.865519 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d7389-046e-49cc-b7d2-f583f25c1a41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:50.867452 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d7389-046e-49cc-b7d2-f583f25c1a41 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:50.886953 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1013/2014] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:32:50 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:32:50.891202 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0597f489-a828-44a6-9536-6e9bfb304652 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:50.902088 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0597f489-a828-44a6-9536-6e9bfb304652 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:50.906969 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb292fb-e092-4e04-b37c-3edfaa518018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:50.907678 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb292fb-e092-4e04-b37c-3edfaa518018 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:50.907961 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb292fb-e092-4e04-b37c-3edfaa518018 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:50.908258 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb292fb-e092-4e04-b37c-3edfaa518018 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:50.908973 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb292fb-e092-4e04-b37c-3edfaa518018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:50.910587 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb292fb-e092-4e04-b37c-3edfaa518018 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:50.922161 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1002/2015] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:32:50.926591 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d7389-046e-49cc-b7d2-f583f25c1a41 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:50.937934 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d7389-046e-49cc-b7d2-f583f25c1a41 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:50.942624 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d04c5-3563-462b-896b-fa7e9589bed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:50.943300 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d04c5-3563-462b-896b-fa7e9589bed0 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:50.943582 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d04c5-3563-462b-896b-fa7e9589bed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:50.943857 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d04c5-3563-462b-896b-fa7e9589bed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:50.944575 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d04c5-3563-462b-896b-fa7e9589bed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:50.946177 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d04c5-3563-462b-896b-fa7e9589bed0 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:50.956590 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1014/2016] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:32:50.961149 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb292fb-e092-4e04-b37c-3edfaa518018 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:50.972139 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb292fb-e092-4e04-b37c-3edfaa518018 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:50.976810 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07258dd-8a03-4011-af18-cc35d0983690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:50.977674 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07258dd-8a03-4011-af18-cc35d0983690 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:50.977953 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07258dd-8a03-4011-af18-cc35d0983690 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:50.978225 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07258dd-8a03-4011-af18-cc35d0983690 admin admin] PATH_INFO: `/v3/projects/937ab1eb0d164b6091773fbb7980221e/users/790cd4b6cc794254bf8d4599f3f9cdef/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:50.992877 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07258dd-8a03-4011-af18-cc35d0983690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=937ab1eb0d164b6091773fbb7980221e, user_id=790cd4b6cc794254bf8d4599f3f9cdef, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:50.995540 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07258dd-8a03-4011-af18-cc35d0983690 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:51.007708 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1003/2017] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:32:50 2022] PUT /identity/v3/projects/937ab1eb0d164b6091773fbb7980221e/users/790cd4b6cc794254bf8d4599f3f9cdef/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:32:51.020695 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f342733-8379-43b3-88d6-3ad826231386 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:51.021281 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f342733-8379-43b3-88d6-3ad826231386 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:51.021281 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f342733-8379-43b3-88d6-3ad826231386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:51.048852 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-5f342733-8379-43b3-88d6-3ad826231386 None None] MFA Rules not processed for user `790cd4b6cc794254bf8d4599f3f9cdef`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:51.050059 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-5f342733-8379-43b3-88d6-3ad826231386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:51.114911 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1015/2018] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:32:51.119327 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07258dd-8a03-4011-af18-cc35d0983690 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:51.180863 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07258dd-8a03-4011-af18-cc35d0983690 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:51.186402 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8680e-df38-4812-86b8-eab59fb1672c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:51.187099 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8680e-df38-4812-86b8-eab59fb1672c admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:51.187370 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8680e-df38-4812-86b8-eab59fb1672c admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:51.187641 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8680e-df38-4812-86b8-eab59fb1672c admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:51.188328 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da8680e-df38-4812-86b8-eab59fb1672c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:51.190220 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da8680e-df38-4812-86b8-eab59fb1672c admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:51.214139 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1004/2019] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:32:51 2022] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:32:51.218732 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f342733-8379-43b3-88d6-3ad826231386 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:51.229490 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f342733-8379-43b3-88d6-3ad826231386 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:51.283075 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d7d90f-1425-4a74-915f-63e1516088bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:51.283750 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7d90f-1425-4a74-915f-63e1516088bc admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:51.284036 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7d90f-1425-4a74-915f-63e1516088bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:51.284312 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7d90f-1425-4a74-915f-63e1516088bc admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:51.285047 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d7d90f-1425-4a74-915f-63e1516088bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:51.286905 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d7d90f-1425-4a74-915f-63e1516088bc admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:51.314449 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1016/2020] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:32:51 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:32:51.314575 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8680e-df38-4812-86b8-eab59fb1672c admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:51.324609 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8680e-df38-4812-86b8-eab59fb1672c admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:51.330430 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7a20b-580e-49a9-a58c-17e107f9486d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:51.331133 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7a20b-580e-49a9-a58c-17e107f9486d admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:51.331413 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7a20b-580e-49a9-a58c-17e107f9486d admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:51.331683 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7a20b-580e-49a9-a58c-17e107f9486d admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:51.332407 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c7a20b-580e-49a9-a58c-17e107f9486d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:51.333990 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c7a20b-580e-49a9-a58c-17e107f9486d admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:51.347360 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1005/2021] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:32:51.350687 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d7d90f-1425-4a74-915f-63e1516088bc admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:51.363109 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d7d90f-1425-4a74-915f-63e1516088bc admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:51.368319 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4172e648-6c24-43e1-afc0-17d35897aaf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:51.368973 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172e648-6c24-43e1-afc0-17d35897aaf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:51.369248 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172e648-6c24-43e1-afc0-17d35897aaf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:51.369526 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172e648-6c24-43e1-afc0-17d35897aaf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:51.370247 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4172e648-6c24-43e1-afc0-17d35897aaf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:51.371855 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4172e648-6c24-43e1-afc0-17d35897aaf0 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:51.382484 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1017/2022] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:32:51.386632 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7a20b-580e-49a9-a58c-17e107f9486d admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:51.396556 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7a20b-580e-49a9-a58c-17e107f9486d admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:51.402526 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea435d-e306-499c-953b-eeb63affc88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:51.403956 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea435d-e306-499c-953b-eeb63affc88f admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:51.404243 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea435d-e306-499c-953b-eeb63affc88f admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:51.404542 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea435d-e306-499c-953b-eeb63affc88f admin admin] PATH_INFO: `/v3/projects/9f9aa45eb6af405c9699448a43409852/users/a8ba896ccf7b46e59e346a42f94c6061/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:51.423241 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ea435d-e306-499c-953b-eeb63affc88f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f9aa45eb6af405c9699448a43409852, user_id=a8ba896ccf7b46e59e346a42f94c6061, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:51.427032 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ea435d-e306-499c-953b-eeb63affc88f admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:51.445026 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1006/2023] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:32:51 2022] PUT /identity/v3/projects/9f9aa45eb6af405c9699448a43409852/users/a8ba896ccf7b46e59e346a42f94c6061/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:32:51.455354 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d0695-7a39-4ae9-9c26-6d750b1666b5 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:51.455657 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d0695-7a39-4ae9-9c26-6d750b1666b5 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:51.455919 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d0695-7a39-4ae9-9c26-6d750b1666b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:51.487009 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-4b1d0695-7a39-4ae9-9c26-6d750b1666b5 None None] MFA Rules not processed for user `a8ba896ccf7b46e59e346a42f94c6061`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:51.488371 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-4b1d0695-7a39-4ae9-9c26-6d750b1666b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:51.568048 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1018/2024] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:51.572471 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea435d-e306-499c-953b-eeb63affc88f admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:51.641510 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea435d-e306-499c-953b-eeb63affc88f admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:51.646633 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d10888-fb3b-47d6-ab73-5d2a8ecfc2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:51.647365 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d10888-fb3b-47d6-ab73-5d2a8ecfc2a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:51.647718 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d10888-fb3b-47d6-ab73-5d2a8ecfc2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:51.647999 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d10888-fb3b-47d6-ab73-5d2a8ecfc2a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:51.648707 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d10888-fb3b-47d6-ab73-5d2a8ecfc2a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:51.650578 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d10888-fb3b-47d6-ab73-5d2a8ecfc2a8 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:51.676953 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1007/2025] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:32:51 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:32:51.681239 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1d0695-7a39-4ae9-9c26-6d750b1666b5 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:51.691841 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1d0695-7a39-4ae9-9c26-6d750b1666b5 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:51.755915 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e12f94-3508-4ea3-aa4d-f2e5beec6500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:51.756587 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e12f94-3508-4ea3-aa4d-f2e5beec6500 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:51.757066 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e12f94-3508-4ea3-aa4d-f2e5beec6500 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:51.757349 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e12f94-3508-4ea3-aa4d-f2e5beec6500 admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:51.758042 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e12f94-3508-4ea3-aa4d-f2e5beec6500 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:51.760013 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e12f94-3508-4ea3-aa4d-f2e5beec6500 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:51.780554 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1019/2026] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:32:51 2022] POST /identity/v3/users => generated 295 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:32:51.784586 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d10888-fb3b-47d6-ab73-5d2a8ecfc2a8 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:51.795441 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d10888-fb3b-47d6-ab73-5d2a8ecfc2a8 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:51.799978 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e7c98-1dcf-4dd0-8f5e-8f377fb38843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:51.800628 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e7c98-1dcf-4dd0-8f5e-8f377fb38843 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:51.800903 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e7c98-1dcf-4dd0-8f5e-8f377fb38843 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:51.801175 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e7c98-1dcf-4dd0-8f5e-8f377fb38843 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:51.801884 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33e7c98-1dcf-4dd0-8f5e-8f377fb38843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:51.803754 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33e7c98-1dcf-4dd0-8f5e-8f377fb38843 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:51.818101 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1008/2027] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:32:51.819575 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e12f94-3508-4ea3-aa4d-f2e5beec6500 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:51.831293 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e12f94-3508-4ea3-aa4d-f2e5beec6500 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:51.836379 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b21f8-c575-418b-a254-cd882fc9502c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:51.837438 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b21f8-c575-418b-a254-cd882fc9502c admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:51.837718 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b21f8-c575-418b-a254-cd882fc9502c admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:51.838096 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b21f8-c575-418b-a254-cd882fc9502c admin admin] PATH_INFO: `/v3/projects/91b87c36c30b4a13b925de1802dc4ea7/users/09e786febe9c4dec9be77961f20a4a51/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:51.858092 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b21f8-c575-418b-a254-cd882fc9502c admin admin] RBAC: Authorizing `identity:create_grant(project_id=91b87c36c30b4a13b925de1802dc4ea7, user_id=09e786febe9c4dec9be77961f20a4a51, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:51.860784 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b21f8-c575-418b-a254-cd882fc9502c admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:51.874994 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1020/2028] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:32:51 2022] PUT /identity/v3/projects/91b87c36c30b4a13b925de1802dc4ea7/users/09e786febe9c4dec9be77961f20a4a51/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:32:51.878956 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e7c98-1dcf-4dd0-8f5e-8f377fb38843 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:51.889781 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e7c98-1dcf-4dd0-8f5e-8f377fb38843 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:51.951818 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9db24-d34b-4322-9bcd-0389107b638d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:51.952518 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9db24-d34b-4322-9bcd-0389107b638d admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:51.952797 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9db24-d34b-4322-9bcd-0389107b638d admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:51.953068 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9db24-d34b-4322-9bcd-0389107b638d admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:51.953783 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f9db24-d34b-4322-9bcd-0389107b638d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:51.955380 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f9db24-d34b-4322-9bcd-0389107b638d admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:51.969331 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1009/2029] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:32:51.970528 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b21f8-c575-418b-a254-cd882fc9502c admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:51.980907 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b21f8-c575-418b-a254-cd882fc9502c admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:51.986804 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11348c4e-5a07-4858-afa5-f74e5eadfe52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:51.988817 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11348c4e-5a07-4858-afa5-f74e5eadfe52 admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:51.989179 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11348c4e-5a07-4858-afa5-f74e5eadfe52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:51.989506 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11348c4e-5a07-4858-afa5-f74e5eadfe52 admin admin] PATH_INFO: `/v3/projects/91b87c36c30b4a13b925de1802dc4ea7/users/09e786febe9c4dec9be77961f20a4a51/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:51.991609 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11348c4e-5a07-4858-afa5-f74e5eadfe52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91b87c36c30b4a13b925de1802dc4ea7, user_id=09e786febe9c4dec9be77961f20a4a51, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:51.994267 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11348c4e-5a07-4858-afa5-f74e5eadfe52 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:52.005786 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1021/2030] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:32:51 2022] PUT /identity/v3/projects/91b87c36c30b4a13b925de1802dc4ea7/users/09e786febe9c4dec9be77961f20a4a51/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:32:52.018300 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ed3ff-4c58-4bb1-9184-0b773acfa1f7 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:52.018613 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ed3ff-4c58-4bb1-9184-0b773acfa1f7 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:52.018947 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ed3ff-4c58-4bb1-9184-0b773acfa1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:52.045100 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-e59ed3ff-4c58-4bb1-9184-0b773acfa1f7 None None] MFA Rules not processed for user `09e786febe9c4dec9be77961f20a4a51`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:52.046294 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-e59ed3ff-4c58-4bb1-9184-0b773acfa1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:52.115342 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1010/2031] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:52 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:32:52.127347 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11348c4e-5a07-4858-afa5-f74e5eadfe52 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:52.129074 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-11348c4e-5a07-4858-afa5-f74e5eadfe52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:52.186978 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11348c4e-5a07-4858-afa5-f74e5eadfe52 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:52.190992 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abcd32-8990-4e43-a227-41f6ff018996 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:52.191663 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abcd32-8990-4e43-a227-41f6ff018996 service cinder] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:52.191946 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abcd32-8990-4e43-a227-41f6ff018996 service cinder] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:52.192222 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abcd32-8990-4e43-a227-41f6ff018996 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:52.246778 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52abcd32-8990-4e43-a227-41f6ff018996 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:52.248193 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52abcd32-8990-4e43-a227-41f6ff018996 service cinder] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:52.256893 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1022/2032] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:32:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:32:53.447536 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ed3ff-4c58-4bb1-9184-0b773acfa1f7 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:53.449247 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-e59ed3ff-4c58-4bb1-9184-0b773acfa1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:53.518783 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ed3ff-4c58-4bb1-9184-0b773acfa1f7 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:53.523744 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d9ff6-a158-4380-af10-e2499042d0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:53.524607 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d9ff6-a158-4380-af10-e2499042d0be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:53.524886 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d9ff6-a158-4380-af10-e2499042d0be admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:53.525157 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d9ff6-a158-4380-af10-e2499042d0be admin admin] PATH_INFO: `/v3/users/15ea80a65cbe4394bb9c7d3b73287655` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:53.526349 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d9ff6-a158-4380-af10-e2499042d0be admin admin] RBAC: Authorizing `identity:delete_user(user_id=15ea80a65cbe4394bb9c7d3b73287655)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:53.528293 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d9ff6-a158-4380-af10-e2499042d0be admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:53.574716 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-cc5d9ff6-a158-4380-af10-e2499042d0be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15ea80a65cbe4394bb9c7d3b73287655'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:53.575437 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-cc5d9ff6-a158-4380-af10-e2499042d0be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15ea80a65cbe4394bb9c7d3b73287655'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:53.589828 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-cc5d9ff6-a158-4380-af10-e2499042d0be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15ea80a65cbe4394bb9c7d3b73287655'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:53.598071 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-cc5d9ff6-a158-4380-af10-e2499042d0be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15ea80a65cbe4394bb9c7d3b73287655'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:53.605032 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-cc5d9ff6-a158-4380-af10-e2499042d0be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15ea80a65cbe4394bb9c7d3b73287655'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:53.611937 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1011/2033] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:32:53 2022] DELETE /identity/v3/users/15ea80a65cbe4394bb9c7d3b73287655 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:32:53.752056 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abcd32-8990-4e43-a227-41f6ff018996 service cinder] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:53.753466 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-52abcd32-8990-4e43-a227-41f6ff018996 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:53.765352 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abcd32-8990-4e43-a227-41f6ff018996 service cinder] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:53.814156 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d9ff6-a158-4380-af10-e2499042d0be admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:53.821564 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-cc5d9ff6-a158-4380-af10-e2499042d0be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:53.828061 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b74cd-14a3-4336-8d6c-497fd668fd81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:53.829071 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b74cd-14a3-4336-8d6c-497fd668fd81 service cinder] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:53.829254 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b74cd-14a3-4336-8d6c-497fd668fd81 service cinder] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:53.829562 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b74cd-14a3-4336-8d6c-497fd668fd81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:53.831822 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-ec8b74cd-14a3-4336-8d6c-497fd668fd81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:53.904924 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d9ff6-a158-4380-af10-e2499042d0be admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:53.909724 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76dd32-6cba-4eff-b962-0cf5f2584a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:53.910576 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76dd32-6cba-4eff-b962-0cf5f2584a15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:53.910885 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76dd32-6cba-4eff-b962-0cf5f2584a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:53.911156 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76dd32-6cba-4eff-b962-0cf5f2584a15 admin admin] PATH_INFO: `/v3/projects/16ab7d83969f4e2ea219ab1eb98cf29d` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:53.912329 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f76dd32-6cba-4eff-b962-0cf5f2584a15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16ab7d83969f4e2ea219ab1eb98cf29d)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:53.914220 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f76dd32-6cba-4eff-b962-0cf5f2584a15 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:53.916166 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b74cd-14a3-4336-8d6c-497fd668fd81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:53.917571 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b74cd-14a3-4336-8d6c-497fd668fd81 service cinder] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:53.927045 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1023/2034] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:32:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:32:53.960807 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-4f76dd32-6cba-4eff-b962-0cf5f2584a15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16ab7d83969f4e2ea219ab1eb98cf29d', 'request_id': 'req-4f76dd32-6cba-4eff-b962-0cf5f2584a15'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:53.967019 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-4f76dd32-6cba-4eff-b962-0cf5f2584a15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16ab7d83969f4e2ea219ab1eb98cf29d', 'request_id': 'req-4f76dd32-6cba-4eff-b962-0cf5f2584a15'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:53.973256 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-4f76dd32-6cba-4eff-b962-0cf5f2584a15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16ab7d83969f4e2ea219ab1eb98cf29d', 'request_id': 'req-4f76dd32-6cba-4eff-b962-0cf5f2584a15'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:53.986449 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-4f76dd32-6cba-4eff-b962-0cf5f2584a15 admin admin] The token cache is being invalidate because project 16ab7d83969f4e2ea219ab1eb98cf29d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:32:53.986764 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-4f76dd32-6cba-4eff-b962-0cf5f2584a15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:53.987385 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-4f76dd32-6cba-4eff-b962-0cf5f2584a15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:32:53.988896 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1012/2035] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:32:53 2022] DELETE /identity/v3/projects/16ab7d83969f4e2ea219ab1eb98cf29d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:32:53.994017 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb283efe-dcdb-409a-a156-440e05c94466 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:53.994327 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb283efe-dcdb-409a-a156-440e05c94466 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:53.994640 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb283efe-dcdb-409a-a156-440e05c94466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:54.015012 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-cb283efe-dcdb-409a-a156-440e05c94466 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:54.016216 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-cb283efe-dcdb-409a-a156-440e05c94466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:54.083412 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1024/2036] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:54.092029 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e1df7-5a0f-4c20-a29f-a75cd56bfa6f None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:54.092388 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e1df7-5a0f-4c20-a29f-a75cd56bfa6f None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:54.092753 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e1df7-5a0f-4c20-a29f-a75cd56bfa6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:54.115824 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-9f7e1df7-5a0f-4c20-a29f-a75cd56bfa6f None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:54.117032 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-9f7e1df7-5a0f-4c20-a29f-a75cd56bfa6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:54.127127 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1013/2037] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:32:54.133032 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb283efe-dcdb-409a-a156-440e05c94466 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:54.142981 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb283efe-dcdb-409a-a156-440e05c94466 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:54.148026 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5f0cc-e511-4695-9dfd-b7fe05507286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:54.148686 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5f0cc-e511-4695-9dfd-b7fe05507286 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:54.148968 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5f0cc-e511-4695-9dfd-b7fe05507286 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:54.149240 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5f0cc-e511-4695-9dfd-b7fe05507286 admin admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:54.149987 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e5f0cc-e511-4695-9dfd-b7fe05507286 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:32:54.150291 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e5f0cc-e511-4695-9dfd-b7fe05507286 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:54.151926 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e5f0cc-e511-4695-9dfd-b7fe05507286 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:54.175184 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1025/2038] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:32:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:32:54.179676 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e1df7-5a0f-4c20-a29f-a75cd56bfa6f None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:54.190588 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e1df7-5a0f-4c20-a29f-a75cd56bfa6f None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:54.195608 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3144d9-a642-4951-9aaf-11100b57e854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:54.196295 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3144d9-a642-4951-9aaf-11100b57e854 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:54.196536 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3144d9-a642-4951-9aaf-11100b57e854 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:54.196811 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3144d9-a642-4951-9aaf-11100b57e854 admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:54.197645 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3144d9-a642-4951-9aaf-11100b57e854 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:54.199586 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3144d9-a642-4951-9aaf-11100b57e854 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:54.242643 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1014/2039] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:32:54 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:32:54.244933 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5f0cc-e511-4695-9dfd-b7fe05507286 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:54.259991 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5f0cc-e511-4695-9dfd-b7fe05507286 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:54.347408 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82e5cf-fc3c-44a1-87fc-383ade13eee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:54.348051 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82e5cf-fc3c-44a1-87fc-383ade13eee8 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:54.348386 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82e5cf-fc3c-44a1-87fc-383ade13eee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:54.348589 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82e5cf-fc3c-44a1-87fc-383ade13eee8 admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:54.349432 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f82e5cf-fc3c-44a1-87fc-383ade13eee8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:54.352099 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f82e5cf-fc3c-44a1-87fc-383ade13eee8 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:54.381498 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1026/2040] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:32:54 2022] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:32:54.386118 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3144d9-a642-4951-9aaf-11100b57e854 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:54.397160 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3144d9-a642-4951-9aaf-11100b57e854 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:54.411756 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40018e3-e55f-4f61-a421-33d953c0a71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:54.412704 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40018e3-e55f-4f61-a421-33d953c0a71f admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:54.412982 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40018e3-e55f-4f61-a421-33d953c0a71f admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:54.413255 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40018e3-e55f-4f61-a421-33d953c0a71f admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:54.413980 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40018e3-e55f-4f61-a421-33d953c0a71f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:54.416022 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40018e3-e55f-4f61-a421-33d953c0a71f admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:54.431657 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1015/2041] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:32:54.436066 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82e5cf-fc3c-44a1-87fc-383ade13eee8 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:54.450271 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82e5cf-fc3c-44a1-87fc-383ade13eee8 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:54.460993 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44669337-2b4e-4063-83cf-243a54435209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:54.462142 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44669337-2b4e-4063-83cf-243a54435209 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:54.462808 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44669337-2b4e-4063-83cf-243a54435209 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:54.463167 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44669337-2b4e-4063-83cf-243a54435209 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:54.464092 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44669337-2b4e-4063-83cf-243a54435209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:54.471074 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44669337-2b4e-4063-83cf-243a54435209 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:54.489121 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1027/2042] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:32:54.493467 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40018e3-e55f-4f61-a421-33d953c0a71f admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:54.504961 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40018e3-e55f-4f61-a421-33d953c0a71f admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:54.509779 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d3257-4ddc-41a8-b102-3ff7f149e2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:54.511044 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d3257-4ddc-41a8-b102-3ff7f149e2c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:54.511522 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d3257-4ddc-41a8-b102-3ff7f149e2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:54.511795 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d3257-4ddc-41a8-b102-3ff7f149e2c0 admin admin] PATH_INFO: `/v3/projects/0e38ee9490664305babbb99bd701c980/users/22931c2efeb943e0b8e5c09e7058a594/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:54.529725 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d3257-4ddc-41a8-b102-3ff7f149e2c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e38ee9490664305babbb99bd701c980, user_id=22931c2efeb943e0b8e5c09e7058a594, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:54.533144 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d3257-4ddc-41a8-b102-3ff7f149e2c0 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:54.557607 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1016/2043] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:32:54 2022] PUT /identity/v3/projects/0e38ee9490664305babbb99bd701c980/users/22931c2efeb943e0b8e5c09e7058a594/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:32:54.561476 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44669337-2b4e-4063-83cf-243a54435209 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:54.563323 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-44669337-2b4e-4063-83cf-243a54435209 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:54.567391 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34ec31-9ec8-475a-bc39-b6673e2322e5 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:54.567780 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34ec31-9ec8-475a-bc39-b6673e2322e5 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:54.568056 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34ec31-9ec8-475a-bc39-b6673e2322e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:54.595686 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-9b34ec31-9ec8-475a-bc39-b6673e2322e5 None None] MFA Rules not processed for user `22931c2efeb943e0b8e5c09e7058a594`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:32:54.596824 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-9b34ec31-9ec8-475a-bc39-b6673e2322e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:54.623511 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44669337-2b4e-4063-83cf-243a54435209 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:54.659277 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1017/2044] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:32:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:32:54.670449 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34ec31-9ec8-475a-bc39-b6673e2322e5 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:32:54.671814 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-9b34ec31-9ec8-475a-bc39-b6673e2322e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:54.671927 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076533d-1e11-47f1-895e-358842a4e7b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:54.672660 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076533d-1e11-47f1-895e-358842a4e7b2 service cinder] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:54.672953 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076533d-1e11-47f1-895e-358842a4e7b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:54.673231 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076533d-1e11-47f1-895e-358842a4e7b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:54.675034 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-2076533d-1e11-47f1-895e-358842a4e7b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:32:54.736146 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2076533d-1e11-47f1-895e-358842a4e7b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:54.737568 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2076533d-1e11-47f1-895e-358842a4e7b2 service cinder] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:54.741363 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34ec31-9ec8-475a-bc39-b6673e2322e5 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:32:54.746919 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1028/2045] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:32:54 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:32:54.747139 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480ce8e-969d-4e16-a844-2e0e7d2dff27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec202a34db8e47f4a6c18285245e3f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:32:54.748539 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480ce8e-969d-4e16-a844-2e0e7d2dff27 service nova] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:32:54.749099 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480ce8e-969d-4e16-a844-2e0e7d2dff27 service nova] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:32:54.749385 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480ce8e-969d-4e16-a844-2e0e7d2dff27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:32:54.757435 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0480ce8e-969d-4e16-a844-2e0e7d2dff27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:32:54.759047 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0480ce8e-969d-4e16-a844-2e0e7d2dff27 service nova] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:32:54.767899 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1018/2046] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:32:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:33:02.387946 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b6560-08d2-41ce-a4be-d0dce2290cc2 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:02.389651 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b6560-08d2-41ce-a4be-d0dce2290cc2 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:02.389937 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b6560-08d2-41ce-a4be-d0dce2290cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:02.407409 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-de0b6560-08d2-41ce-a4be-d0dce2290cc2 None None] MFA Rules not processed for user `2c32548c092048afaf0a89eaccdc05cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:02.408595 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-de0b6560-08d2-41ce-a4be-d0dce2290cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:02.463935 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1029/2047] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:33:03.805017 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480ce8e-969d-4e16-a844-2e0e7d2dff27 service nova] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:03.806456 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-0480ce8e-969d-4e16-a844-2e0e7d2dff27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:03.871755 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480ce8e-969d-4e16-a844-2e0e7d2dff27 service nova] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:03.877147 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f72fc4-f9b1-44e0-b25f-4e26f68dac57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:03.878000 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f72fc4-f9b1-44e0-b25f-4e26f68dac57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:03.878277 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f72fc4-f9b1-44e0-b25f-4e26f68dac57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:03.878549 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f72fc4-f9b1-44e0-b25f-4e26f68dac57 admin admin] PATH_INFO: `/v3/users/790cd4b6cc794254bf8d4599f3f9cdef` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:03.879783 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f72fc4-f9b1-44e0-b25f-4e26f68dac57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=790cd4b6cc794254bf8d4599f3f9cdef)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:03.881707 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f72fc4-f9b1-44e0-b25f-4e26f68dac57 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:03.928402 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-58f72fc4-f9b1-44e0-b25f-4e26f68dac57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '790cd4b6cc794254bf8d4599f3f9cdef'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:03.930973 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-58f72fc4-f9b1-44e0-b25f-4e26f68dac57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '790cd4b6cc794254bf8d4599f3f9cdef'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:03.943386 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-58f72fc4-f9b1-44e0-b25f-4e26f68dac57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '790cd4b6cc794254bf8d4599f3f9cdef'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:03.950427 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-58f72fc4-f9b1-44e0-b25f-4e26f68dac57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '790cd4b6cc794254bf8d4599f3f9cdef'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:03.957150 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-58f72fc4-f9b1-44e0-b25f-4e26f68dac57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '790cd4b6cc794254bf8d4599f3f9cdef'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:03.963263 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1019/2048] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:33:03 2022] DELETE /identity/v3/users/790cd4b6cc794254bf8d4599f3f9cdef => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:03.968576 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0dddfc-88f8-4ee9-8499-ab7c0cf2f820 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:03.969407 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0dddfc-88f8-4ee9-8499-ab7c0cf2f820 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:03.969846 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0dddfc-88f8-4ee9-8499-ab7c0cf2f820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:03.989303 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-3d0dddfc-88f8-4ee9-8499-ab7c0cf2f820 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:03.990530 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-3d0dddfc-88f8-4ee9-8499-ab7c0cf2f820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:04.053166 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1030/2049] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:33:04.063874 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f72fc4-f9b1-44e0-b25f-4e26f68dac57 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:04.070338 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-58f72fc4-f9b1-44e0-b25f-4e26f68dac57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:04.136233 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f72fc4-f9b1-44e0-b25f-4e26f68dac57 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:04.140793 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24d8df-2af4-4013-96b1-463bcbde6f8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:04.141850 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24d8df-2af4-4013-96b1-463bcbde6f8d service neutron] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:04.142229 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24d8df-2af4-4013-96b1-463bcbde6f8d service neutron] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:04.142631 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24d8df-2af4-4013-96b1-463bcbde6f8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:04.154351 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24d8df-2af4-4013-96b1-463bcbde6f8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:04.156085 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24d8df-2af4-4013-96b1-463bcbde6f8d service neutron] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:04.167320 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1020/2050] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:33:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:33:04.486997 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0dddfc-88f8-4ee9-8499-ab7c0cf2f820 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:04.488824 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-3d0dddfc-88f8-4ee9-8499-ab7c0cf2f820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:04.505870 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0dddfc-88f8-4ee9-8499-ab7c0cf2f820 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:04.520124 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033fc9e6-b616-4316-919d-887438ccff85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:04.521189 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033fc9e6-b616-4316-919d-887438ccff85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:04.521476 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033fc9e6-b616-4316-919d-887438ccff85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:04.521756 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033fc9e6-b616-4316-919d-887438ccff85 admin admin] PATH_INFO: `/v3/projects/937ab1eb0d164b6091773fbb7980221e` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:04.523071 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033fc9e6-b616-4316-919d-887438ccff85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=937ab1eb0d164b6091773fbb7980221e)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:04.525819 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033fc9e6-b616-4316-919d-887438ccff85 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:04.588708 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-033fc9e6-b616-4316-919d-887438ccff85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '937ab1eb0d164b6091773fbb7980221e', 'request_id': 'req-033fc9e6-b616-4316-919d-887438ccff85'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:04.599238 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-033fc9e6-b616-4316-919d-887438ccff85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '937ab1eb0d164b6091773fbb7980221e', 'request_id': 'req-033fc9e6-b616-4316-919d-887438ccff85'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:04.606927 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-033fc9e6-b616-4316-919d-887438ccff85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '937ab1eb0d164b6091773fbb7980221e', 'request_id': 'req-033fc9e6-b616-4316-919d-887438ccff85'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:04.625702 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-033fc9e6-b616-4316-919d-887438ccff85 admin admin] The token cache is being invalidate because project 937ab1eb0d164b6091773fbb7980221e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:33:04.626242 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-033fc9e6-b616-4316-919d-887438ccff85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:04.627132 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-033fc9e6-b616-4316-919d-887438ccff85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:04.629214 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1031/2051] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:33:04 2022] DELETE /identity/v3/projects/937ab1eb0d164b6091773fbb7980221e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:04.633032 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24d8df-2af4-4013-96b1-463bcbde6f8d service neutron] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:04.644226 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24d8df-2af4-4013-96b1-463bcbde6f8d service neutron] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:04.717883 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5c391-c6cd-4a69-a0c6-7e46c399b222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:04.718771 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5c391-c6cd-4a69-a0c6-7e46c399b222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:04.719055 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5c391-c6cd-4a69-a0c6-7e46c399b222 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:04.719331 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5c391-c6cd-4a69-a0c6-7e46c399b222 admin admin] PATH_INFO: `/v3/users/a8ba896ccf7b46e59e346a42f94c6061` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:04.720568 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb5c391-c6cd-4a69-a0c6-7e46c399b222 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8ba896ccf7b46e59e346a42f94c6061)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:04.722579 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb5c391-c6cd-4a69-a0c6-7e46c399b222 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:04.780767 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-4eb5c391-c6cd-4a69-a0c6-7e46c399b222 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8ba896ccf7b46e59e346a42f94c6061'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:04.781681 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-4eb5c391-c6cd-4a69-a0c6-7e46c399b222 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8ba896ccf7b46e59e346a42f94c6061'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:04.792951 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033fc9e6-b616-4316-919d-887438ccff85 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:04.795828 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-033fc9e6-b616-4316-919d-887438ccff85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:04.797625 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-4eb5c391-c6cd-4a69-a0c6-7e46c399b222 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8ba896ccf7b46e59e346a42f94c6061'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:04.807848 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-4eb5c391-c6cd-4a69-a0c6-7e46c399b222 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8ba896ccf7b46e59e346a42f94c6061'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:04.810661 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033fc9e6-b616-4316-919d-887438ccff85 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:04.815292 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-4eb5c391-c6cd-4a69-a0c6-7e46c399b222 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8ba896ccf7b46e59e346a42f94c6061'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:04.815568 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab3c1f-ea52-4118-a137-05a5c6d60e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:04.816780 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab3c1f-ea52-4118-a137-05a5c6d60e95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:04.817131 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab3c1f-ea52-4118-a137-05a5c6d60e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:04.817467 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab3c1f-ea52-4118-a137-05a5c6d60e95 admin admin] PATH_INFO: `/v3/users/a22ebe575a9b40ad9a8e25522f06e692` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:04.818734 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab3c1f-ea52-4118-a137-05a5c6d60e95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a22ebe575a9b40ad9a8e25522f06e692)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:04.820744 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab3c1f-ea52-4118-a137-05a5c6d60e95 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:04.822350 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1021/2052] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:33:04 2022] DELETE /identity/v3/users/a8ba896ccf7b46e59e346a42f94c6061 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:04.887239 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-90ab3c1f-ea52-4118-a137-05a5c6d60e95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a22ebe575a9b40ad9a8e25522f06e692'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:04.896894 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-90ab3c1f-ea52-4118-a137-05a5c6d60e95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a22ebe575a9b40ad9a8e25522f06e692'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:04.898284 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-90ab3c1f-ea52-4118-a137-05a5c6d60e95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a22ebe575a9b40ad9a8e25522f06e692'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:04.917767 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-90ab3c1f-ea52-4118-a137-05a5c6d60e95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a22ebe575a9b40ad9a8e25522f06e692'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:04.926864 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-90ab3c1f-ea52-4118-a137-05a5c6d60e95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a22ebe575a9b40ad9a8e25522f06e692'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:04.933262 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1032/2053] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:33:04 2022] DELETE /identity/v3/users/a22ebe575a9b40ad9a8e25522f06e692 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:04.937920 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db646688-55cb-47cf-9e0d-09488c9a50bc None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:04.938278 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db646688-55cb-47cf-9e0d-09488c9a50bc None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:04.938771 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db646688-55cb-47cf-9e0d-09488c9a50bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:04.955992 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-db646688-55cb-47cf-9e0d-09488c9a50bc None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:04.957287 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-db646688-55cb-47cf-9e0d-09488c9a50bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:05.027063 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1022/2054] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:33:05.035029 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab3c1f-ea52-4118-a137-05a5c6d60e95 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:05.036448 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-90ab3c1f-ea52-4118-a137-05a5c6d60e95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:05.132348 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab3c1f-ea52-4118-a137-05a5c6d60e95 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:05.136838 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a00a7-1210-4618-a659-131323b74a78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:05.138461 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a00a7-1210-4618-a659-131323b74a78 service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:05.139051 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a00a7-1210-4618-a659-131323b74a78 service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:05.140391 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a00a7-1210-4618-a659-131323b74a78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:05.156256 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a00a7-1210-4618-a659-131323b74a78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:05.158357 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a00a7-1210-4618-a659-131323b74a78 service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:05.165976 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db646688-55cb-47cf-9e0d-09488c9a50bc None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:05.167726 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-db646688-55cb-47cf-9e0d-09488c9a50bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:05.177934 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1033/2055] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:33:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:33:05.192341 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db646688-55cb-47cf-9e0d-09488c9a50bc None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:05.203800 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364dbfcb-62f3-4395-8ce8-3e58086ccbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:05.204671 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364dbfcb-62f3-4395-8ce8-3e58086ccbea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:05.204951 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364dbfcb-62f3-4395-8ce8-3e58086ccbea admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:05.205224 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364dbfcb-62f3-4395-8ce8-3e58086ccbea admin admin] PATH_INFO: `/v3/projects/9f9aa45eb6af405c9699448a43409852` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:05.206424 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364dbfcb-62f3-4395-8ce8-3e58086ccbea admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f9aa45eb6af405c9699448a43409852)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:05.208372 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364dbfcb-62f3-4395-8ce8-3e58086ccbea admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:05.221893 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a00a7-1210-4618-a659-131323b74a78 service neutron] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:05.224039 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-428a00a7-1210-4618-a659-131323b74a78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:05.248243 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a00a7-1210-4618-a659-131323b74a78 service neutron] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:05.256879 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8253006-f109-4d74-ad04-0cb90714c4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:05.257748 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8253006-f109-4d74-ad04-0cb90714c4d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:05.258023 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8253006-f109-4d74-ad04-0cb90714c4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:05.258291 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8253006-f109-4d74-ad04-0cb90714c4d5 admin admin] PATH_INFO: `/v3/users/22931c2efeb943e0b8e5c09e7058a594` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:05.259581 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8253006-f109-4d74-ad04-0cb90714c4d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22931c2efeb943e0b8e5c09e7058a594)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:05.261534 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8253006-f109-4d74-ad04-0cb90714c4d5 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:05.305512 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-364dbfcb-62f3-4395-8ce8-3e58086ccbea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f9aa45eb6af405c9699448a43409852', 'request_id': 'req-364dbfcb-62f3-4395-8ce8-3e58086ccbea'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:05.313071 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-364dbfcb-62f3-4395-8ce8-3e58086ccbea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f9aa45eb6af405c9699448a43409852', 'request_id': 'req-364dbfcb-62f3-4395-8ce8-3e58086ccbea'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:05.322231 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-364dbfcb-62f3-4395-8ce8-3e58086ccbea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f9aa45eb6af405c9699448a43409852', 'request_id': 'req-364dbfcb-62f3-4395-8ce8-3e58086ccbea'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:05.338033 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-a8253006-f109-4d74-ad04-0cb90714c4d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22931c2efeb943e0b8e5c09e7058a594'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:05.343115 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-364dbfcb-62f3-4395-8ce8-3e58086ccbea admin admin] The token cache is being invalidate because project 9f9aa45eb6af405c9699448a43409852 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:33:05.343910 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-364dbfcb-62f3-4395-8ce8-3e58086ccbea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:05.345474 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-364dbfcb-62f3-4395-8ce8-3e58086ccbea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:05.348086 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1023/2056] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:33:05 2022] DELETE /identity/v3/projects/9f9aa45eb6af405c9699448a43409852 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:33:05.352454 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-a8253006-f109-4d74-ad04-0cb90714c4d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22931c2efeb943e0b8e5c09e7058a594'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:05.353168 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364dbfcb-62f3-4395-8ce8-3e58086ccbea admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:05.353809 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-a8253006-f109-4d74-ad04-0cb90714c4d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22931c2efeb943e0b8e5c09e7058a594'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:05.355114 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-364dbfcb-62f3-4395-8ce8-3e58086ccbea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:05.380785 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-a8253006-f109-4d74-ad04-0cb90714c4d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22931c2efeb943e0b8e5c09e7058a594'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:05.389180 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-a8253006-f109-4d74-ad04-0cb90714c4d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22931c2efeb943e0b8e5c09e7058a594'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:05.396078 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1034/2057] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:33:05 2022] DELETE /identity/v3/users/22931c2efeb943e0b8e5c09e7058a594 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:33:05.400342 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8be2b-2f3b-4294-9cea-fd51090ac31e None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:05.400725 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8be2b-2f3b-4294-9cea-fd51090ac31e None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:05.401099 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8be2b-2f3b-4294-9cea-fd51090ac31e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:05.423977 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-9bf8be2b-2f3b-4294-9cea-fd51090ac31e None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:05.425311 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-9bf8be2b-2f3b-4294-9cea-fd51090ac31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:05.458571 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364dbfcb-62f3-4395-8ce8-3e58086ccbea admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:05.533349 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe14d6-bb72-4483-ac00-154d1d90d6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:05.534367 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe14d6-bb72-4483-ac00-154d1d90d6dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:05.534669 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe14d6-bb72-4483-ac00-154d1d90d6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:05.534940 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe14d6-bb72-4483-ac00-154d1d90d6dc admin admin] PATH_INFO: `/v3/users/09e786febe9c4dec9be77961f20a4a51` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:05.536153 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fe14d6-bb72-4483-ac00-154d1d90d6dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=09e786febe9c4dec9be77961f20a4a51)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:05.538199 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fe14d6-bb72-4483-ac00-154d1d90d6dc admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:05.538993 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1035/2058] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:33:05.561435 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf8be2b-2f3b-4294-9cea-fd51090ac31e None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:05.563005 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-9bf8be2b-2f3b-4294-9cea-fd51090ac31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:05.611717 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-78fe14d6-bb72-4483-ac00-154d1d90d6dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09e786febe9c4dec9be77961f20a4a51'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:05.612500 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-78fe14d6-bb72-4483-ac00-154d1d90d6dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09e786febe9c4dec9be77961f20a4a51'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:05.630737 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-78fe14d6-bb72-4483-ac00-154d1d90d6dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09e786febe9c4dec9be77961f20a4a51'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:05.640444 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-78fe14d6-bb72-4483-ac00-154d1d90d6dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09e786febe9c4dec9be77961f20a4a51'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:05.649972 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-78fe14d6-bb72-4483-ac00-154d1d90d6dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09e786febe9c4dec9be77961f20a4a51'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:05.656464 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1024/2059] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:33:05 2022] DELETE /identity/v3/users/09e786febe9c4dec9be77961f20a4a51 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:33:05.656634 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf8be2b-2f3b-4294-9cea-fd51090ac31e None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:05.657599 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe14d6-bb72-4483-ac00-154d1d90d6dc admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:05.659014 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-78fe14d6-bb72-4483-ac00-154d1d90d6dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:05.734890 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d766f77-c9ba-4d18-a3ab-2b0597b6b693 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:05.735921 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d766f77-c9ba-4d18-a3ab-2b0597b6b693 service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:05.736593 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d766f77-c9ba-4d18-a3ab-2b0597b6b693 service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:05.737339 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d766f77-c9ba-4d18-a3ab-2b0597b6b693 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:05.740710 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-0d766f77-c9ba-4d18-a3ab-2b0597b6b693 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:05.744044 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe14d6-bb72-4483-ac00-154d1d90d6dc admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:05.750465 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30768a2c-aac2-4ef2-8b5c-1c327c1778d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:05.751478 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30768a2c-aac2-4ef2-8b5c-1c327c1778d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:05.751763 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30768a2c-aac2-4ef2-8b5c-1c327c1778d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:05.752038 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30768a2c-aac2-4ef2-8b5c-1c327c1778d2 admin admin] PATH_INFO: `/v3/projects/e71c7dc93f794ea2be50a436e7a71bb9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:05.753249 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30768a2c-aac2-4ef2-8b5c-1c327c1778d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e71c7dc93f794ea2be50a436e7a71bb9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:05.755222 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30768a2c-aac2-4ef2-8b5c-1c327c1778d2 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:05.757938 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d766f77-c9ba-4d18-a3ab-2b0597b6b693 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:05.760057 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d766f77-c9ba-4d18-a3ab-2b0597b6b693 service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:05.776132 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1036/2060] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:33:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:33:05.811795 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-30768a2c-aac2-4ef2-8b5c-1c327c1778d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e71c7dc93f794ea2be50a436e7a71bb9', 'request_id': 'req-30768a2c-aac2-4ef2-8b5c-1c327c1778d2'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:05.819068 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-30768a2c-aac2-4ef2-8b5c-1c327c1778d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e71c7dc93f794ea2be50a436e7a71bb9', 'request_id': 'req-30768a2c-aac2-4ef2-8b5c-1c327c1778d2'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:05.833844 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-30768a2c-aac2-4ef2-8b5c-1c327c1778d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e71c7dc93f794ea2be50a436e7a71bb9', 'request_id': 'req-30768a2c-aac2-4ef2-8b5c-1c327c1778d2'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:05.850032 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-30768a2c-aac2-4ef2-8b5c-1c327c1778d2 admin admin] The token cache is being invalidate because project e71c7dc93f794ea2be50a436e7a71bb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:33:05.850733 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-30768a2c-aac2-4ef2-8b5c-1c327c1778d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:05.851605 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-30768a2c-aac2-4ef2-8b5c-1c327c1778d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:05.853828 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1025/2061] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:33:05 2022] DELETE /identity/v3/projects/e71c7dc93f794ea2be50a436e7a71bb9 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:05.859380 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d766f77-c9ba-4d18-a3ab-2b0597b6b693 service neutron] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:05.870713 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d766f77-c9ba-4d18-a3ab-2b0597b6b693 service neutron] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:05.959921 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b09394-8ec3-4246-b883-1ba1a4f8108d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:05.961155 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b09394-8ec3-4246-b883-1ba1a4f8108d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:05.961422 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b09394-8ec3-4246-b883-1ba1a4f8108d admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:05.961693 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b09394-8ec3-4246-b883-1ba1a4f8108d admin admin] PATH_INFO: `/v3/users/86dee824a08d4481b82641885aea91c0` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:05.963233 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b09394-8ec3-4246-b883-1ba1a4f8108d admin admin] RBAC: Authorizing `identity:delete_user(user_id=86dee824a08d4481b82641885aea91c0)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:05.965382 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b09394-8ec3-4246-b883-1ba1a4f8108d admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:06.026071 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-71b09394-8ec3-4246-b883-1ba1a4f8108d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86dee824a08d4481b82641885aea91c0'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:06.038289 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-71b09394-8ec3-4246-b883-1ba1a4f8108d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86dee824a08d4481b82641885aea91c0'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:06.039150 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-71b09394-8ec3-4246-b883-1ba1a4f8108d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86dee824a08d4481b82641885aea91c0'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:06.057965 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-71b09394-8ec3-4246-b883-1ba1a4f8108d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86dee824a08d4481b82641885aea91c0'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:06.065065 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-71b09394-8ec3-4246-b883-1ba1a4f8108d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86dee824a08d4481b82641885aea91c0'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:06.071610 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1037/2062] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:33:05 2022] DELETE /identity/v3/users/86dee824a08d4481b82641885aea91c0 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:06.178322 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30768a2c-aac2-4ef2-8b5c-1c327c1778d2 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:06.179809 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-30768a2c-aac2-4ef2-8b5c-1c327c1778d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:06.199602 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30768a2c-aac2-4ef2-8b5c-1c327c1778d2 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:06.285410 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b09394-8ec3-4246-b883-1ba1a4f8108d admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:06.287467 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-71b09394-8ec3-4246-b883-1ba1a4f8108d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:06.312253 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335fc8d-b5c5-492e-817e-275bc0bfdb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:06.315316 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335fc8d-b5c5-492e-817e-275bc0bfdb12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:06.315603 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335fc8d-b5c5-492e-817e-275bc0bfdb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:06.315890 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335fc8d-b5c5-492e-817e-275bc0bfdb12 admin admin] PATH_INFO: `/v3/projects/0e38ee9490664305babbb99bd701c980` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:06.317417 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e335fc8d-b5c5-492e-817e-275bc0bfdb12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e38ee9490664305babbb99bd701c980)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:06.319874 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e335fc8d-b5c5-492e-817e-275bc0bfdb12 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:06.381684 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-e335fc8d-b5c5-492e-817e-275bc0bfdb12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e38ee9490664305babbb99bd701c980', 'request_id': 'req-e335fc8d-b5c5-492e-817e-275bc0bfdb12'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:06.389730 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-e335fc8d-b5c5-492e-817e-275bc0bfdb12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e38ee9490664305babbb99bd701c980', 'request_id': 'req-e335fc8d-b5c5-492e-817e-275bc0bfdb12'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:06.397869 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-e335fc8d-b5c5-492e-817e-275bc0bfdb12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e38ee9490664305babbb99bd701c980', 'request_id': 'req-e335fc8d-b5c5-492e-817e-275bc0bfdb12'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:06.402112 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b09394-8ec3-4246-b883-1ba1a4f8108d admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:06.416447 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-e335fc8d-b5c5-492e-817e-275bc0bfdb12 admin admin] The token cache is being invalidate because project 0e38ee9490664305babbb99bd701c980 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:33:06.417307 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-e335fc8d-b5c5-492e-817e-275bc0bfdb12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:06.418655 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-e335fc8d-b5c5-492e-817e-275bc0bfdb12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:06.420941 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1026/2063] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:33:06 2022] DELETE /identity/v3/projects/0e38ee9490664305babbb99bd701c980 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:06.426415 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acad2f9-2995-4e50-9762-b042445f3fbe None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:06.426784 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acad2f9-2995-4e50-9762-b042445f3fbe None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:06.427386 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acad2f9-2995-4e50-9762-b042445f3fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:06.448562 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-8acad2f9-2995-4e50-9762-b042445f3fbe None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:06.450900 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-8acad2f9-2995-4e50-9762-b042445f3fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:06.486476 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5d5b1-6567-4304-8238-b99674ac6db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:06.487628 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5d5b1-6567-4304-8238-b99674ac6db1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:06.487904 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5d5b1-6567-4304-8238-b99674ac6db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:06.488176 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5d5b1-6567-4304-8238-b99674ac6db1 admin admin] PATH_INFO: `/v3/projects/91b87c36c30b4a13b925de1802dc4ea7` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:06.489388 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca5d5b1-6567-4304-8238-b99674ac6db1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91b87c36c30b4a13b925de1802dc4ea7)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:06.491326 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca5d5b1-6567-4304-8238-b99674ac6db1 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:06.527477 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1027/2064] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:33:06.529037 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acad2f9-2995-4e50-9762-b042445f3fbe None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:06.536089 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-8acad2f9-2995-4e50-9762-b042445f3fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:06.554699 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acad2f9-2995-4e50-9762-b042445f3fbe None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:06.560025 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fdbe81-4513-4ac6-9d82-33285906efae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:06.560885 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdbe81-4513-4ac6-9d82-33285906efae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:06.561299 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdbe81-4513-4ac6-9d82-33285906efae admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:06.561582 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdbe81-4513-4ac6-9d82-33285906efae admin admin] PATH_INFO: `/v3/projects/e1e023f6d9e84b47a23113d6eec63ecb` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:06.563404 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fdbe81-4513-4ac6-9d82-33285906efae admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1e023f6d9e84b47a23113d6eec63ecb)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:06.565706 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fdbe81-4513-4ac6-9d82-33285906efae admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:06.587314 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-2ca5d5b1-6567-4304-8238-b99674ac6db1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91b87c36c30b4a13b925de1802dc4ea7', 'request_id': 'req-2ca5d5b1-6567-4304-8238-b99674ac6db1'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:06.595938 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-2ca5d5b1-6567-4304-8238-b99674ac6db1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91b87c36c30b4a13b925de1802dc4ea7', 'request_id': 'req-2ca5d5b1-6567-4304-8238-b99674ac6db1'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:06.602334 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-2ca5d5b1-6567-4304-8238-b99674ac6db1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91b87c36c30b4a13b925de1802dc4ea7', 'request_id': 'req-2ca5d5b1-6567-4304-8238-b99674ac6db1'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:06.617077 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-2ca5d5b1-6567-4304-8238-b99674ac6db1 admin admin] The token cache is being invalidate because project 91b87c36c30b4a13b925de1802dc4ea7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:33:06.617821 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-2ca5d5b1-6567-4304-8238-b99674ac6db1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:06.618714 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-2ca5d5b1-6567-4304-8238-b99674ac6db1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:06.620779 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1038/2065] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:33:06 2022] DELETE /identity/v3/projects/91b87c36c30b4a13b925de1802dc4ea7 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:06.621968 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177fab98-4be7-417c-a3ab-c0cb6876c97f None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:06.623490 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177fab98-4be7-417c-a3ab-c0cb6876c97f None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:06.623771 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177fab98-4be7-417c-a3ab-c0cb6876c97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:06.633599 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-26fdbe81-4513-4ac6-9d82-33285906efae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1e023f6d9e84b47a23113d6eec63ecb', 'request_id': 'req-26fdbe81-4513-4ac6-9d82-33285906efae'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:06.639375 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-26fdbe81-4513-4ac6-9d82-33285906efae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1e023f6d9e84b47a23113d6eec63ecb', 'request_id': 'req-26fdbe81-4513-4ac6-9d82-33285906efae'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:06.645676 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-26fdbe81-4513-4ac6-9d82-33285906efae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1e023f6d9e84b47a23113d6eec63ecb', 'request_id': 'req-26fdbe81-4513-4ac6-9d82-33285906efae'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:06.646413 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-177fab98-4be7-417c-a3ab-c0cb6876c97f None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:06.647671 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-177fab98-4be7-417c-a3ab-c0cb6876c97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:06.660834 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-26fdbe81-4513-4ac6-9d82-33285906efae admin admin] The token cache is being invalidate because project e1e023f6d9e84b47a23113d6eec63ecb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:33:06.661115 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-26fdbe81-4513-4ac6-9d82-33285906efae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:06.661964 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-26fdbe81-4513-4ac6-9d82-33285906efae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:06.663683 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1028/2066] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:33:06 2022] DELETE /identity/v3/projects/e1e023f6d9e84b47a23113d6eec63ecb => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:06.664912 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701c38b-7b2d-4c3e-bc5c-b4205786b092 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:06.665200 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701c38b-7b2d-4c3e-bc5c-b4205786b092 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:06.665473 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701c38b-7b2d-4c3e-bc5c-b4205786b092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:06.686560 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-c701c38b-7b2d-4c3e-bc5c-b4205786b092 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:06.687987 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-c701c38b-7b2d-4c3e-bc5c-b4205786b092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:06.722918 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1039/2067] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:33:06.724462 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce51989-72e0-432c-b965-ca1078514711 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:06.724811 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce51989-72e0-432c-b965-ca1078514711 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:06.725135 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce51989-72e0-432c-b965-ca1078514711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:06.749343 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-fce51989-72e0-432c-b965-ca1078514711 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:06.750564 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-fce51989-72e0-432c-b965-ca1078514711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:06.751660 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1029/2068] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:33:06.755562 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c701c38b-7b2d-4c3e-bc5c-b4205786b092 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:06.759969 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1040/2069] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:33:06.761121 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e29d5c-e9fb-4413-bc63-df636a370937 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:06.761403 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e29d5c-e9fb-4413-bc63-df636a370937 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:06.761677 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e29d5c-e9fb-4413-bc63-df636a370937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:06.768437 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c701c38b-7b2d-4c3e-bc5c-b4205786b092 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:06.773766 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c61b802-4230-4291-ac7a-966c9bd0d476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:06.774564 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61b802-4230-4291-ac7a-966c9bd0d476 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:06.775157 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61b802-4230-4291-ac7a-966c9bd0d476 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:06.775543 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61b802-4230-4291-ac7a-966c9bd0d476 admin admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:06.776275 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c61b802-4230-4291-ac7a-966c9bd0d476 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:33:06.776683 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c61b802-4230-4291-ac7a-966c9bd0d476 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:06.779585 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c61b802-4230-4291-ac7a-966c9bd0d476 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:06.796096 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1030/2070] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:33:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:33:06.796260 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-37e29d5c-e9fb-4413-bc63-df636a370937 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:06.796371 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3519f-0069-4ce0-bcac-655c7a108c93 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:06.796371 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3519f-0069-4ce0-bcac-655c7a108c93 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:06.796530 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-37e29d5c-e9fb-4413-bc63-df636a370937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:06.796622 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3519f-0069-4ce0-bcac-655c7a108c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:06.803523 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1041/2071] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:33:06.804401 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e29d5c-e9fb-4413-bc63-df636a370937 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:06.814475 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e29d5c-e9fb-4413-bc63-df636a370937 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:06.819351 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-34f3519f-0069-4ce0-bcac-655c7a108c93 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:06.820477 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-34f3519f-0069-4ce0-bcac-655c7a108c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:06.820597 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda60430-04f8-4813-b7d2-0bf3fbd4200f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:06.821429 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda60430-04f8-4813-b7d2-0bf3fbd4200f admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:06.821717 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda60430-04f8-4813-b7d2-0bf3fbd4200f admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:06.821995 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda60430-04f8-4813-b7d2-0bf3fbd4200f admin admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:06.822803 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda60430-04f8-4813-b7d2-0bf3fbd4200f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:06.824709 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda60430-04f8-4813-b7d2-0bf3fbd4200f admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:06.829504 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1031/2072] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:33:06.830464 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3519f-0069-4ce0-bcac-655c7a108c93 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:06.842321 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3519f-0069-4ce0-bcac-655c7a108c93 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:06.851445 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727adce3-f0f6-4367-ae0a-689fabec5238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:06.852243 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727adce3-f0f6-4367-ae0a-689fabec5238 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:06.852581 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727adce3-f0f6-4367-ae0a-689fabec5238 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:06.853090 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727adce3-f0f6-4367-ae0a-689fabec5238 admin admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:06.853271 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1042/2073] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:33:06 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:33:06.854170 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda60430-04f8-4813-b7d2-0bf3fbd4200f admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:06.854479 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727adce3-f0f6-4367-ae0a-689fabec5238 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:33:06.855004 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727adce3-f0f6-4367-ae0a-689fabec5238 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:06.858379 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727adce3-f0f6-4367-ae0a-689fabec5238 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:06.871278 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1032/2074] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:33:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:33:06.873016 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727adce3-f0f6-4367-ae0a-689fabec5238 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:06.883477 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727adce3-f0f6-4367-ae0a-689fabec5238 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:06.932456 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda60430-04f8-4813-b7d2-0bf3fbd4200f admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:06.938106 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2784581-d805-49a9-a825-fc654340149d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:06.938881 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2784581-d805-49a9-a825-fc654340149d admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:06.939170 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2784581-d805-49a9-a825-fc654340149d admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:06.939447 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2784581-d805-49a9-a825-fc654340149d admin admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:06.940164 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2784581-d805-49a9-a825-fc654340149d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:33:06.940470 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2784581-d805-49a9-a825-fc654340149d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:06.942532 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2784581-d805-49a9-a825-fc654340149d admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:06.942680 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0834f-fdb8-446e-9389-9f29f5761a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:06.943123 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0834f-fdb8-446e-9389-9f29f5761a3c admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:06.943518 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0834f-fdb8-446e-9389-9f29f5761a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:06.943802 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0834f-fdb8-446e-9389-9f29f5761a3c admin admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:06.944724 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e0834f-fdb8-446e-9389-9f29f5761a3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:06.946322 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e0834f-fdb8-446e-9389-9f29f5761a3c admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:06.953907 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1043/2075] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:33:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:33:06.957894 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2784581-d805-49a9-a825-fc654340149d admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:06.968762 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1033/2076] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:33:06 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:33:06.969951 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0834f-fdb8-446e-9389-9f29f5761a3c admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:06.971888 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2784581-d805-49a9-a825-fc654340149d admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:06.977029 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf4742-6196-4c47-a9b4-1fcbc6e8fb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:06.978265 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf4742-6196-4c47-a9b4-1fcbc6e8fb20 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:06.978265 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf4742-6196-4c47-a9b4-1fcbc6e8fb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:06.978469 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf4742-6196-4c47-a9b4-1fcbc6e8fb20 admin admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:06.979249 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf4742-6196-4c47-a9b4-1fcbc6e8fb20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:06.981138 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf4742-6196-4c47-a9b4-1fcbc6e8fb20 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:06.982384 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0834f-fdb8-446e-9389-9f29f5761a3c admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:06.987567 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6059f6-d098-4d3c-91aa-00f9c06e097d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:06.988238 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6059f6-d098-4d3c-91aa-00f9c06e097d admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:06.988517 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6059f6-d098-4d3c-91aa-00f9c06e097d admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:06.988789 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6059f6-d098-4d3c-91aa-00f9c06e097d admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:06.989469 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6059f6-d098-4d3c-91aa-00f9c06e097d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:06.991816 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6059f6-d098-4d3c-91aa-00f9c06e097d admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:07.012432 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1044/2077] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:33:06 2022] POST /identity/v3/projects => generated 369 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:33:07.013393 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf4742-6196-4c47-a9b4-1fcbc6e8fb20 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:07.022544 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1034/2078] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:33:06 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:33:07.023589 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6059f6-d098-4d3c-91aa-00f9c06e097d admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:07.084055 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf4742-6196-4c47-a9b4-1fcbc6e8fb20 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:07.089228 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6059f6-d098-4d3c-91aa-00f9c06e097d admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:07.089361 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81c028-6773-4ed8-9113-e016e4513e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:07.090038 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81c028-6773-4ed8-9113-e016e4513e87 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:07.090385 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81c028-6773-4ed8-9113-e016e4513e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:07.090785 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81c028-6773-4ed8-9113-e016e4513e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:07.091596 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df81c028-6773-4ed8-9113-e016e4513e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:07.093359 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df81c028-6773-4ed8-9113-e016e4513e87 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:07.094905 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af050ed8-4538-4500-8129-95f6071ae243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:07.095566 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af050ed8-4538-4500-8129-95f6071ae243 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:07.095847 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af050ed8-4538-4500-8129-95f6071ae243 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:07.096121 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af050ed8-4538-4500-8129-95f6071ae243 admin admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:07.096812 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af050ed8-4538-4500-8129-95f6071ae243 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:07.098724 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af050ed8-4538-4500-8129-95f6071ae243 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:07.104303 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1045/2079] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:33:07.105147 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81c028-6773-4ed8-9113-e016e4513e87 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:07.114983 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81c028-6773-4ed8-9113-e016e4513e87 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:07.119732 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536c9d8-3363-499e-ae61-b02caeb89aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:07.123711 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536c9d8-3363-499e-ae61-b02caeb89aac admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:07.123711 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536c9d8-3363-499e-ae61-b02caeb89aac admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:07.123938 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1035/2080] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:33:07 2022] POST /identity/v3/users => generated 285 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:33:07.124022 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536c9d8-3363-499e-ae61-b02caeb89aac admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:07.124103 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af050ed8-4538-4500-8129-95f6071ae243 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:07.124177 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a536c9d8-3363-499e-ae61-b02caeb89aac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:07.125051 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a536c9d8-3363-499e-ae61-b02caeb89aac admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:07.135233 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af050ed8-4538-4500-8129-95f6071ae243 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:07.140649 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b82b9d-8797-43af-bd6f-b674ff56ff47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:07.141288 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b82b9d-8797-43af-bd6f-b674ff56ff47 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:07.141568 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b82b9d-8797-43af-bd6f-b674ff56ff47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:07.141846 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b82b9d-8797-43af-bd6f-b674ff56ff47 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:07.142564 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b82b9d-8797-43af-bd6f-b674ff56ff47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:07.144180 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b82b9d-8797-43af-bd6f-b674ff56ff47 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:07.148742 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1046/2081] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:33:07 2022] POST /identity/v3/users => generated 290 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:33:07.148742 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536c9d8-3363-499e-ae61-b02caeb89aac admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:07.158061 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1036/2082] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:33:07.158061 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b82b9d-8797-43af-bd6f-b674ff56ff47 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:07.160152 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536c9d8-3363-499e-ae61-b02caeb89aac admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:07.166465 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed8968-bd42-4f37-8865-90abc49cafe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:07.167210 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed8968-bd42-4f37-8865-90abc49cafe4 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:07.167546 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed8968-bd42-4f37-8865-90abc49cafe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:07.167817 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b82b9d-8797-43af-bd6f-b674ff56ff47 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:07.167940 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed8968-bd42-4f37-8865-90abc49cafe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:07.168538 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed8968-bd42-4f37-8865-90abc49cafe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:07.171181 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed8968-bd42-4f37-8865-90abc49cafe4 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:07.173551 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e488d-0777-4679-aa0d-7e1b589d9bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:07.174206 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e488d-0777-4679-aa0d-7e1b589d9bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:07.174492 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e488d-0777-4679-aa0d-7e1b589d9bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:07.174805 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e488d-0777-4679-aa0d-7e1b589d9bb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:07.175523 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e488d-0777-4679-aa0d-7e1b589d9bb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:07.177105 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e488d-0777-4679-aa0d-7e1b589d9bb9 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:07.181744 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1047/2083] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:33:07.182624 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed8968-bd42-4f37-8865-90abc49cafe4 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:07.188156 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1037/2084] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:33:07.188156 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e488d-0777-4679-aa0d-7e1b589d9bb9 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:07.195667 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed8968-bd42-4f37-8865-90abc49cafe4 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:07.197823 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e488d-0777-4679-aa0d-7e1b589d9bb9 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:07.200750 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579e58a-1642-4d0a-b801-a392ec16203d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:07.201631 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579e58a-1642-4d0a-b801-a392ec16203d admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:07.202047 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579e58a-1642-4d0a-b801-a392ec16203d admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:07.202330 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579e58a-1642-4d0a-b801-a392ec16203d admin admin] PATH_INFO: `/v3/projects/0b073443c9ea4de8a48a589cf86daa3f/users/6e83bdc0cdbb4301a2fd596f7900f8d8/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:07.202764 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515113b-4465-47be-b7f5-d4316c7a5ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:07.203409 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515113b-4465-47be-b7f5-d4316c7a5ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:07.203692 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515113b-4465-47be-b7f5-d4316c7a5ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:07.203963 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515113b-4465-47be-b7f5-d4316c7a5ce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:07.204689 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a515113b-4465-47be-b7f5-d4316c7a5ce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:07.206251 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a515113b-4465-47be-b7f5-d4316c7a5ce6 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:07.217873 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1038/2085] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:33:07.218735 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515113b-4465-47be-b7f5-d4316c7a5ce6 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:07.222276 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8579e58a-1642-4d0a-b801-a392ec16203d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b073443c9ea4de8a48a589cf86daa3f, user_id=6e83bdc0cdbb4301a2fd596f7900f8d8, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:07.224987 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8579e58a-1642-4d0a-b801-a392ec16203d admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:07.228198 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515113b-4465-47be-b7f5-d4316c7a5ce6 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:07.234802 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1004936-716b-4772-8903-866a0c620ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:07.235516 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1004936-716b-4772-8903-866a0c620ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:07.235756 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1004936-716b-4772-8903-866a0c620ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:07.236021 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1004936-716b-4772-8903-866a0c620ee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:07.236735 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1004936-716b-4772-8903-866a0c620ee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:07.238310 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1004936-716b-4772-8903-866a0c620ee3 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:07.241039 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1048/2086] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:33:07 2022] PUT /identity/v3/projects/0b073443c9ea4de8a48a589cf86daa3f/users/6e83bdc0cdbb4301a2fd596f7900f8d8/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:07.242208 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579e58a-1642-4d0a-b801-a392ec16203d admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:07.250290 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1039/2087] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:33:07.252406 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41755024-0317-4f1e-90f9-25d56f14b277 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:07.252702 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41755024-0317-4f1e-90f9-25d56f14b277 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:07.253071 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41755024-0317-4f1e-90f9-25d56f14b277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:07.281383 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-41755024-0317-4f1e-90f9-25d56f14b277 None None] MFA Rules not processed for user `6e83bdc0cdbb4301a2fd596f7900f8d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:07.282655 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-41755024-0317-4f1e-90f9-25d56f14b277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:07.319399 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579e58a-1642-4d0a-b801-a392ec16203d admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:07.324084 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3bb72-afa8-45ef-9014-ff5adfffaf8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:07.324960 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3bb72-afa8-45ef-9014-ff5adfffaf8a admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:07.325409 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3bb72-afa8-45ef-9014-ff5adfffaf8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:07.326213 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3bb72-afa8-45ef-9014-ff5adfffaf8a admin admin] PATH_INFO: `/v3/projects/6cf4ea175d3c4c7fb2f4fca8aaebb163/users/d1caf03a51b043f0b10bc7993127ce9a/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:07.342991 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c3bb72-afa8-45ef-9014-ff5adfffaf8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cf4ea175d3c4c7fb2f4fca8aaebb163, user_id=d1caf03a51b043f0b10bc7993127ce9a, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:07.345655 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c3bb72-afa8-45ef-9014-ff5adfffaf8a admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:07.359793 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1040/2088] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:33:07.360709 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41755024-0317-4f1e-90f9-25d56f14b277 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:07.374566 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1049/2089] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:33:07 2022] PUT /identity/v3/projects/6cf4ea175d3c4c7fb2f4fca8aaebb163/users/d1caf03a51b043f0b10bc7993127ce9a/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:07.374566 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3bb72-afa8-45ef-9014-ff5adfffaf8a admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:07.374860 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41755024-0317-4f1e-90f9-25d56f14b277 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:07.436744 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa622272-5bcb-4306-9095-5fc50dd453c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:07.437925 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa622272-5bcb-4306-9095-5fc50dd453c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:07.438312 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa622272-5bcb-4306-9095-5fc50dd453c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:07.438851 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa622272-5bcb-4306-9095-5fc50dd453c3 admin admin] PATH_INFO: `/v3/projects/28e9cb5652594a33935ee545a2e315c6/users/e77233e4c14647c6babae0ae41be3fc1/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:07.447864 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3bb72-afa8-45ef-9014-ff5adfffaf8a admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:07.453044 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807dc6e5-d646-4c26-ae9a-0be2f7c814ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:07.453707 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807dc6e5-d646-4c26-ae9a-0be2f7c814ab admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:07.453993 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807dc6e5-d646-4c26-ae9a-0be2f7c814ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:07.454264 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807dc6e5-d646-4c26-ae9a-0be2f7c814ab admin admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:07.454996 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807dc6e5-d646-4c26-ae9a-0be2f7c814ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:07.456883 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa622272-5bcb-4306-9095-5fc50dd453c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28e9cb5652594a33935ee545a2e315c6, user_id=e77233e4c14647c6babae0ae41be3fc1, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:07.457023 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807dc6e5-d646-4c26-ae9a-0be2f7c814ab admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:07.459911 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa622272-5bcb-4306-9095-5fc50dd453c3 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:07.475591 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1041/2090] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:33:07 2022] PUT /identity/v3/projects/28e9cb5652594a33935ee545a2e315c6/users/e77233e4c14647c6babae0ae41be3fc1/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:07.476979 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a73e40-fc81-49bf-909a-20c6149b52f4 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:07.478026 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a73e40-fc81-49bf-909a-20c6149b52f4 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:07.478840 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a73e40-fc81-49bf-909a-20c6149b52f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:07.490801 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1050/2091] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:33:07 2022] POST /identity/v3/projects => generated 381 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:33:07.492126 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759049f4-a61a-4046-9c76-b4bd6c19adff None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:07.492448 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759049f4-a61a-4046-9c76-b4bd6c19adff None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:07.492725 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759049f4-a61a-4046-9c76-b4bd6c19adff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:07.518496 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-d4a73e40-fc81-49bf-909a-20c6149b52f4 None None] MFA Rules not processed for user `d1caf03a51b043f0b10bc7993127ce9a`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:07.521631 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-d4a73e40-fc81-49bf-909a-20c6149b52f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:07.525290 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-759049f4-a61a-4046-9c76-b4bd6c19adff None None] MFA Rules not processed for user `e77233e4c14647c6babae0ae41be3fc1`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:07.526246 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-759049f4-a61a-4046-9c76-b4bd6c19adff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:07.593450 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1042/2092] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:07 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:33:07.594321 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a73e40-fc81-49bf-909a-20c6149b52f4 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:07.595766 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1051/2093] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:33:07.600013 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759049f4-a61a-4046-9c76-b4bd6c19adff None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:07.660759 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a73e40-fc81-49bf-909a-20c6149b52f4 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:07.662328 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759049f4-a61a-4046-9c76-b4bd6c19adff None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:07.665279 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9817a-2c91-4dbd-b199-569e970b1946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:07.665930 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9817a-2c91-4dbd-b199-569e970b1946 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:07.666206 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9817a-2c91-4dbd-b199-569e970b1946 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:07.666476 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9817a-2c91-4dbd-b199-569e970b1946 admin admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:07.667026 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573085ae-e594-4ff0-a349-699d849181a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:07.667203 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9817a-2c91-4dbd-b199-569e970b1946 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:07.667874 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573085ae-e594-4ff0-a349-699d849181a6 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:07.668046 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573085ae-e594-4ff0-a349-699d849181a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:07.668312 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573085ae-e594-4ff0-a349-699d849181a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:07.669212 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573085ae-e594-4ff0-a349-699d849181a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:07.669651 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9817a-2c91-4dbd-b199-569e970b1946 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:07.671092 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573085ae-e594-4ff0-a349-699d849181a6 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:07.690864 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1043/2094] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:33:07 2022] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:33:07.691670 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9817a-2c91-4dbd-b199-569e970b1946 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:07.694815 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-0cd9817a-2c91-4dbd-b199-569e970b1946 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:07.696669 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1052/2095] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:33:07 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:33:07.697567 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573085ae-e594-4ff0-a349-699d849181a6 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:07.753915 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9817a-2c91-4dbd-b199-569e970b1946 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:07.757520 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573085ae-e594-4ff0-a349-699d849181a6 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:07.762263 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5370ed8f-5e1e-42b5-9929-2176cf5a1af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:07.763495 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370ed8f-5e1e-42b5-9929-2176cf5a1af0 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:07.763772 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370ed8f-5e1e-42b5-9929-2176cf5a1af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:07.764047 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370ed8f-5e1e-42b5-9929-2176cf5a1af0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:07.764757 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5370ed8f-5e1e-42b5-9929-2176cf5a1af0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:07.766320 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5370ed8f-5e1e-42b5-9929-2176cf5a1af0 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:07.775862 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1053/2096] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:33:07.776633 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5370ed8f-5e1e-42b5-9929-2176cf5a1af0 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:07.786225 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5370ed8f-5e1e-42b5-9929-2176cf5a1af0 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:07.790827 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bbe4e7-ec9c-43be-8147-97fcc4d55418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:07.791451 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bbe4e7-ec9c-43be-8147-97fcc4d55418 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:07.791733 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bbe4e7-ec9c-43be-8147-97fcc4d55418 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:07.792009 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bbe4e7-ec9c-43be-8147-97fcc4d55418 admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:07.792677 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bbe4e7-ec9c-43be-8147-97fcc4d55418 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:07.794648 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bbe4e7-ec9c-43be-8147-97fcc4d55418 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:07.801655 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b247303-d636-4bdb-8532-792e2c36400e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99b63b9b6e44219921569db1bf2e0dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:07.802290 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b247303-d636-4bdb-8532-792e2c36400e service glance] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:07.802566 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b247303-d636-4bdb-8532-792e2c36400e service glance] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:07.802863 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b247303-d636-4bdb-8532-792e2c36400e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:07.814587 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1054/2097] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:33:07 2022] POST /identity/v3/users => generated 297 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:33:07.816767 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bbe4e7-ec9c-43be-8147-97fcc4d55418 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:07.827690 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bbe4e7-ec9c-43be-8147-97fcc4d55418 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:07.832587 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f816c-2dd8-463d-b4f9-609accd5a856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:07.833512 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f816c-2dd8-463d-b4f9-609accd5a856 admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:07.833799 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f816c-2dd8-463d-b4f9-609accd5a856 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:07.834095 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f816c-2dd8-463d-b4f9-609accd5a856 admin admin] PATH_INFO: `/v3/projects/3bd61756df1345b79d186640f4c59492/users/31ab28b534d0420fb54c5023c40190d3/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:07.857888 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f816c-2dd8-463d-b4f9-609accd5a856 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bd61756df1345b79d186640f4c59492, user_id=31ab28b534d0420fb54c5023c40190d3, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:07.860750 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f816c-2dd8-463d-b4f9-609accd5a856 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:07.869629 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b247303-d636-4bdb-8532-792e2c36400e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:07.871181 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b247303-d636-4bdb-8532-792e2c36400e service glance] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:07.874708 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1055/2098] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:33:07 2022] PUT /identity/v3/projects/3bd61756df1345b79d186640f4c59492/users/31ab28b534d0420fb54c5023c40190d3/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:07.875688 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f816c-2dd8-463d-b4f9-609accd5a856 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:07.883826 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1044/2099] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:33:07 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:33:07.884661 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b247303-d636-4bdb-8532-792e2c36400e service glance] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:07.895568 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b247303-d636-4bdb-8532-792e2c36400e service glance] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:07.967203 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f816c-2dd8-463d-b4f9-609accd5a856 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:07.976113 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb23c0-bcb1-43a9-818c-2eeb4818b44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:07.976832 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb23c0-bcb1-43a9-818c-2eeb4818b44f admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:07.977119 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb23c0-bcb1-43a9-818c-2eeb4818b44f admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:07.977658 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb23c0-bcb1-43a9-818c-2eeb4818b44f admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:07.977951 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71be64-e7d5-41d5-b4bc-190e8fc5a674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:07.978497 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb23c0-bcb1-43a9-818c-2eeb4818b44f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:07.980336 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb23c0-bcb1-43a9-818c-2eeb4818b44f admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:07.982180 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71be64-e7d5-41d5-b4bc-190e8fc5a674 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:07.982334 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71be64-e7d5-41d5-b4bc-190e8fc5a674 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:07.982645 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71be64-e7d5-41d5-b4bc-190e8fc5a674 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:07.983403 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa71be64-e7d5-41d5-b4bc-190e8fc5a674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:07.989803 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa71be64-e7d5-41d5-b4bc-190e8fc5a674 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:07.992954 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1045/2100] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:33:07.998266 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb23c0-bcb1-43a9-818c-2eeb4818b44f admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:08.009815 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1056/2101] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:33:08.013436 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71be64-e7d5-41d5-b4bc-190e8fc5a674 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:08.014379 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb23c0-bcb1-43a9-818c-2eeb4818b44f admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:08.021495 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39767d0a-f39a-4e06-9f76-5ee28b0e1c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:08.022437 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39767d0a-f39a-4e06-9f76-5ee28b0e1c25 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:08.022753 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39767d0a-f39a-4e06-9f76-5ee28b0e1c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:08.023033 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39767d0a-f39a-4e06-9f76-5ee28b0e1c25 admin admin] PATH_INFO: `/v3/projects/3bd61756df1345b79d186640f4c59492/users/31ab28b534d0420fb54c5023c40190d3/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:08.025175 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39767d0a-f39a-4e06-9f76-5ee28b0e1c25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bd61756df1345b79d186640f4c59492, user_id=31ab28b534d0420fb54c5023c40190d3, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:08.027913 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39767d0a-f39a-4e06-9f76-5ee28b0e1c25 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:08.049122 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1046/2102] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:33:07 2022] PUT /identity/v3/projects/3bd61756df1345b79d186640f4c59492/users/31ab28b534d0420fb54c5023c40190d3/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:08.053156 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71be64-e7d5-41d5-b4bc-190e8fc5a674 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:08.059390 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c2e7e-6d0f-4447-9ff7-7c4ca845c514 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:08.059967 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c2e7e-6d0f-4447-9ff7-7c4ca845c514 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:08.060430 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c2e7e-6d0f-4447-9ff7-7c4ca845c514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:08.119822 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-c06c2e7e-6d0f-4447-9ff7-7c4ca845c514 None None] MFA Rules not processed for user `31ab28b534d0420fb54c5023c40190d3`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:08.121049 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-c06c2e7e-6d0f-4447-9ff7-7c4ca845c514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:08.154081 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e73fa-cec2-4214-9395-3bed2c60df47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:08.155398 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e73fa-cec2-4214-9395-3bed2c60df47 admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:08.155789 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e73fa-cec2-4214-9395-3bed2c60df47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:08.156393 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e73fa-cec2-4214-9395-3bed2c60df47 admin admin] PATH_INFO: `/v3/projects/c26e49978b3147799acf518e9756a933/users/a9b9c800bd614fb08d50fa1a950a0e23/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:08.175711 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4e73fa-cec2-4214-9395-3bed2c60df47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c26e49978b3147799acf518e9756a933, user_id=a9b9c800bd614fb08d50fa1a950a0e23, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:08.179290 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4e73fa-cec2-4214-9395-3bed2c60df47 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:08.197138 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1057/2103] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:33:08 2022] PUT /identity/v3/projects/c26e49978b3147799acf518e9756a933/users/a9b9c800bd614fb08d50fa1a950a0e23/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:08.198725 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1047/2104] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:08 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:33:08.202140 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e73fa-cec2-4214-9395-3bed2c60df47 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:08.212548 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c2e7e-6d0f-4447-9ff7-7c4ca845c514 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:08.213953 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-c06c2e7e-6d0f-4447-9ff7-7c4ca845c514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:08.283744 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e73fa-cec2-4214-9395-3bed2c60df47 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:08.287975 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c2e7e-6d0f-4447-9ff7-7c4ca845c514 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:08.291618 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5de93b-1359-4341-a395-565a228919e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:08.293642 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5de93b-1359-4341-a395-565a228919e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:08.294777 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5de93b-1359-4341-a395-565a228919e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:08.295479 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5de93b-1359-4341-a395-565a228919e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:08.296579 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5de93b-1359-4341-a395-565a228919e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:08.298321 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5de93b-1359-4341-a395-565a228919e1 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:08.310921 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1058/2105] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:33:08.315874 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5de93b-1359-4341-a395-565a228919e1 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:08.334389 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5de93b-1359-4341-a395-565a228919e1 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:08.341368 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107eb3a-0042-4e01-a141-82a651a7da81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:08.342382 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107eb3a-0042-4e01-a141-82a651a7da81 admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:08.342731 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107eb3a-0042-4e01-a141-82a651a7da81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:08.342971 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107eb3a-0042-4e01-a141-82a651a7da81 admin admin] PATH_INFO: `/v3/projects/c26e49978b3147799acf518e9756a933/users/a9b9c800bd614fb08d50fa1a950a0e23/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:08.344778 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77332035-18e9-47ad-8c68-307a1f1f83a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:08.345267 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a107eb3a-0042-4e01-a141-82a651a7da81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c26e49978b3147799acf518e9756a933, user_id=a9b9c800bd614fb08d50fa1a950a0e23, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:08.345855 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77332035-18e9-47ad-8c68-307a1f1f83a8 service cinder] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:08.346355 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77332035-18e9-47ad-8c68-307a1f1f83a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:08.346748 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77332035-18e9-47ad-8c68-307a1f1f83a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:08.348735 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a107eb3a-0042-4e01-a141-82a651a7da81 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:08.363131 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1059/2106] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:33:08 2022] PUT /identity/v3/projects/c26e49978b3147799acf518e9756a933/users/a9b9c800bd614fb08d50fa1a950a0e23/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:08.373699 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35881b76-89ae-4508-aeab-c1632a968342 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:08.373973 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35881b76-89ae-4508-aeab-c1632a968342 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:08.374170 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35881b76-89ae-4508-aeab-c1632a968342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:08.413214 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-35881b76-89ae-4508-aeab-c1632a968342 None None] MFA Rules not processed for user `a9b9c800bd614fb08d50fa1a950a0e23`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:08.414507 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-35881b76-89ae-4508-aeab-c1632a968342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:08.428931 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77332035-18e9-47ad-8c68-307a1f1f83a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:08.430537 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77332035-18e9-47ad-8c68-307a1f1f83a8 service cinder] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:08.442907 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1048/2107] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:33:08 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:33:08.502761 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1060/2108] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:08 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:33:08.510919 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77332035-18e9-47ad-8c68-307a1f1f83a8 service cinder] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:08.520610 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77332035-18e9-47ad-8c68-307a1f1f83a8 service cinder] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:08.527377 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35881b76-89ae-4508-aeab-c1632a968342 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:08.529461 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-35881b76-89ae-4508-aeab-c1632a968342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:08.577095 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796f249-d45e-406b-940e-0137123191ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:08.577791 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796f249-d45e-406b-940e-0137123191ca service cinder] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:08.578070 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796f249-d45e-406b-940e-0137123191ca service cinder] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:08.578344 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796f249-d45e-406b-940e-0137123191ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:08.592396 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c796f249-d45e-406b-940e-0137123191ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:08.593908 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c796f249-d45e-406b-940e-0137123191ca service cinder] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:08.595363 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35881b76-89ae-4508-aeab-c1632a968342 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:08.600813 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04457537-69ec-4a8c-b616-bd6738b10aaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:08.600813 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04457537-69ec-4a8c-b616-bd6738b10aaf service cinder] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:08.600813 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04457537-69ec-4a8c-b616-bd6738b10aaf service cinder] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:08.600813 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04457537-69ec-4a8c-b616-bd6738b10aaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:08.604227 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1049/2109] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:33:08 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:33:08.669998 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04457537-69ec-4a8c-b616-bd6738b10aaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:08.671573 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04457537-69ec-4a8c-b616-bd6738b10aaf service cinder] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:08.681999 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1061/2110] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:33:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:33:08.931304 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796f249-d45e-406b-940e-0137123191ca service cinder] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:08.940853 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796f249-d45e-406b-940e-0137123191ca service cinder] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:08.945841 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbdc3a7-672c-4ae0-a5cf-a6474e1d3deb tempest-VolumeQuotaClassesTest-1544775582 tempest-VolumeQuotaClassesTest-1544775582-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9c800bd614fb08d50fa1a950a0e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c26e49978b3147799acf518e9756a933', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:08.946494 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbdc3a7-672c-4ae0-a5cf-a6474e1d3deb tempest-VolumeQuotaClassesTest-1544775582 tempest-VolumeQuotaClassesTest-1544775582-project-admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:08.946810 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbdc3a7-672c-4ae0-a5cf-a6474e1d3deb tempest-VolumeQuotaClassesTest-1544775582 tempest-VolumeQuotaClassesTest-1544775582-project-admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:08.947132 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbdc3a7-672c-4ae0-a5cf-a6474e1d3deb tempest-VolumeQuotaClassesTest-1544775582 tempest-VolumeQuotaClassesTest-1544775582-project-admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:08.947793 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbdc3a7-672c-4ae0-a5cf-a6474e1d3deb tempest-VolumeQuotaClassesTest-1544775582 tempest-VolumeQuotaClassesTest-1544775582-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:33:08.948237 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbdc3a7-672c-4ae0-a5cf-a6474e1d3deb tempest-VolumeQuotaClassesTest-1544775582 tempest-VolumeQuotaClassesTest-1544775582-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:08.949687 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbdc3a7-672c-4ae0-a5cf-a6474e1d3deb tempest-VolumeQuotaClassesTest-1544775582 tempest-VolumeQuotaClassesTest-1544775582-project-admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:08.961803 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1050/2111] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:33:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:33:08.966491 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04457537-69ec-4a8c-b616-bd6738b10aaf service cinder] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:08.977490 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04457537-69ec-4a8c-b616-bd6738b10aaf service cinder] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:08.984589 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c0c4f-daff-4f73-bdd1-aa3663e49c7c tempest-VolumeQuotaClassesTest-1544775582 tempest-VolumeQuotaClassesTest-1544775582-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9c800bd614fb08d50fa1a950a0e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c26e49978b3147799acf518e9756a933', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:08.985263 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c0c4f-daff-4f73-bdd1-aa3663e49c7c tempest-VolumeQuotaClassesTest-1544775582 tempest-VolumeQuotaClassesTest-1544775582-project-admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:08.985546 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c0c4f-daff-4f73-bdd1-aa3663e49c7c tempest-VolumeQuotaClassesTest-1544775582 tempest-VolumeQuotaClassesTest-1544775582-project-admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:08.985823 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c0c4f-daff-4f73-bdd1-aa3663e49c7c tempest-VolumeQuotaClassesTest-1544775582 tempest-VolumeQuotaClassesTest-1544775582-project-admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:08.986523 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c0c4f-daff-4f73-bdd1-aa3663e49c7c tempest-VolumeQuotaClassesTest-1544775582 tempest-VolumeQuotaClassesTest-1544775582-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:08.988485 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c0c4f-daff-4f73-bdd1-aa3663e49c7c tempest-VolumeQuotaClassesTest-1544775582 tempest-VolumeQuotaClassesTest-1544775582-project-admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:09.017619 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1062/2112] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:33:08 2022] POST /identity/v3/projects => generated 354 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:33:09.022043 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbdc3a7-672c-4ae0-a5cf-a6474e1d3deb tempest-VolumeQuotaClassesTest-1544775582 tempest-VolumeQuotaClassesTest-1544775582-project-admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:09.033371 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbdc3a7-672c-4ae0-a5cf-a6474e1d3deb tempest-VolumeQuotaClassesTest-1544775582 tempest-VolumeQuotaClassesTest-1544775582-project-admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:09.095395 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d614198-3cd5-4653-b155-e0d6461808ed tempest-VolumeQuotaClassesTest-1544775582 tempest-VolumeQuotaClassesTest-1544775582-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9c800bd614fb08d50fa1a950a0e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c26e49978b3147799acf518e9756a933', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:09.096044 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d614198-3cd5-4653-b155-e0d6461808ed tempest-VolumeQuotaClassesTest-1544775582 tempest-VolumeQuotaClassesTest-1544775582-project-admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:09.096329 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d614198-3cd5-4653-b155-e0d6461808ed tempest-VolumeQuotaClassesTest-1544775582 tempest-VolumeQuotaClassesTest-1544775582-project-admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:09.096607 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d614198-3cd5-4653-b155-e0d6461808ed tempest-VolumeQuotaClassesTest-1544775582 tempest-VolumeQuotaClassesTest-1544775582-project-admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:09.097341 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d614198-3cd5-4653-b155-e0d6461808ed tempest-VolumeQuotaClassesTest-1544775582 tempest-VolumeQuotaClassesTest-1544775582-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:33:09.097647 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d614198-3cd5-4653-b155-e0d6461808ed tempest-VolumeQuotaClassesTest-1544775582 tempest-VolumeQuotaClassesTest-1544775582-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:09.099274 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d614198-3cd5-4653-b155-e0d6461808ed tempest-VolumeQuotaClassesTest-1544775582 tempest-VolumeQuotaClassesTest-1544775582-project-admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:09.111866 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1051/2113] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:33:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:33:09.149415 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c0c4f-daff-4f73-bdd1-aa3663e49c7c tempest-VolumeQuotaClassesTest-1544775582 tempest-VolumeQuotaClassesTest-1544775582-project-admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:09.159960 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c0c4f-daff-4f73-bdd1-aa3663e49c7c tempest-VolumeQuotaClassesTest-1544775582 tempest-VolumeQuotaClassesTest-1544775582-project-admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:09.164573 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2d783-af96-4871-88d9-30bd7859b0d4 tempest-VolumeQuotaClassesTest-1544775582 tempest-VolumeQuotaClassesTest-1544775582-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b9c800bd614fb08d50fa1a950a0e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c26e49978b3147799acf518e9756a933', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:09.165415 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2d783-af96-4871-88d9-30bd7859b0d4 tempest-VolumeQuotaClassesTest-1544775582 tempest-VolumeQuotaClassesTest-1544775582-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:09.165697 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2d783-af96-4871-88d9-30bd7859b0d4 tempest-VolumeQuotaClassesTest-1544775582 tempest-VolumeQuotaClassesTest-1544775582-project-admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:09.165968 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2d783-af96-4871-88d9-30bd7859b0d4 tempest-VolumeQuotaClassesTest-1544775582 tempest-VolumeQuotaClassesTest-1544775582-project-admin] PATH_INFO: `/v3/projects/8722b887debd4efdbbfeb8081ec30379` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:09.167194 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba2d783-af96-4871-88d9-30bd7859b0d4 tempest-VolumeQuotaClassesTest-1544775582 tempest-VolumeQuotaClassesTest-1544775582-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8722b887debd4efdbbfeb8081ec30379)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:09.169678 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba2d783-af96-4871-88d9-30bd7859b0d4 tempest-VolumeQuotaClassesTest-1544775582 tempest-VolumeQuotaClassesTest-1544775582-project-admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:09.225754 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-2ba2d783-af96-4871-88d9-30bd7859b0d4 tempest-VolumeQuotaClassesTest-1544775582 tempest-VolumeQuotaClassesTest-1544775582-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8722b887debd4efdbbfeb8081ec30379', 'request_id': 'req-2ba2d783-af96-4871-88d9-30bd7859b0d4'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:09.230907 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-2ba2d783-af96-4871-88d9-30bd7859b0d4 tempest-VolumeQuotaClassesTest-1544775582 tempest-VolumeQuotaClassesTest-1544775582-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8722b887debd4efdbbfeb8081ec30379', 'request_id': 'req-2ba2d783-af96-4871-88d9-30bd7859b0d4'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:09.238166 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-2ba2d783-af96-4871-88d9-30bd7859b0d4 tempest-VolumeQuotaClassesTest-1544775582 tempest-VolumeQuotaClassesTest-1544775582-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8722b887debd4efdbbfeb8081ec30379', 'request_id': 'req-2ba2d783-af96-4871-88d9-30bd7859b0d4'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:09.252814 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-2ba2d783-af96-4871-88d9-30bd7859b0d4 tempest-VolumeQuotaClassesTest-1544775582 tempest-VolumeQuotaClassesTest-1544775582-project-admin] The token cache is being invalidate because project 8722b887debd4efdbbfeb8081ec30379 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:33:09.253140 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-2ba2d783-af96-4871-88d9-30bd7859b0d4 tempest-VolumeQuotaClassesTest-1544775582 tempest-VolumeQuotaClassesTest-1544775582-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:09.253816 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-2ba2d783-af96-4871-88d9-30bd7859b0d4 tempest-VolumeQuotaClassesTest-1544775582 tempest-VolumeQuotaClassesTest-1544775582-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:09.255620 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1063/2114] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:33:09 2022] DELETE /identity/v3/projects/8722b887debd4efdbbfeb8081ec30379 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:09.452562 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d614198-3cd5-4653-b155-e0d6461808ed tempest-VolumeQuotaClassesTest-1544775582 tempest-VolumeQuotaClassesTest-1544775582-project-admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:09.459652 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-2d614198-3cd5-4653-b155-e0d6461808ed tempest-VolumeQuotaClassesTest-1544775582 tempest-VolumeQuotaClassesTest-1544775582-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:09.522456 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d614198-3cd5-4653-b155-e0d6461808ed tempest-VolumeQuotaClassesTest-1544775582 tempest-VolumeQuotaClassesTest-1544775582-project-admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:09.582587 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76936b65-e336-445b-90d8-48f04369f53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:09.583469 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76936b65-e336-445b-90d8-48f04369f53a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:09.583747 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76936b65-e336-445b-90d8-48f04369f53a admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:09.584018 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76936b65-e336-445b-90d8-48f04369f53a admin admin] PATH_INFO: `/v3/users/e77233e4c14647c6babae0ae41be3fc1` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:09.585188 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76936b65-e336-445b-90d8-48f04369f53a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e77233e4c14647c6babae0ae41be3fc1)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:09.587381 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76936b65-e336-445b-90d8-48f04369f53a admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:09.637173 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-76936b65-e336-445b-90d8-48f04369f53a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e77233e4c14647c6babae0ae41be3fc1'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:09.638752 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-76936b65-e336-445b-90d8-48f04369f53a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e77233e4c14647c6babae0ae41be3fc1'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:09.652295 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-76936b65-e336-445b-90d8-48f04369f53a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e77233e4c14647c6babae0ae41be3fc1'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:09.660258 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-76936b65-e336-445b-90d8-48f04369f53a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e77233e4c14647c6babae0ae41be3fc1'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:09.666863 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-76936b65-e336-445b-90d8-48f04369f53a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e77233e4c14647c6babae0ae41be3fc1'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:09.673381 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1052/2115] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:33:09 2022] DELETE /identity/v3/users/e77233e4c14647c6babae0ae41be3fc1 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:09.677797 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74924769-cb0f-4f9c-a538-095acd74e0b0 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:09.678026 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74924769-cb0f-4f9c-a538-095acd74e0b0 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:09.678322 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74924769-cb0f-4f9c-a538-095acd74e0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:09.699550 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-74924769-cb0f-4f9c-a538-095acd74e0b0 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:09.701962 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-74924769-cb0f-4f9c-a538-095acd74e0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:09.767458 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1064/2116] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:33:09.776803 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76936b65-e336-445b-90d8-48f04369f53a admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:09.778357 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-76936b65-e336-445b-90d8-48f04369f53a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:09.853119 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76936b65-e336-445b-90d8-48f04369f53a admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:09.858090 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aefcf2-737f-4af5-a194-909e65652626 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:09.858925 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aefcf2-737f-4af5-a194-909e65652626 service neutron] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:09.859306 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aefcf2-737f-4af5-a194-909e65652626 service neutron] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:09.859681 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aefcf2-737f-4af5-a194-909e65652626 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:09.869948 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aefcf2-737f-4af5-a194-909e65652626 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:09.871507 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aefcf2-737f-4af5-a194-909e65652626 service neutron] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:09.884969 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1053/2117] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:33:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:33:10.204825 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74924769-cb0f-4f9c-a538-095acd74e0b0 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:10.206339 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-74924769-cb0f-4f9c-a538-095acd74e0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:10.233509 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74924769-cb0f-4f9c-a538-095acd74e0b0 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:10.251199 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc2aef-7cfa-47eb-9a06-80a2ba22001c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:10.252652 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc2aef-7cfa-47eb-9a06-80a2ba22001c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:10.252932 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc2aef-7cfa-47eb-9a06-80a2ba22001c admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:10.253289 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc2aef-7cfa-47eb-9a06-80a2ba22001c admin admin] PATH_INFO: `/v3/projects/28e9cb5652594a33935ee545a2e315c6` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:10.256210 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbc2aef-7cfa-47eb-9a06-80a2ba22001c admin admin] RBAC: Authorizing `identity:delete_project(project_id=28e9cb5652594a33935ee545a2e315c6)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:10.259677 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbc2aef-7cfa-47eb-9a06-80a2ba22001c admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:10.315601 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-6fbc2aef-7cfa-47eb-9a06-80a2ba22001c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28e9cb5652594a33935ee545a2e315c6', 'request_id': 'req-6fbc2aef-7cfa-47eb-9a06-80a2ba22001c'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:10.322303 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-6fbc2aef-7cfa-47eb-9a06-80a2ba22001c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28e9cb5652594a33935ee545a2e315c6', 'request_id': 'req-6fbc2aef-7cfa-47eb-9a06-80a2ba22001c'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:10.330988 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-6fbc2aef-7cfa-47eb-9a06-80a2ba22001c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28e9cb5652594a33935ee545a2e315c6', 'request_id': 'req-6fbc2aef-7cfa-47eb-9a06-80a2ba22001c'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:10.345980 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-6fbc2aef-7cfa-47eb-9a06-80a2ba22001c admin admin] The token cache is being invalidate because project 28e9cb5652594a33935ee545a2e315c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:33:10.346278 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-6fbc2aef-7cfa-47eb-9a06-80a2ba22001c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:10.347283 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-6fbc2aef-7cfa-47eb-9a06-80a2ba22001c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:10.350642 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1065/2118] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:33:10 2022] DELETE /identity/v3/projects/28e9cb5652594a33935ee545a2e315c6 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:10.353111 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aefcf2-737f-4af5-a194-909e65652626 service neutron] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:10.363395 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aefcf2-737f-4af5-a194-909e65652626 service neutron] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:10.418692 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4b7a1-164c-428e-8663-40c06a879fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:10.419675 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4b7a1-164c-428e-8663-40c06a879fe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:10.419862 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4b7a1-164c-428e-8663-40c06a879fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:10.420127 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4b7a1-164c-428e-8663-40c06a879fe1 admin admin] PATH_INFO: `/v3/users/a9b9c800bd614fb08d50fa1a950a0e23` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:10.421300 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4b7a1-164c-428e-8663-40c06a879fe1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9b9c800bd614fb08d50fa1a950a0e23)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:10.423261 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4b7a1-164c-428e-8663-40c06a879fe1 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:10.469049 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-f4a4b7a1-164c-428e-8663-40c06a879fe1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9b9c800bd614fb08d50fa1a950a0e23'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:10.469689 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-f4a4b7a1-164c-428e-8663-40c06a879fe1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9b9c800bd614fb08d50fa1a950a0e23'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:10.481083 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-f4a4b7a1-164c-428e-8663-40c06a879fe1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9b9c800bd614fb08d50fa1a950a0e23'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:10.487813 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-f4a4b7a1-164c-428e-8663-40c06a879fe1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9b9c800bd614fb08d50fa1a950a0e23'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:10.494310 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-f4a4b7a1-164c-428e-8663-40c06a879fe1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9b9c800bd614fb08d50fa1a950a0e23'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:10.500347 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1054/2119] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:33:10 2022] DELETE /identity/v3/users/a9b9c800bd614fb08d50fa1a950a0e23 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:10.770509 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc2aef-7cfa-47eb-9a06-80a2ba22001c admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:10.771958 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-6fbc2aef-7cfa-47eb-9a06-80a2ba22001c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:10.785685 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc2aef-7cfa-47eb-9a06-80a2ba22001c admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:10.844171 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a465b4b-3819-45de-ac1c-86531590909d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:10.845046 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a465b4b-3819-45de-ac1c-86531590909d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:10.845329 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a465b4b-3819-45de-ac1c-86531590909d admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:10.845605 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a465b4b-3819-45de-ac1c-86531590909d admin admin] PATH_INFO: `/v3/projects/c26e49978b3147799acf518e9756a933` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:10.846972 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a465b4b-3819-45de-ac1c-86531590909d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c26e49978b3147799acf518e9756a933)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:10.852541 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a465b4b-3819-45de-ac1c-86531590909d admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:10.894208 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-1a465b4b-3819-45de-ac1c-86531590909d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c26e49978b3147799acf518e9756a933', 'request_id': 'req-1a465b4b-3819-45de-ac1c-86531590909d'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:10.899312 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-1a465b4b-3819-45de-ac1c-86531590909d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c26e49978b3147799acf518e9756a933', 'request_id': 'req-1a465b4b-3819-45de-ac1c-86531590909d'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:10.905602 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-1a465b4b-3819-45de-ac1c-86531590909d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c26e49978b3147799acf518e9756a933', 'request_id': 'req-1a465b4b-3819-45de-ac1c-86531590909d'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:10.916611 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-1a465b4b-3819-45de-ac1c-86531590909d admin admin] The token cache is being invalidate because project c26e49978b3147799acf518e9756a933 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:33:10.916893 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-1a465b4b-3819-45de-ac1c-86531590909d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:10.917516 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-1a465b4b-3819-45de-ac1c-86531590909d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:10.919488 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1066/2120] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:33:10 2022] DELETE /identity/v3/projects/c26e49978b3147799acf518e9756a933 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:10.924209 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe1d3b-c268-4a01-8012-e330b98eab8c None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:10.924498 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe1d3b-c268-4a01-8012-e330b98eab8c None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:10.924806 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe1d3b-c268-4a01-8012-e330b98eab8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:10.951263 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-9dfe1d3b-c268-4a01-8012-e330b98eab8c None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:10.952561 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-9dfe1d3b-c268-4a01-8012-e330b98eab8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:11.010978 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1055/2121] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:33:11.020804 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc517cbd-a11b-4971-8b33-e832da901f00 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:11.021092 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc517cbd-a11b-4971-8b33-e832da901f00 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:11.021368 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc517cbd-a11b-4971-8b33-e832da901f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:11.039094 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-bc517cbd-a11b-4971-8b33-e832da901f00 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:11.040292 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-bc517cbd-a11b-4971-8b33-e832da901f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:11.052290 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1067/2122] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:33:11.057088 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe1d3b-c268-4a01-8012-e330b98eab8c None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:11.067475 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe1d3b-c268-4a01-8012-e330b98eab8c None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:11.072198 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263d38e-2aed-48b7-a1dd-e6ea1e3b3f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:11.072848 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263d38e-2aed-48b7-a1dd-e6ea1e3b3f55 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:11.073125 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263d38e-2aed-48b7-a1dd-e6ea1e3b3f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:11.073397 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263d38e-2aed-48b7-a1dd-e6ea1e3b3f55 admin admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:11.074116 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f263d38e-2aed-48b7-a1dd-e6ea1e3b3f55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:33:11.074424 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f263d38e-2aed-48b7-a1dd-e6ea1e3b3f55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:11.076061 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f263d38e-2aed-48b7-a1dd-e6ea1e3b3f55 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:11.087900 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1056/2123] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:33:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:33:11.092528 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc517cbd-a11b-4971-8b33-e832da901f00 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:11.101442 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc517cbd-a11b-4971-8b33-e832da901f00 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:11.106258 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc219e-f08f-4643-a5c0-0718123f142f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:11.107919 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc219e-f08f-4643-a5c0-0718123f142f admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:11.108199 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc219e-f08f-4643-a5c0-0718123f142f admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:11.108469 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc219e-f08f-4643-a5c0-0718123f142f admin admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:11.109154 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc219e-f08f-4643-a5c0-0718123f142f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:11.111055 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc219e-f08f-4643-a5c0-0718123f142f admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:11.144390 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1068/2124] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:33:11 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:33:11.148462 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263d38e-2aed-48b7-a1dd-e6ea1e3b3f55 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:11.159714 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263d38e-2aed-48b7-a1dd-e6ea1e3b3f55 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:11.214520 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb09cf-0fd3-41d7-90bd-444133c12cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:11.215210 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb09cf-0fd3-41d7-90bd-444133c12cfd admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:11.215493 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb09cf-0fd3-41d7-90bd-444133c12cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:11.215819 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb09cf-0fd3-41d7-90bd-444133c12cfd admin admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:11.217072 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb09cf-0fd3-41d7-90bd-444133c12cfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:11.219009 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb09cf-0fd3-41d7-90bd-444133c12cfd admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:11.237570 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1057/2125] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:33:11 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:33:11.243972 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc219e-f08f-4643-a5c0-0718123f142f admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:11.254741 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc219e-f08f-4643-a5c0-0718123f142f admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:11.259449 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb3f45-a49b-4b7e-afbf-b5d5f5cb9d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:11.260099 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb3f45-a49b-4b7e-afbf-b5d5f5cb9d3f admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:11.260383 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb3f45-a49b-4b7e-afbf-b5d5f5cb9d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:11.260660 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb3f45-a49b-4b7e-afbf-b5d5f5cb9d3f admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:11.261466 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb3f45-a49b-4b7e-afbf-b5d5f5cb9d3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:11.263693 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb3f45-a49b-4b7e-afbf-b5d5f5cb9d3f admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:11.273880 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1069/2126] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:33:11.277969 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb09cf-0fd3-41d7-90bd-444133c12cfd admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:11.288542 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb09cf-0fd3-41d7-90bd-444133c12cfd admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:11.293410 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa70ae-2390-4a51-a5ce-aa01a77c66ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:11.294344 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa70ae-2390-4a51-a5ce-aa01a77c66ea admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:11.294688 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa70ae-2390-4a51-a5ce-aa01a77c66ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:11.294971 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa70ae-2390-4a51-a5ce-aa01a77c66ea admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:11.295702 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa70ae-2390-4a51-a5ce-aa01a77c66ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:11.297417 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa70ae-2390-4a51-a5ce-aa01a77c66ea admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:11.309249 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1058/2127] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:33:11.313369 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb3f45-a49b-4b7e-afbf-b5d5f5cb9d3f admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:11.323990 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb3f45-a49b-4b7e-afbf-b5d5f5cb9d3f admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:11.330578 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4f14a-47da-4d34-b810-cc238a1af79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:11.331530 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4f14a-47da-4d34-b810-cc238a1af79d admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:11.331816 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4f14a-47da-4d34-b810-cc238a1af79d admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:11.332095 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4f14a-47da-4d34-b810-cc238a1af79d admin admin] PATH_INFO: `/v3/projects/d96b60cdea4f4bb1951d21a86268993d/users/a7ec4f406686456ab5f9557426e7d3ce/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:11.348175 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac4f14a-47da-4d34-b810-cc238a1af79d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d96b60cdea4f4bb1951d21a86268993d, user_id=a7ec4f406686456ab5f9557426e7d3ce, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:11.350882 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac4f14a-47da-4d34-b810-cc238a1af79d admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:11.364251 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1070/2128] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:33:11 2022] PUT /identity/v3/projects/d96b60cdea4f4bb1951d21a86268993d/users/a7ec4f406686456ab5f9557426e7d3ce/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:11.374473 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392459b0-acb5-4908-ac62-ad4774a4272d None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:11.374964 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392459b0-acb5-4908-ac62-ad4774a4272d None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:11.375068 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392459b0-acb5-4908-ac62-ad4774a4272d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:11.401511 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-392459b0-acb5-4908-ac62-ad4774a4272d None None] MFA Rules not processed for user `a7ec4f406686456ab5f9557426e7d3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:11.402939 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-392459b0-acb5-4908-ac62-ad4774a4272d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:11.471026 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1059/2129] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:33:11.475694 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4f14a-47da-4d34-b810-cc238a1af79d admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:11.544893 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4f14a-47da-4d34-b810-cc238a1af79d admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:11.550239 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b79c65-8cdc-43c8-a203-d349e99baefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:11.551098 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b79c65-8cdc-43c8-a203-d349e99baefd admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:11.551399 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b79c65-8cdc-43c8-a203-d349e99baefd admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:11.552846 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b79c65-8cdc-43c8-a203-d349e99baefd admin admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:11.553554 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b79c65-8cdc-43c8-a203-d349e99baefd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:11.555566 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b79c65-8cdc-43c8-a203-d349e99baefd admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:11.586512 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1071/2130] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:33:11 2022] POST /identity/v3/projects => generated 371 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:33:11.590404 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392459b0-acb5-4908-ac62-ad4774a4272d None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:11.609946 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392459b0-acb5-4908-ac62-ad4774a4272d None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:11.678379 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a19dac-3035-4ab8-8c24-b948ccafafc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:11.679099 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a19dac-3035-4ab8-8c24-b948ccafafc2 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:11.679379 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a19dac-3035-4ab8-8c24-b948ccafafc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:11.679675 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a19dac-3035-4ab8-8c24-b948ccafafc2 admin admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:11.680361 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a19dac-3035-4ab8-8c24-b948ccafafc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:11.682303 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a19dac-3035-4ab8-8c24-b948ccafafc2 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:11.709277 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1060/2131] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:33:11 2022] POST /identity/v3/users => generated 286 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:33:11.713791 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b79c65-8cdc-43c8-a203-d349e99baefd admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:11.725031 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b79c65-8cdc-43c8-a203-d349e99baefd admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:11.729720 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7051c71-1f06-49ff-91ce-6eafc7b4f2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:11.730376 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7051c71-1f06-49ff-91ce-6eafc7b4f2dd admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:11.730694 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7051c71-1f06-49ff-91ce-6eafc7b4f2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:11.730973 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7051c71-1f06-49ff-91ce-6eafc7b4f2dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:11.732356 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7051c71-1f06-49ff-91ce-6eafc7b4f2dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:11.733905 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7051c71-1f06-49ff-91ce-6eafc7b4f2dd admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:11.746553 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1072/2132] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:33:11.750037 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a19dac-3035-4ab8-8c24-b948ccafafc2 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:11.759860 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a19dac-3035-4ab8-8c24-b948ccafafc2 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:11.765699 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f3008-c000-4e52-8123-cf70bab89237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:11.766354 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f3008-c000-4e52-8123-cf70bab89237 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:11.766656 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f3008-c000-4e52-8123-cf70bab89237 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:11.766933 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f3008-c000-4e52-8123-cf70bab89237 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:11.767641 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114f3008-c000-4e52-8123-cf70bab89237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:11.769211 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114f3008-c000-4e52-8123-cf70bab89237 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:11.780890 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1061/2133] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:33:11.785521 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7051c71-1f06-49ff-91ce-6eafc7b4f2dd admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:11.796394 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7051c71-1f06-49ff-91ce-6eafc7b4f2dd admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:11.802847 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ea6e1-e4c5-4ef6-9a89-1554bc1c17a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:11.802847 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ea6e1-e4c5-4ef6-9a89-1554bc1c17a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:11.802847 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ea6e1-e4c5-4ef6-9a89-1554bc1c17a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:11.802847 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ea6e1-e4c5-4ef6-9a89-1554bc1c17a4 admin admin] PATH_INFO: `/v3/projects/3cb8d8e37bde4bbfbf70bb72e84c005e/users/ec50d32867e54f5b962de38bb6b86fc3/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:11.823374 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ea6e1-e4c5-4ef6-9a89-1554bc1c17a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cb8d8e37bde4bbfbf70bb72e84c005e, user_id=ec50d32867e54f5b962de38bb6b86fc3, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:11.826429 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ea6e1-e4c5-4ef6-9a89-1554bc1c17a4 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:11.841240 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1073/2134] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:33:11 2022] PUT /identity/v3/projects/3cb8d8e37bde4bbfbf70bb72e84c005e/users/ec50d32867e54f5b962de38bb6b86fc3/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:11.852562 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33ba97-22b1-4704-b18c-0ccb2f8295f6 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:11.852903 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33ba97-22b1-4704-b18c-0ccb2f8295f6 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:11.853184 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33ba97-22b1-4704-b18c-0ccb2f8295f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:11.881097 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-3a33ba97-22b1-4704-b18c-0ccb2f8295f6 None None] MFA Rules not processed for user `ec50d32867e54f5b962de38bb6b86fc3`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:11.882320 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-3a33ba97-22b1-4704-b18c-0ccb2f8295f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:11.945961 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1062/2135] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:33:11.950725 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ea6e1-e4c5-4ef6-9a89-1554bc1c17a4 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:12.011955 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ea6e1-e4c5-4ef6-9a89-1554bc1c17a4 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:12.017113 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e3608-4150-4492-9bbc-bd836f257f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:12.017805 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e3608-4150-4492-9bbc-bd836f257f97 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:12.018088 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e3608-4150-4492-9bbc-bd836f257f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:12.018362 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e3608-4150-4492-9bbc-bd836f257f97 admin admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:12.019113 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e3608-4150-4492-9bbc-bd836f257f97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:12.021011 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e3608-4150-4492-9bbc-bd836f257f97 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:12.047146 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1074/2136] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:33:11 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:33:12.051323 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33ba97-22b1-4704-b18c-0ccb2f8295f6 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:12.062852 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33ba97-22b1-4704-b18c-0ccb2f8295f6 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:12.124326 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9923654-cb4d-4184-9818-836dc03ec03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:12.124997 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9923654-cb4d-4184-9818-836dc03ec03d admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:12.125309 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9923654-cb4d-4184-9818-836dc03ec03d admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:12.125584 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9923654-cb4d-4184-9818-836dc03ec03d admin admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:12.126278 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9923654-cb4d-4184-9818-836dc03ec03d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:12.128203 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9923654-cb4d-4184-9818-836dc03ec03d admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:12.152003 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1063/2137] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:33:12 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:33:12.153616 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e3608-4150-4492-9bbc-bd836f257f97 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:12.164264 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e3608-4150-4492-9bbc-bd836f257f97 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:12.169810 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49626a6-df38-4f74-ab75-f2db8780051c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:12.170785 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49626a6-df38-4f74-ab75-f2db8780051c admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:12.171076 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49626a6-df38-4f74-ab75-f2db8780051c admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:12.171354 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49626a6-df38-4f74-ab75-f2db8780051c admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:12.172080 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49626a6-df38-4f74-ab75-f2db8780051c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:12.173667 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49626a6-df38-4f74-ab75-f2db8780051c admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:12.183932 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1075/2138] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:33:12.189029 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9923654-cb4d-4184-9818-836dc03ec03d admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:12.205651 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9923654-cb4d-4184-9818-836dc03ec03d admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:12.210773 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971e1c1-a0cf-4e43-9b9b-edc690e98c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:12.211663 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971e1c1-a0cf-4e43-9b9b-edc690e98c65 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:12.211938 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971e1c1-a0cf-4e43-9b9b-edc690e98c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:12.212205 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971e1c1-a0cf-4e43-9b9b-edc690e98c65 admin admin] PATH_INFO: `/v3/projects/d3e855f2b2314856b2f649410b0e2866/users/6c9d9ade9ae847d7993ee1041f3ce137/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:12.228071 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8971e1c1-a0cf-4e43-9b9b-edc690e98c65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3e855f2b2314856b2f649410b0e2866, user_id=6c9d9ade9ae847d7993ee1041f3ce137, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:12.230778 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8971e1c1-a0cf-4e43-9b9b-edc690e98c65 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:12.244392 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1064/2139] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:33:12 2022] PUT /identity/v3/projects/d3e855f2b2314856b2f649410b0e2866/users/6c9d9ade9ae847d7993ee1041f3ce137/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:33:12.248567 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49626a6-df38-4f74-ab75-f2db8780051c admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:12.258874 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49626a6-df38-4f74-ab75-f2db8780051c admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:12.322179 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d816c96-8517-4cca-b977-5127308f89ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:12.322793 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d816c96-8517-4cca-b977-5127308f89ad admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:12.323078 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d816c96-8517-4cca-b977-5127308f89ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:12.323349 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d816c96-8517-4cca-b977-5127308f89ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:12.324081 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d816c96-8517-4cca-b977-5127308f89ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:12.325693 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d816c96-8517-4cca-b977-5127308f89ad admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:12.335730 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1076/2140] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:33:12.339896 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971e1c1-a0cf-4e43-9b9b-edc690e98c65 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:12.350452 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971e1c1-a0cf-4e43-9b9b-edc690e98c65 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:12.355115 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65c2ec-89a5-400c-a18c-8af3be597234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:12.355978 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65c2ec-89a5-400c-a18c-8af3be597234 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:12.356259 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65c2ec-89a5-400c-a18c-8af3be597234 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:12.357202 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65c2ec-89a5-400c-a18c-8af3be597234 admin admin] PATH_INFO: `/v3/projects/d3e855f2b2314856b2f649410b0e2866/users/6c9d9ade9ae847d7993ee1041f3ce137/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:12.359237 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da65c2ec-89a5-400c-a18c-8af3be597234 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3e855f2b2314856b2f649410b0e2866, user_id=6c9d9ade9ae847d7993ee1041f3ce137, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:12.361867 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da65c2ec-89a5-400c-a18c-8af3be597234 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:12.371822 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1065/2141] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:33:12 2022] PUT /identity/v3/projects/d3e855f2b2314856b2f649410b0e2866/users/6c9d9ade9ae847d7993ee1041f3ce137/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:12.384144 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ac86d-f507-49db-a214-a8334c8e67e8 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:12.384618 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ac86d-f507-49db-a214-a8334c8e67e8 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:12.384727 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ac86d-f507-49db-a214-a8334c8e67e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:12.412135 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-484ac86d-f507-49db-a214-a8334c8e67e8 None None] MFA Rules not processed for user `6c9d9ade9ae847d7993ee1041f3ce137`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:12.413367 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-484ac86d-f507-49db-a214-a8334c8e67e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:12.482329 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1077/2142] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:12 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:33:12.493571 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65c2ec-89a5-400c-a18c-8af3be597234 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:12.495362 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-da65c2ec-89a5-400c-a18c-8af3be597234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:12.550304 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65c2ec-89a5-400c-a18c-8af3be597234 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:12.553951 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a5fac-9508-4605-b49e-8c80f0c286d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:12.554583 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a5fac-9508-4605-b49e-8c80f0c286d2 service cinder] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:12.554898 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a5fac-9508-4605-b49e-8c80f0c286d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:12.555171 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a5fac-9508-4605-b49e-8c80f0c286d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:12.564044 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1a5fac-9508-4605-b49e-8c80f0c286d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:12.565507 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1a5fac-9508-4605-b49e-8c80f0c286d2 service cinder] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:12.575825 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1066/2143] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:33:12 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:33:12.616734 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ac86d-f507-49db-a214-a8334c8e67e8 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:12.618106 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-484ac86d-f507-49db-a214-a8334c8e67e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:12.630478 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ac86d-f507-49db-a214-a8334c8e67e8 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:12.634017 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42e3b1-c2df-46a8-8512-7536b0ec1f35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:12.634683 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42e3b1-c2df-46a8-8512-7536b0ec1f35 service cinder] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:12.634965 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42e3b1-c2df-46a8-8512-7536b0ec1f35 service cinder] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:12.635236 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42e3b1-c2df-46a8-8512-7536b0ec1f35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:12.698700 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b42e3b1-c2df-46a8-8512-7536b0ec1f35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:12.700112 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b42e3b1-c2df-46a8-8512-7536b0ec1f35 service cinder] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:12.710263 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1078/2144] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:33:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:33:16.610245 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a5fac-9508-4605-b49e-8c80f0c286d2 service cinder] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:16.674515 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a5fac-9508-4605-b49e-8c80f0c286d2 service cinder] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:16.679134 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d1917d-8d2c-4434-93fd-317a6c48fe29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:16.679988 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1917d-8d2c-4434-93fd-317a6c48fe29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:16.680270 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1917d-8d2c-4434-93fd-317a6c48fe29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:16.680544 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1917d-8d2c-4434-93fd-317a6c48fe29 admin admin] PATH_INFO: `/v3/users/a7ec4f406686456ab5f9557426e7d3ce` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:16.681732 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d1917d-8d2c-4434-93fd-317a6c48fe29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7ec4f406686456ab5f9557426e7d3ce)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:16.683685 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d1917d-8d2c-4434-93fd-317a6c48fe29 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:16.730797 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-e5d1917d-8d2c-4434-93fd-317a6c48fe29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7ec4f406686456ab5f9557426e7d3ce'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:16.731474 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-e5d1917d-8d2c-4434-93fd-317a6c48fe29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7ec4f406686456ab5f9557426e7d3ce'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:16.744452 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-e5d1917d-8d2c-4434-93fd-317a6c48fe29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7ec4f406686456ab5f9557426e7d3ce'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:16.753741 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-e5d1917d-8d2c-4434-93fd-317a6c48fe29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7ec4f406686456ab5f9557426e7d3ce'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:16.760781 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-e5d1917d-8d2c-4434-93fd-317a6c48fe29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7ec4f406686456ab5f9557426e7d3ce'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:16.771705 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1067/2145] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:33:16 2022] DELETE /identity/v3/users/a7ec4f406686456ab5f9557426e7d3ce => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:16.773982 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f85b1-da1e-4e18-97cf-29004919dcbc None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:16.774460 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f85b1-da1e-4e18-97cf-29004919dcbc None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:16.774754 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f85b1-da1e-4e18-97cf-29004919dcbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:16.791651 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-7f8f85b1-da1e-4e18-97cf-29004919dcbc None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:16.792843 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-7f8f85b1-da1e-4e18-97cf-29004919dcbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:16.854739 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1079/2146] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:33:16.871483 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d1917d-8d2c-4434-93fd-317a6c48fe29 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:16.873726 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-e5d1917d-8d2c-4434-93fd-317a6c48fe29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:16.935104 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d1917d-8d2c-4434-93fd-317a6c48fe29 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:16.938821 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a81f8-c737-42ef-ab9f-ec72ac7d3185 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:16.939464 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a81f8-c737-42ef-ab9f-ec72ac7d3185 service neutron] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:16.939749 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a81f8-c737-42ef-ab9f-ec72ac7d3185 service neutron] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:16.940025 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a81f8-c737-42ef-ab9f-ec72ac7d3185 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:16.949426 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a81f8-c737-42ef-ab9f-ec72ac7d3185 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:16.951517 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a81f8-c737-42ef-ab9f-ec72ac7d3185 service neutron] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:16.964932 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1068/2147] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:33:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:33:17.304135 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f85b1-da1e-4e18-97cf-29004919dcbc None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:17.305737 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-7f8f85b1-da1e-4e18-97cf-29004919dcbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:17.319700 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f85b1-da1e-4e18-97cf-29004919dcbc None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:17.330681 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0c888-3398-4373-bc1f-d32d12a08e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:17.331822 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0c888-3398-4373-bc1f-d32d12a08e30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:17.332269 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0c888-3398-4373-bc1f-d32d12a08e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:17.332542 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0c888-3398-4373-bc1f-d32d12a08e30 admin admin] PATH_INFO: `/v3/projects/d96b60cdea4f4bb1951d21a86268993d` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:17.334013 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef0c888-3398-4373-bc1f-d32d12a08e30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d96b60cdea4f4bb1951d21a86268993d)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:17.336226 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef0c888-3398-4373-bc1f-d32d12a08e30 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:17.392697 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-9ef0c888-3398-4373-bc1f-d32d12a08e30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd96b60cdea4f4bb1951d21a86268993d', 'request_id': 'req-9ef0c888-3398-4373-bc1f-d32d12a08e30'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:17.398216 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-9ef0c888-3398-4373-bc1f-d32d12a08e30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd96b60cdea4f4bb1951d21a86268993d', 'request_id': 'req-9ef0c888-3398-4373-bc1f-d32d12a08e30'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:17.404854 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-9ef0c888-3398-4373-bc1f-d32d12a08e30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd96b60cdea4f4bb1951d21a86268993d', 'request_id': 'req-9ef0c888-3398-4373-bc1f-d32d12a08e30'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:17.417738 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-9ef0c888-3398-4373-bc1f-d32d12a08e30 admin admin] The token cache is being invalidate because project d96b60cdea4f4bb1951d21a86268993d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:33:17.418174 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-9ef0c888-3398-4373-bc1f-d32d12a08e30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:17.418951 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-9ef0c888-3398-4373-bc1f-d32d12a08e30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:17.420570 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1080/2148] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:33:17 2022] DELETE /identity/v3/projects/d96b60cdea4f4bb1951d21a86268993d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:17.424630 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a81f8-c737-42ef-ab9f-ec72ac7d3185 service neutron] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:17.434404 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a81f8-c737-42ef-ab9f-ec72ac7d3185 service neutron] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:17.489900 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193c9dd-7d7e-4049-b003-576891a9d759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:17.490798 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193c9dd-7d7e-4049-b003-576891a9d759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:17.491076 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193c9dd-7d7e-4049-b003-576891a9d759 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:17.491345 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193c9dd-7d7e-4049-b003-576891a9d759 admin admin] PATH_INFO: `/v3/users/ec50d32867e54f5b962de38bb6b86fc3` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:17.492495 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4193c9dd-7d7e-4049-b003-576891a9d759 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec50d32867e54f5b962de38bb6b86fc3)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:17.494520 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4193c9dd-7d7e-4049-b003-576891a9d759 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:17.537914 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-4193c9dd-7d7e-4049-b003-576891a9d759 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec50d32867e54f5b962de38bb6b86fc3'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:17.538551 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-4193c9dd-7d7e-4049-b003-576891a9d759 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec50d32867e54f5b962de38bb6b86fc3'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:17.550568 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-4193c9dd-7d7e-4049-b003-576891a9d759 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec50d32867e54f5b962de38bb6b86fc3'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:17.557775 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-4193c9dd-7d7e-4049-b003-576891a9d759 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec50d32867e54f5b962de38bb6b86fc3'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:17.565219 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-4193c9dd-7d7e-4049-b003-576891a9d759 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec50d32867e54f5b962de38bb6b86fc3'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:17.571750 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1069/2149] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:33:17 2022] DELETE /identity/v3/users/ec50d32867e54f5b962de38bb6b86fc3 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:17.849524 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0c888-3398-4373-bc1f-d32d12a08e30 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:17.851946 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-9ef0c888-3398-4373-bc1f-d32d12a08e30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:17.870006 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0c888-3398-4373-bc1f-d32d12a08e30 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:17.940497 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b85d5-10b8-49de-ae8f-aed1825b3b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:17.941349 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b85d5-10b8-49de-ae8f-aed1825b3b67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:17.941631 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b85d5-10b8-49de-ae8f-aed1825b3b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:17.941911 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b85d5-10b8-49de-ae8f-aed1825b3b67 admin admin] PATH_INFO: `/v3/projects/3cb8d8e37bde4bbfbf70bb72e84c005e` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:17.943160 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b85d5-10b8-49de-ae8f-aed1825b3b67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cb8d8e37bde4bbfbf70bb72e84c005e)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:17.945222 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b85d5-10b8-49de-ae8f-aed1825b3b67 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:17.992685 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-e53b85d5-10b8-49de-ae8f-aed1825b3b67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cb8d8e37bde4bbfbf70bb72e84c005e', 'request_id': 'req-e53b85d5-10b8-49de-ae8f-aed1825b3b67'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:17.998364 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-e53b85d5-10b8-49de-ae8f-aed1825b3b67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cb8d8e37bde4bbfbf70bb72e84c005e', 'request_id': 'req-e53b85d5-10b8-49de-ae8f-aed1825b3b67'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:18.004896 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-e53b85d5-10b8-49de-ae8f-aed1825b3b67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cb8d8e37bde4bbfbf70bb72e84c005e', 'request_id': 'req-e53b85d5-10b8-49de-ae8f-aed1825b3b67'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:18.023176 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-e53b85d5-10b8-49de-ae8f-aed1825b3b67 admin admin] The token cache is being invalidate because project 3cb8d8e37bde4bbfbf70bb72e84c005e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:33:18.023514 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-e53b85d5-10b8-49de-ae8f-aed1825b3b67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:18.024170 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-e53b85d5-10b8-49de-ae8f-aed1825b3b67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:18.025993 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1081/2150] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:33:17 2022] DELETE /identity/v3/projects/3cb8d8e37bde4bbfbf70bb72e84c005e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:18.030647 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193c9dd-7d7e-4049-b003-576891a9d759 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:18.032427 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-4193c9dd-7d7e-4049-b003-576891a9d759 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:18.045662 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193c9dd-7d7e-4049-b003-576891a9d759 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:18.103408 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef7a35-9639-4d97-9181-819dcfb492b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:18.104396 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef7a35-9639-4d97-9181-819dcfb492b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:18.104754 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef7a35-9639-4d97-9181-819dcfb492b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:18.105100 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef7a35-9639-4d97-9181-819dcfb492b3 admin admin] PATH_INFO: `/v3/users/6c9d9ade9ae847d7993ee1041f3ce137` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:18.106387 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ef7a35-9639-4d97-9181-819dcfb492b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c9d9ade9ae847d7993ee1041f3ce137)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:18.108411 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ef7a35-9639-4d97-9181-819dcfb492b3 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:18.159995 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-d6ef7a35-9639-4d97-9181-819dcfb492b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c9d9ade9ae847d7993ee1041f3ce137'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:18.160653 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-d6ef7a35-9639-4d97-9181-819dcfb492b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c9d9ade9ae847d7993ee1041f3ce137'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:18.172770 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-d6ef7a35-9639-4d97-9181-819dcfb492b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c9d9ade9ae847d7993ee1041f3ce137'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:18.180052 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-d6ef7a35-9639-4d97-9181-819dcfb492b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c9d9ade9ae847d7993ee1041f3ce137'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:18.187684 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-d6ef7a35-9639-4d97-9181-819dcfb492b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c9d9ade9ae847d7993ee1041f3ce137'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:18.193530 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1070/2151] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:33:18 2022] DELETE /identity/v3/users/6c9d9ade9ae847d7993ee1041f3ce137 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:18.495791 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b85d5-10b8-49de-ae8f-aed1825b3b67 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:18.497851 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-e53b85d5-10b8-49de-ae8f-aed1825b3b67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:18.517794 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b85d5-10b8-49de-ae8f-aed1825b3b67 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:18.608809 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ccb31b-06a8-4ba6-b37f-3ba266d4dab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:18.609754 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccb31b-06a8-4ba6-b37f-3ba266d4dab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:18.610098 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccb31b-06a8-4ba6-b37f-3ba266d4dab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:18.611112 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccb31b-06a8-4ba6-b37f-3ba266d4dab0 admin admin] PATH_INFO: `/v3/projects/d3e855f2b2314856b2f649410b0e2866` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:18.615636 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ccb31b-06a8-4ba6-b37f-3ba266d4dab0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3e855f2b2314856b2f649410b0e2866)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:18.618640 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ccb31b-06a8-4ba6-b37f-3ba266d4dab0 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:18.673739 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-38ccb31b-06a8-4ba6-b37f-3ba266d4dab0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3e855f2b2314856b2f649410b0e2866', 'request_id': 'req-38ccb31b-06a8-4ba6-b37f-3ba266d4dab0'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:18.681723 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-38ccb31b-06a8-4ba6-b37f-3ba266d4dab0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3e855f2b2314856b2f649410b0e2866', 'request_id': 'req-38ccb31b-06a8-4ba6-b37f-3ba266d4dab0'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:18.689573 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-38ccb31b-06a8-4ba6-b37f-3ba266d4dab0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3e855f2b2314856b2f649410b0e2866', 'request_id': 'req-38ccb31b-06a8-4ba6-b37f-3ba266d4dab0'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:18.702475 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef7a35-9639-4d97-9181-819dcfb492b3 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:18.704067 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-d6ef7a35-9639-4d97-9181-819dcfb492b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:18.723364 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-38ccb31b-06a8-4ba6-b37f-3ba266d4dab0 admin admin] The token cache is being invalidate because project d3e855f2b2314856b2f649410b0e2866 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:33:18.723663 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-38ccb31b-06a8-4ba6-b37f-3ba266d4dab0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:18.724409 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-38ccb31b-06a8-4ba6-b37f-3ba266d4dab0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:18.725559 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef7a35-9639-4d97-9181-819dcfb492b3 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:18.731101 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1082/2152] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:33:18 2022] DELETE /identity/v3/projects/d3e855f2b2314856b2f649410b0e2866 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:18.732509 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b7dfd-72f7-405f-828a-11dd7d658b6d None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:18.732797 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b7dfd-72f7-405f-828a-11dd7d658b6d None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:18.733124 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b7dfd-72f7-405f-828a-11dd7d658b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:18.753696 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-736b7dfd-72f7-405f-828a-11dd7d658b6d None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:18.754965 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-736b7dfd-72f7-405f-828a-11dd7d658b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:18.800050 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f714f4-738b-4f5a-a75a-aee90e748fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:18.801133 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f714f4-738b-4f5a-a75a-aee90e748fad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:18.801502 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f714f4-738b-4f5a-a75a-aee90e748fad admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:18.801889 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f714f4-738b-4f5a-a75a-aee90e748fad admin admin] PATH_INFO: `/v3/users/6e83bdc0cdbb4301a2fd596f7900f8d8` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:18.803550 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f714f4-738b-4f5a-a75a-aee90e748fad admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e83bdc0cdbb4301a2fd596f7900f8d8)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:18.805745 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f714f4-738b-4f5a-a75a-aee90e748fad admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:18.838807 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1083/2153] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:33:18.847858 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53369ac-c47e-4cd1-8c13-9ee69e6b4518 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:18.848145 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53369ac-c47e-4cd1-8c13-9ee69e6b4518 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:18.848420 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53369ac-c47e-4cd1-8c13-9ee69e6b4518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:18.853584 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-34f714f4-738b-4f5a-a75a-aee90e748fad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e83bdc0cdbb4301a2fd596f7900f8d8'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:18.854251 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-34f714f4-738b-4f5a-a75a-aee90e748fad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e83bdc0cdbb4301a2fd596f7900f8d8'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:18.866119 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-f53369ac-c47e-4cd1-8c13-9ee69e6b4518 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:18.866572 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-34f714f4-738b-4f5a-a75a-aee90e748fad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e83bdc0cdbb4301a2fd596f7900f8d8'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:18.867365 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-f53369ac-c47e-4cd1-8c13-9ee69e6b4518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:18.873500 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-34f714f4-738b-4f5a-a75a-aee90e748fad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e83bdc0cdbb4301a2fd596f7900f8d8'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:18.875881 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1084/2154] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:33:18.880197 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53369ac-c47e-4cd1-8c13-9ee69e6b4518 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:18.880510 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-34f714f4-738b-4f5a-a75a-aee90e748fad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e83bdc0cdbb4301a2fd596f7900f8d8'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:18.886446 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1071/2155] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:33:18 2022] DELETE /identity/v3/users/6e83bdc0cdbb4301a2fd596f7900f8d8 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:33:18.891252 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5540b23-75f3-4034-a7d5-c7267c101950 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:18.891541 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5540b23-75f3-4034-a7d5-c7267c101950 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:18.891819 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5540b23-75f3-4034-a7d5-c7267c101950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:18.892247 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53369ac-c47e-4cd1-8c13-9ee69e6b4518 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:18.911154 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-f5540b23-75f3-4034-a7d5-c7267c101950 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:18.912363 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-f5540b23-75f3-4034-a7d5-c7267c101950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:18.948849 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9e58f-d9c5-4ef7-8afd-191ed45c47c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:18.949418 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9e58f-d9c5-4ef7-8afd-191ed45c47c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:18.949696 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9e58f-d9c5-4ef7-8afd-191ed45c47c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:18.949964 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9e58f-d9c5-4ef7-8afd-191ed45c47c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:18.951293 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f9e58f-d9c5-4ef7-8afd-191ed45c47c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:33:18.951592 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f9e58f-d9c5-4ef7-8afd-191ed45c47c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:18.953924 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f9e58f-d9c5-4ef7-8afd-191ed45c47c4 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:18.968712 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1085/2156] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:33:18.969848 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9e58f-d9c5-4ef7-8afd-191ed45c47c4 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:18.972005 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1072/2157] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:33:18.979986 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9e58f-d9c5-4ef7-8afd-191ed45c47c4 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:18.983354 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5540b23-75f3-4034-a7d5-c7267c101950 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:18.984657 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-f5540b23-75f3-4034-a7d5-c7267c101950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:18.988122 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147798d7-3b80-424d-a2e0-83dabd42547f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:18.988775 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147798d7-3b80-424d-a2e0-83dabd42547f admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:18.989108 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147798d7-3b80-424d-a2e0-83dabd42547f admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:18.989387 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147798d7-3b80-424d-a2e0-83dabd42547f admin admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:18.990126 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147798d7-3b80-424d-a2e0-83dabd42547f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:18.992138 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147798d7-3b80-424d-a2e0-83dabd42547f admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:19.022032 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1086/2158] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:33:18 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:33:19.026074 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147798d7-3b80-424d-a2e0-83dabd42547f admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:19.043338 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5540b23-75f3-4034-a7d5-c7267c101950 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:19.087661 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147798d7-3b80-424d-a2e0-83dabd42547f admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:19.092006 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18617ad7-98d5-4e7a-8c6d-f793874742b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:19.092651 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18617ad7-98d5-4e7a-8c6d-f793874742b9 service neutron] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:19.092936 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18617ad7-98d5-4e7a-8c6d-f793874742b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:19.093207 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18617ad7-98d5-4e7a-8c6d-f793874742b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:19.093825 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f15a0-7356-4f52-a28b-64487951a6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:19.094577 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f15a0-7356-4f52-a28b-64487951a6a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:19.094899 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f15a0-7356-4f52-a28b-64487951a6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:19.095198 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f15a0-7356-4f52-a28b-64487951a6a7 admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:19.095902 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f15a0-7356-4f52-a28b-64487951a6a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:19.097806 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f15a0-7356-4f52-a28b-64487951a6a7 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:19.102487 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18617ad7-98d5-4e7a-8c6d-f793874742b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:19.103937 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18617ad7-98d5-4e7a-8c6d-f793874742b9 service neutron] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:19.115105 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1073/2159] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:33:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:33:19.119195 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1087/2160] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:33:19 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:33:19.123350 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18617ad7-98d5-4e7a-8c6d-f793874742b9 service neutron] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:19.132770 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18617ad7-98d5-4e7a-8c6d-f793874742b9 service neutron] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:19.137647 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7de969-8ae2-403c-a95d-0765248d7de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:19.138890 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7de969-8ae2-403c-a95d-0765248d7de0 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:19.139170 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7de969-8ae2-403c-a95d-0765248d7de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:19.139443 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7de969-8ae2-403c-a95d-0765248d7de0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:19.140154 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7de969-8ae2-403c-a95d-0765248d7de0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:19.141768 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7de969-8ae2-403c-a95d-0765248d7de0 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:19.151791 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1074/2161] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:33:19.156644 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f15a0-7356-4f52-a28b-64487951a6a7 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:19.169687 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f15a0-7356-4f52-a28b-64487951a6a7 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:19.177338 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b60786-8c7a-4d88-b5df-adbee47d6579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:19.178226 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b60786-8c7a-4d88-b5df-adbee47d6579 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:19.178649 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b60786-8c7a-4d88-b5df-adbee47d6579 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:19.179017 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b60786-8c7a-4d88-b5df-adbee47d6579 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:19.179815 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b60786-8c7a-4d88-b5df-adbee47d6579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:19.181435 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b60786-8c7a-4d88-b5df-adbee47d6579 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:19.192528 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1088/2162] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:33:19.196996 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7de969-8ae2-403c-a95d-0765248d7de0 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:19.207508 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7de969-8ae2-403c-a95d-0765248d7de0 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:19.212384 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d68e8c-f90e-4d08-bfb6-574016c31b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:19.213261 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d68e8c-f90e-4d08-bfb6-574016c31b3c admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:19.213546 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d68e8c-f90e-4d08-bfb6-574016c31b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:19.213816 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d68e8c-f90e-4d08-bfb6-574016c31b3c admin admin] PATH_INFO: `/v3/projects/9decabdb588e4bb5b8debbab9a70cb40/users/ce564281c2d44630976686ef31e904ff/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:19.229959 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d68e8c-f90e-4d08-bfb6-574016c31b3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9decabdb588e4bb5b8debbab9a70cb40, user_id=ce564281c2d44630976686ef31e904ff, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:19.232993 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d68e8c-f90e-4d08-bfb6-574016c31b3c admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:19.246019 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1075/2163] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:33:19 2022] PUT /identity/v3/projects/9decabdb588e4bb5b8debbab9a70cb40/users/ce564281c2d44630976686ef31e904ff/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:19.257939 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd44f39-6a73-48fb-9e35-5c0b1d1566d0 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:19.258252 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd44f39-6a73-48fb-9e35-5c0b1d1566d0 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:19.258540 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd44f39-6a73-48fb-9e35-5c0b1d1566d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:19.286537 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-0fd44f39-6a73-48fb-9e35-5c0b1d1566d0 None None] MFA Rules not processed for user `ce564281c2d44630976686ef31e904ff`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:19.287971 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-0fd44f39-6a73-48fb-9e35-5c0b1d1566d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:19.354552 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1089/2164] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:33:19.369733 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d68e8c-f90e-4d08-bfb6-574016c31b3c admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:19.371919 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-b4d68e8c-f90e-4d08-bfb6-574016c31b3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:19.405691 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd44f39-6a73-48fb-9e35-5c0b1d1566d0 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:19.407408 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-0fd44f39-6a73-48fb-9e35-5c0b1d1566d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:19.440909 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d68e8c-f90e-4d08-bfb6-574016c31b3c admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:19.444954 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6951e-73ce-42d7-b75c-6208c63c2521 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:19.445796 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6951e-73ce-42d7-b75c-6208c63c2521 service cinder] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:19.446077 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6951e-73ce-42d7-b75c-6208c63c2521 service cinder] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:19.446358 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6951e-73ce-42d7-b75c-6208c63c2521 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:19.456027 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e6951e-73ce-42d7-b75c-6208c63c2521 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:19.457460 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e6951e-73ce-42d7-b75c-6208c63c2521 service cinder] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:19.469246 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1076/2165] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:33:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:33:19.489050 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd44f39-6a73-48fb-9e35-5c0b1d1566d0 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:19.493918 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f220eb2-e1b9-4ef5-aadc-66de6b5d3716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:19.495006 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f220eb2-e1b9-4ef5-aadc-66de6b5d3716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:19.495395 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f220eb2-e1b9-4ef5-aadc-66de6b5d3716 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:19.495776 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f220eb2-e1b9-4ef5-aadc-66de6b5d3716 admin admin] PATH_INFO: `/v3/projects/0b073443c9ea4de8a48a589cf86daa3f` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:19.504857 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f220eb2-e1b9-4ef5-aadc-66de6b5d3716 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b073443c9ea4de8a48a589cf86daa3f)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:19.507075 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f220eb2-e1b9-4ef5-aadc-66de6b5d3716 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:19.562916 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-0f220eb2-e1b9-4ef5-aadc-66de6b5d3716 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b073443c9ea4de8a48a589cf86daa3f', 'request_id': 'req-0f220eb2-e1b9-4ef5-aadc-66de6b5d3716'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:19.568986 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-0f220eb2-e1b9-4ef5-aadc-66de6b5d3716 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b073443c9ea4de8a48a589cf86daa3f', 'request_id': 'req-0f220eb2-e1b9-4ef5-aadc-66de6b5d3716'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:19.577503 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-0f220eb2-e1b9-4ef5-aadc-66de6b5d3716 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b073443c9ea4de8a48a589cf86daa3f', 'request_id': 'req-0f220eb2-e1b9-4ef5-aadc-66de6b5d3716'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:19.597016 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-0f220eb2-e1b9-4ef5-aadc-66de6b5d3716 admin admin] The token cache is being invalidate because project 0b073443c9ea4de8a48a589cf86daa3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:33:19.597278 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-0f220eb2-e1b9-4ef5-aadc-66de6b5d3716 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:19.597973 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-0f220eb2-e1b9-4ef5-aadc-66de6b5d3716 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:19.599826 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1090/2166] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:33:19 2022] DELETE /identity/v3/projects/0b073443c9ea4de8a48a589cf86daa3f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:33:19.603996 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6951e-73ce-42d7-b75c-6208c63c2521 service cinder] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:19.622696 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6951e-73ce-42d7-b75c-6208c63c2521 service cinder] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:19.697878 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff495c-013e-4a62-a275-9957dab15745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:19.699428 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff495c-013e-4a62-a275-9957dab15745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:19.699708 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff495c-013e-4a62-a275-9957dab15745 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:19.699979 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff495c-013e-4a62-a275-9957dab15745 admin admin] PATH_INFO: `/v3/users/31ab28b534d0420fb54c5023c40190d3` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:19.702980 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ff495c-013e-4a62-a275-9957dab15745 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31ab28b534d0420fb54c5023c40190d3)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:19.705066 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ff495c-013e-4a62-a275-9957dab15745 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:19.762314 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-61ff495c-013e-4a62-a275-9957dab15745 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31ab28b534d0420fb54c5023c40190d3'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:19.762829 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-61ff495c-013e-4a62-a275-9957dab15745 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31ab28b534d0420fb54c5023c40190d3'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:19.781771 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-61ff495c-013e-4a62-a275-9957dab15745 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31ab28b534d0420fb54c5023c40190d3'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:19.793339 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-61ff495c-013e-4a62-a275-9957dab15745 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31ab28b534d0420fb54c5023c40190d3'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:19.803303 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-61ff495c-013e-4a62-a275-9957dab15745 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31ab28b534d0420fb54c5023c40190d3'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:19.810992 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1077/2167] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:33:19 2022] DELETE /identity/v3/users/31ab28b534d0420fb54c5023c40190d3 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:20.201264 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f220eb2-e1b9-4ef5-aadc-66de6b5d3716 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:20.202843 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-0f220eb2-e1b9-4ef5-aadc-66de6b5d3716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:20.222888 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f220eb2-e1b9-4ef5-aadc-66de6b5d3716 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:20.310994 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b13fe76-f90e-42ad-a1cc-b52ff831e2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:20.312064 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13fe76-f90e-42ad-a1cc-b52ff831e2f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:20.312464 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13fe76-f90e-42ad-a1cc-b52ff831e2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:20.312844 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13fe76-f90e-42ad-a1cc-b52ff831e2f9 admin admin] PATH_INFO: `/v3/projects/3bd61756df1345b79d186640f4c59492` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:20.314280 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b13fe76-f90e-42ad-a1cc-b52ff831e2f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bd61756df1345b79d186640f4c59492)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:20.316334 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b13fe76-f90e-42ad-a1cc-b52ff831e2f9 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:20.366100 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-7b13fe76-f90e-42ad-a1cc-b52ff831e2f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bd61756df1345b79d186640f4c59492', 'request_id': 'req-7b13fe76-f90e-42ad-a1cc-b52ff831e2f9'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:20.373178 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-7b13fe76-f90e-42ad-a1cc-b52ff831e2f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bd61756df1345b79d186640f4c59492', 'request_id': 'req-7b13fe76-f90e-42ad-a1cc-b52ff831e2f9'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:20.379709 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-7b13fe76-f90e-42ad-a1cc-b52ff831e2f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bd61756df1345b79d186640f4c59492', 'request_id': 'req-7b13fe76-f90e-42ad-a1cc-b52ff831e2f9'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:20.392419 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-7b13fe76-f90e-42ad-a1cc-b52ff831e2f9 admin admin] The token cache is being invalidate because project 3bd61756df1345b79d186640f4c59492 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:33:20.392708 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-7b13fe76-f90e-42ad-a1cc-b52ff831e2f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:20.393499 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-7b13fe76-f90e-42ad-a1cc-b52ff831e2f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:20.395118 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1091/2168] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:33:20 2022] DELETE /identity/v3/projects/3bd61756df1345b79d186640f4c59492 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:20.400384 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4510e1-cf7a-4011-9aec-6ba5f9cc092c None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:20.400842 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4510e1-cf7a-4011-9aec-6ba5f9cc092c None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:20.401173 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4510e1-cf7a-4011-9aec-6ba5f9cc092c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:20.421940 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-7f4510e1-cf7a-4011-9aec-6ba5f9cc092c None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:20.423190 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-7f4510e1-cf7a-4011-9aec-6ba5f9cc092c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:20.485292 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1078/2169] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:33:20.494389 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eae163-e336-463a-814d-18c1984d56a9 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:20.494622 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eae163-e336-463a-814d-18c1984d56a9 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:20.494907 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eae163-e336-463a-814d-18c1984d56a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:20.514358 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-21eae163-e336-463a-814d-18c1984d56a9 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:20.515608 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-21eae163-e336-463a-814d-18c1984d56a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:20.528030 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1092/2170] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:33:20.531025 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4510e1-cf7a-4011-9aec-6ba5f9cc092c None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:20.540905 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4510e1-cf7a-4011-9aec-6ba5f9cc092c None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:20.546799 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d89637-93bb-4d15-aa13-b673f32ad40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:20.547454 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d89637-93bb-4d15-aa13-b673f32ad40a admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:20.547737 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d89637-93bb-4d15-aa13-b673f32ad40a admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:20.548013 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d89637-93bb-4d15-aa13-b673f32ad40a admin admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:20.548729 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d89637-93bb-4d15-aa13-b673f32ad40a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:33:20.549036 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d89637-93bb-4d15-aa13-b673f32ad40a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:20.550653 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d89637-93bb-4d15-aa13-b673f32ad40a admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:20.562264 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1079/2171] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:33:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:33:20.566328 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eae163-e336-463a-814d-18c1984d56a9 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:20.575374 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eae163-e336-463a-814d-18c1984d56a9 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:20.580170 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8468e2e-c811-4251-8cdf-2976fc5d5593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:20.580816 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8468e2e-c811-4251-8cdf-2976fc5d5593 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:20.581098 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8468e2e-c811-4251-8cdf-2976fc5d5593 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:20.581377 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8468e2e-c811-4251-8cdf-2976fc5d5593 admin admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:20.582070 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8468e2e-c811-4251-8cdf-2976fc5d5593 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:20.583989 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8468e2e-c811-4251-8cdf-2976fc5d5593 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:20.613796 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1093/2172] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:33:20 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:33:20.614963 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d89637-93bb-4d15-aa13-b673f32ad40a admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:20.629022 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d89637-93bb-4d15-aa13-b673f32ad40a admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:20.694371 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad101b-25f7-46b9-8617-ae917e01fea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:20.695078 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad101b-25f7-46b9-8617-ae917e01fea2 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:20.695360 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad101b-25f7-46b9-8617-ae917e01fea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:20.695766 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad101b-25f7-46b9-8617-ae917e01fea2 admin admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:20.696457 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ad101b-25f7-46b9-8617-ae917e01fea2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:20.698366 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ad101b-25f7-46b9-8617-ae917e01fea2 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:20.725175 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1080/2173] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:33:20 2022] POST /identity/v3/users => generated 294 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:33:20.726802 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8468e2e-c811-4251-8cdf-2976fc5d5593 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:20.739940 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8468e2e-c811-4251-8cdf-2976fc5d5593 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:20.745884 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91074606-bb88-403d-88a0-81b772e569ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:20.746860 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91074606-bb88-403d-88a0-81b772e569ac admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:20.747954 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91074606-bb88-403d-88a0-81b772e569ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:20.748378 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91074606-bb88-403d-88a0-81b772e569ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:20.749267 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91074606-bb88-403d-88a0-81b772e569ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:20.751431 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91074606-bb88-403d-88a0-81b772e569ac admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:20.765579 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1094/2174] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:33:20.769766 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad101b-25f7-46b9-8617-ae917e01fea2 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:20.780124 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad101b-25f7-46b9-8617-ae917e01fea2 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:20.785762 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b20f0-aa46-4fa9-bdf3-dc03803cb124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:20.786639 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b20f0-aa46-4fa9-bdf3-dc03803cb124 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:20.786770 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b20f0-aa46-4fa9-bdf3-dc03803cb124 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:20.787011 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b20f0-aa46-4fa9-bdf3-dc03803cb124 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:20.787740 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b20f0-aa46-4fa9-bdf3-dc03803cb124 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:20.789328 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b20f0-aa46-4fa9-bdf3-dc03803cb124 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:20.801749 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1081/2175] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:33:20.806017 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91074606-bb88-403d-88a0-81b772e569ac admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:20.816783 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91074606-bb88-403d-88a0-81b772e569ac admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:20.821620 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da548a27-7153-4091-bbb3-d99a438345f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:20.822494 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da548a27-7153-4091-bbb3-d99a438345f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:20.822806 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da548a27-7153-4091-bbb3-d99a438345f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:20.823080 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da548a27-7153-4091-bbb3-d99a438345f0 admin admin] PATH_INFO: `/v3/projects/b2b104b0f29e4a18905b57bf9276c626/users/bc32cc34276f41d0a765fa618e6d538b/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:20.842545 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da548a27-7153-4091-bbb3-d99a438345f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2b104b0f29e4a18905b57bf9276c626, user_id=bc32cc34276f41d0a765fa618e6d538b, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:20.845615 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da548a27-7153-4091-bbb3-d99a438345f0 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:20.876644 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1095/2176] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:33:20 2022] PUT /identity/v3/projects/b2b104b0f29e4a18905b57bf9276c626/users/bc32cc34276f41d0a765fa618e6d538b/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:33:20.878149 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb415516-65bd-4f0a-87f9-851846f81c2d None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:20.878438 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb415516-65bd-4f0a-87f9-851846f81c2d None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:20.878742 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb415516-65bd-4f0a-87f9-851846f81c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:20.905942 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-cb415516-65bd-4f0a-87f9-851846f81c2d None None] MFA Rules not processed for user `bc32cc34276f41d0a765fa618e6d538b`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:20.907264 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-cb415516-65bd-4f0a-87f9-851846f81c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:20.984529 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1082/2177] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:33:20.988982 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da548a27-7153-4091-bbb3-d99a438345f0 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:21.089909 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da548a27-7153-4091-bbb3-d99a438345f0 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:21.095079 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864aa70b-a5df-46b0-8ee7-e06fabbb1c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:21.095710 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864aa70b-a5df-46b0-8ee7-e06fabbb1c9f admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:21.096013 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864aa70b-a5df-46b0-8ee7-e06fabbb1c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:21.096303 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864aa70b-a5df-46b0-8ee7-e06fabbb1c9f admin admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:21.097005 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864aa70b-a5df-46b0-8ee7-e06fabbb1c9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:21.099122 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864aa70b-a5df-46b0-8ee7-e06fabbb1c9f admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:21.131682 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1096/2178] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:33:20 2022] POST /identity/v3/projects => generated 387 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:33:21.135662 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb415516-65bd-4f0a-87f9-851846f81c2d None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:21.151515 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb415516-65bd-4f0a-87f9-851846f81c2d None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:21.217990 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467fb1ee-cbf8-4397-a3a4-49cba7c59014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:21.218773 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467fb1ee-cbf8-4397-a3a4-49cba7c59014 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:21.219125 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467fb1ee-cbf8-4397-a3a4-49cba7c59014 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:21.219471 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467fb1ee-cbf8-4397-a3a4-49cba7c59014 admin admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:21.220283 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467fb1ee-cbf8-4397-a3a4-49cba7c59014 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:21.223716 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467fb1ee-cbf8-4397-a3a4-49cba7c59014 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:21.248510 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1083/2179] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:33:21 2022] POST /identity/v3/users => generated 294 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:33:21.250423 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864aa70b-a5df-46b0-8ee7-e06fabbb1c9f admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:21.269419 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864aa70b-a5df-46b0-8ee7-e06fabbb1c9f admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:21.274605 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87884329-89f6-4fa4-b69c-8984d3e89192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:21.275540 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87884329-89f6-4fa4-b69c-8984d3e89192 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:21.275982 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87884329-89f6-4fa4-b69c-8984d3e89192 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:21.276359 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87884329-89f6-4fa4-b69c-8984d3e89192 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:21.277637 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87884329-89f6-4fa4-b69c-8984d3e89192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:21.279975 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87884329-89f6-4fa4-b69c-8984d3e89192 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:21.291484 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1097/2180] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:33:21.296537 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467fb1ee-cbf8-4397-a3a4-49cba7c59014 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:21.307430 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467fb1ee-cbf8-4397-a3a4-49cba7c59014 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:21.312973 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7dbb9-7aa3-4e0e-8d69-2d0da692e717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:21.313777 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7dbb9-7aa3-4e0e-8d69-2d0da692e717 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:21.314065 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7dbb9-7aa3-4e0e-8d69-2d0da692e717 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:21.314344 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7dbb9-7aa3-4e0e-8d69-2d0da692e717 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:21.315110 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7dbb9-7aa3-4e0e-8d69-2d0da692e717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:21.316695 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7dbb9-7aa3-4e0e-8d69-2d0da692e717 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:21.327234 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1084/2181] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:33:21.331531 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87884329-89f6-4fa4-b69c-8984d3e89192 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:21.349831 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87884329-89f6-4fa4-b69c-8984d3e89192 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:21.355189 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f714b-35ab-480a-bbff-86d95a0457e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:21.356081 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f714b-35ab-480a-bbff-86d95a0457e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:21.356426 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f714b-35ab-480a-bbff-86d95a0457e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:21.357214 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f714b-35ab-480a-bbff-86d95a0457e7 admin admin] PATH_INFO: `/v3/projects/4a068a4673604d7ba2fd876f34761510/users/180827dd7db24e5da033371a0e88cfcd/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:21.377619 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f714b-35ab-480a-bbff-86d95a0457e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a068a4673604d7ba2fd876f34761510, user_id=180827dd7db24e5da033371a0e88cfcd, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:21.380288 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f714b-35ab-480a-bbff-86d95a0457e7 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:21.394829 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1098/2182] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:33:21 2022] PUT /identity/v3/projects/4a068a4673604d7ba2fd876f34761510/users/180827dd7db24e5da033371a0e88cfcd/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:21.407294 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84871ef0-bf73-4330-9238-1e24ada9be7b None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:21.407762 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84871ef0-bf73-4330-9238-1e24ada9be7b None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:21.407855 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84871ef0-bf73-4330-9238-1e24ada9be7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:21.456652 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-84871ef0-bf73-4330-9238-1e24ada9be7b None None] MFA Rules not processed for user `180827dd7db24e5da033371a0e88cfcd`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:21.458521 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-84871ef0-bf73-4330-9238-1e24ada9be7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:21.560062 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1085/2183] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:33:21.561570 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f714b-35ab-480a-bbff-86d95a0457e7 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:21.646059 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f714b-35ab-480a-bbff-86d95a0457e7 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:21.651778 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df648a02-810a-489a-844d-649e0d93dda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:21.652491 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df648a02-810a-489a-844d-649e0d93dda3 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:21.652977 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df648a02-810a-489a-844d-649e0d93dda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:21.653098 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df648a02-810a-489a-844d-649e0d93dda3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:21.654585 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df648a02-810a-489a-844d-649e0d93dda3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:21.663765 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df648a02-810a-489a-844d-649e0d93dda3 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:21.710654 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1099/2184] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:33:21 2022] POST /identity/v3/projects => generated 385 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:33:21.714842 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84871ef0-bf73-4330-9238-1e24ada9be7b None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:21.726017 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84871ef0-bf73-4330-9238-1e24ada9be7b None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:21.781589 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5f4ca-e087-429f-a6fc-671ebab02300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:21.782208 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5f4ca-e087-429f-a6fc-671ebab02300 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:21.782486 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5f4ca-e087-429f-a6fc-671ebab02300 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:21.782790 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5f4ca-e087-429f-a6fc-671ebab02300 admin admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:21.783482 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd5f4ca-e087-429f-a6fc-671ebab02300 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:21.785375 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd5f4ca-e087-429f-a6fc-671ebab02300 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:21.804837 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1086/2185] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:33:21 2022] POST /identity/v3/users => generated 299 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:33:21.808806 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df648a02-810a-489a-844d-649e0d93dda3 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:21.820525 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df648a02-810a-489a-844d-649e0d93dda3 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:21.828100 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88cf8f-b5c6-44ab-bf73-421eee6e3e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:21.828807 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88cf8f-b5c6-44ab-bf73-421eee6e3e46 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:21.829110 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88cf8f-b5c6-44ab-bf73-421eee6e3e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:21.829361 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88cf8f-b5c6-44ab-bf73-421eee6e3e46 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:21.830317 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d88cf8f-b5c6-44ab-bf73-421eee6e3e46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:21.831907 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d88cf8f-b5c6-44ab-bf73-421eee6e3e46 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:21.846955 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1100/2186] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:33:21.858711 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5f4ca-e087-429f-a6fc-671ebab02300 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:21.868698 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5f4ca-e087-429f-a6fc-671ebab02300 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:21.874296 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e5165-d00e-41af-84e9-27d4b9a7a133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:21.875200 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e5165-d00e-41af-84e9-27d4b9a7a133 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:21.875496 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e5165-d00e-41af-84e9-27d4b9a7a133 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:21.875753 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e5165-d00e-41af-84e9-27d4b9a7a133 admin admin] PATH_INFO: `/v3/projects/be32f3a45daa4a088697bea8d21927cf/users/dbb5c654e4694075ab25e4517ba42e0b/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:21.894332 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e5165-d00e-41af-84e9-27d4b9a7a133 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be32f3a45daa4a088697bea8d21927cf, user_id=dbb5c654e4694075ab25e4517ba42e0b, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:21.897135 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e5165-d00e-41af-84e9-27d4b9a7a133 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:21.911767 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1087/2187] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:33:21 2022] PUT /identity/v3/projects/be32f3a45daa4a088697bea8d21927cf/users/dbb5c654e4694075ab25e4517ba42e0b/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:21.915589 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88cf8f-b5c6-44ab-bf73-421eee6e3e46 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:21.925983 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88cf8f-b5c6-44ab-bf73-421eee6e3e46 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:21.982346 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f0bf0-388b-4476-9603-2fe736f9374d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:21.983041 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f0bf0-388b-4476-9603-2fe736f9374d admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:21.983329 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f0bf0-388b-4476-9603-2fe736f9374d admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:21.983635 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f0bf0-388b-4476-9603-2fe736f9374d admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:21.984353 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483f0bf0-388b-4476-9603-2fe736f9374d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:21.985939 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483f0bf0-388b-4476-9603-2fe736f9374d admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:21.995579 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1101/2188] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:33:22.000232 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e5165-d00e-41af-84e9-27d4b9a7a133 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:22.012510 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e5165-d00e-41af-84e9-27d4b9a7a133 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:22.017517 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e014b-0e0c-4cef-a922-8a1c15853d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:22.018408 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e014b-0e0c-4cef-a922-8a1c15853d93 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:22.018712 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e014b-0e0c-4cef-a922-8a1c15853d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:22.018993 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e014b-0e0c-4cef-a922-8a1c15853d93 admin admin] PATH_INFO: `/v3/projects/be32f3a45daa4a088697bea8d21927cf/users/dbb5c654e4694075ab25e4517ba42e0b/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:22.020954 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e014b-0e0c-4cef-a922-8a1c15853d93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be32f3a45daa4a088697bea8d21927cf, user_id=dbb5c654e4694075ab25e4517ba42e0b, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:22.023630 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e014b-0e0c-4cef-a922-8a1c15853d93 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:22.034868 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1088/2189] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:33:21 2022] PUT /identity/v3/projects/be32f3a45daa4a088697bea8d21927cf/users/dbb5c654e4694075ab25e4517ba42e0b/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:22.045540 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7a123-5896-49e3-93a9-3600e05e9f5c None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:22.045855 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7a123-5896-49e3-93a9-3600e05e9f5c None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:22.046136 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7a123-5896-49e3-93a9-3600e05e9f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:22.073397 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-d0a7a123-5896-49e3-93a9-3600e05e9f5c None None] MFA Rules not processed for user `dbb5c654e4694075ab25e4517ba42e0b`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:22.074629 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-d0a7a123-5896-49e3-93a9-3600e05e9f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:22.144630 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1102/2190] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:22 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:33:22.160497 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e014b-0e0c-4cef-a922-8a1c15853d93 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:22.162157 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-5d4e014b-0e0c-4cef-a922-8a1c15853d93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:22.219035 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e014b-0e0c-4cef-a922-8a1c15853d93 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:22.222718 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee15e20-a799-4713-9d18-b5723434dae4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:22.223357 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee15e20-a799-4713-9d18-b5723434dae4 service cinder] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:22.223635 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee15e20-a799-4713-9d18-b5723434dae4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:22.223907 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee15e20-a799-4713-9d18-b5723434dae4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:22.233385 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee15e20-a799-4713-9d18-b5723434dae4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:22.234836 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee15e20-a799-4713-9d18-b5723434dae4 service cinder] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:22.243995 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1089/2191] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:33:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:33:22.715707 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7a123-5896-49e3-93a9-3600e05e9f5c None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:22.718415 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-d0a7a123-5896-49e3-93a9-3600e05e9f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:22.733197 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7a123-5896-49e3-93a9-3600e05e9f5c None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:22.735442 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee15e20-a799-4713-9d18-b5723434dae4 service cinder] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:22.737486 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-bee15e20-a799-4713-9d18-b5723434dae4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:22.738666 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7d60f-d5db-48fa-99f1-36138181cbfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:22.739300 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7d60f-d5db-48fa-99f1-36138181cbfe service cinder] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:22.739583 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7d60f-d5db-48fa-99f1-36138181cbfe service cinder] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:22.739855 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7d60f-d5db-48fa-99f1-36138181cbfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:22.811710 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed7d60f-d5db-48fa-99f1-36138181cbfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:22.813261 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed7d60f-d5db-48fa-99f1-36138181cbfe service cinder] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:22.814251 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee15e20-a799-4713-9d18-b5723434dae4 service cinder] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:22.818861 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc696f56-ab13-4512-adb3-b2bf2065cf12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:22.819761 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc696f56-ab13-4512-adb3-b2bf2065cf12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:22.819986 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc696f56-ab13-4512-adb3-b2bf2065cf12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:22.820257 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc696f56-ab13-4512-adb3-b2bf2065cf12 admin admin] PATH_INFO: `/v3/users/ce564281c2d44630976686ef31e904ff` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:22.821465 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc696f56-ab13-4512-adb3-b2bf2065cf12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce564281c2d44630976686ef31e904ff)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:22.822835 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1103/2192] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:33:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:33:22.823517 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc696f56-ab13-4512-adb3-b2bf2065cf12 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:22.876823 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-fc696f56-ab13-4512-adb3-b2bf2065cf12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce564281c2d44630976686ef31e904ff'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:22.877566 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-fc696f56-ab13-4512-adb3-b2bf2065cf12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce564281c2d44630976686ef31e904ff'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:22.889335 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-fc696f56-ab13-4512-adb3-b2bf2065cf12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce564281c2d44630976686ef31e904ff'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:22.896694 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-fc696f56-ab13-4512-adb3-b2bf2065cf12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce564281c2d44630976686ef31e904ff'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:22.904270 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-fc696f56-ab13-4512-adb3-b2bf2065cf12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce564281c2d44630976686ef31e904ff'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:22.910190 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1090/2193] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:33:22 2022] DELETE /identity/v3/users/ce564281c2d44630976686ef31e904ff => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:33:22.914724 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5ccbd-c8b0-4855-998b-efcbfe2b8c0b None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:22.915214 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5ccbd-c8b0-4855-998b-efcbfe2b8c0b None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:22.915585 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5ccbd-c8b0-4855-998b-efcbfe2b8c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:22.933565 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-45c5ccbd-c8b0-4855-998b-efcbfe2b8c0b None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:22.936132 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-45c5ccbd-c8b0-4855-998b-efcbfe2b8c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:23.013237 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1104/2194] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:33:23.023124 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc696f56-ab13-4512-adb3-b2bf2065cf12 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:23.024591 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-fc696f56-ab13-4512-adb3-b2bf2065cf12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:23.098927 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc696f56-ab13-4512-adb3-b2bf2065cf12 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:23.105002 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fbd495-69d4-451c-9c78-58088306ec3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:23.105851 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbd495-69d4-451c-9c78-58088306ec3b service neutron] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:23.106276 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbd495-69d4-451c-9c78-58088306ec3b service neutron] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:23.106791 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbd495-69d4-451c-9c78-58088306ec3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:23.117189 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fbd495-69d4-451c-9c78-58088306ec3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:23.118653 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fbd495-69d4-451c-9c78-58088306ec3b service neutron] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:23.129473 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1091/2195] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:33:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:33:23.397469 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c5ccbd-c8b0-4855-998b-efcbfe2b8c0b None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:23.399012 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-45c5ccbd-c8b0-4855-998b-efcbfe2b8c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:23.412025 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c5ccbd-c8b0-4855-998b-efcbfe2b8c0b None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:23.417033 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4cbaa-3907-4073-9aca-3a2d534e17bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:23.417978 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4cbaa-3907-4073-9aca-3a2d534e17bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:23.418370 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4cbaa-3907-4073-9aca-3a2d534e17bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:23.418681 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4cbaa-3907-4073-9aca-3a2d534e17bf admin admin] PATH_INFO: `/v3/projects/9decabdb588e4bb5b8debbab9a70cb40` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:23.420454 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d4cbaa-3907-4073-9aca-3a2d534e17bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9decabdb588e4bb5b8debbab9a70cb40)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:23.422388 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d4cbaa-3907-4073-9aca-3a2d534e17bf admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:23.469327 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-38d4cbaa-3907-4073-9aca-3a2d534e17bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9decabdb588e4bb5b8debbab9a70cb40', 'request_id': 'req-38d4cbaa-3907-4073-9aca-3a2d534e17bf'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:23.474563 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-38d4cbaa-3907-4073-9aca-3a2d534e17bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9decabdb588e4bb5b8debbab9a70cb40', 'request_id': 'req-38d4cbaa-3907-4073-9aca-3a2d534e17bf'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:23.480510 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-38d4cbaa-3907-4073-9aca-3a2d534e17bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9decabdb588e4bb5b8debbab9a70cb40', 'request_id': 'req-38d4cbaa-3907-4073-9aca-3a2d534e17bf'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:23.492555 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-38d4cbaa-3907-4073-9aca-3a2d534e17bf admin admin] The token cache is being invalidate because project 9decabdb588e4bb5b8debbab9a70cb40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:33:23.492836 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-38d4cbaa-3907-4073-9aca-3a2d534e17bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:23.493450 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-38d4cbaa-3907-4073-9aca-3a2d534e17bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:23.494984 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1105/2196] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:33:23 2022] DELETE /identity/v3/projects/9decabdb588e4bb5b8debbab9a70cb40 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:23.500007 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713966ce-4c9a-4473-838e-ab232409033a None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:23.500297 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713966ce-4c9a-4473-838e-ab232409033a None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:23.500584 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713966ce-4c9a-4473-838e-ab232409033a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:23.518063 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-713966ce-4c9a-4473-838e-ab232409033a None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:23.519306 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-713966ce-4c9a-4473-838e-ab232409033a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:23.576154 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1092/2197] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:33:23.584133 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cfbc4b-aaa2-4127-ac39-320c54835d26 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:23.584403 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cfbc4b-aaa2-4127-ac39-320c54835d26 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:23.584677 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cfbc4b-aaa2-4127-ac39-320c54835d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:23.603096 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-33cfbc4b-aaa2-4127-ac39-320c54835d26 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:23.604230 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-33cfbc4b-aaa2-4127-ac39-320c54835d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:23.613004 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1106/2198] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:33:23.617096 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713966ce-4c9a-4473-838e-ab232409033a None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:23.628009 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713966ce-4c9a-4473-838e-ab232409033a None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:23.632665 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a088d8-2ad0-4a24-b240-6e59def1d0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:23.633311 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a088d8-2ad0-4a24-b240-6e59def1d0cd admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:23.633590 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a088d8-2ad0-4a24-b240-6e59def1d0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:23.633866 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a088d8-2ad0-4a24-b240-6e59def1d0cd admin admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:23.634576 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a088d8-2ad0-4a24-b240-6e59def1d0cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:33:23.634911 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a088d8-2ad0-4a24-b240-6e59def1d0cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:23.636492 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a088d8-2ad0-4a24-b240-6e59def1d0cd admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:23.648570 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1093/2199] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:33:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:33:23.652968 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cfbc4b-aaa2-4127-ac39-320c54835d26 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:23.662707 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cfbc4b-aaa2-4127-ac39-320c54835d26 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:23.667327 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7149e17e-ef38-4f0d-996e-2b204262332b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:23.667961 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149e17e-ef38-4f0d-996e-2b204262332b admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:23.668241 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149e17e-ef38-4f0d-996e-2b204262332b admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:23.668515 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149e17e-ef38-4f0d-996e-2b204262332b admin admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:23.669766 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7149e17e-ef38-4f0d-996e-2b204262332b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:23.671881 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7149e17e-ef38-4f0d-996e-2b204262332b admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:23.697485 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1107/2200] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:33:23 2022] POST /identity/v3/projects => generated 387 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:33:23.701181 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a088d8-2ad0-4a24-b240-6e59def1d0cd admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:23.711090 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a088d8-2ad0-4a24-b240-6e59def1d0cd admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:23.764744 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814511c-6302-449c-a47d-bf9abfefb5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:23.765382 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814511c-6302-449c-a47d-bf9abfefb5b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:23.765669 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814511c-6302-449c-a47d-bf9abfefb5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:23.765946 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814511c-6302-449c-a47d-bf9abfefb5b9 admin admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:23.766663 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e814511c-6302-449c-a47d-bf9abfefb5b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:23.768654 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e814511c-6302-449c-a47d-bf9abfefb5b9 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:23.789767 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1094/2201] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:33:23 2022] POST /identity/v3/users => generated 294 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:33:23.792831 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7149e17e-ef38-4f0d-996e-2b204262332b admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:23.803658 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7149e17e-ef38-4f0d-996e-2b204262332b admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:23.808291 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ab781-9e32-45d4-a564-f50738d9acfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:23.808936 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ab781-9e32-45d4-a564-f50738d9acfb admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:23.809218 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ab781-9e32-45d4-a564-f50738d9acfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:23.809609 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ab781-9e32-45d4-a564-f50738d9acfb admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:23.810425 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724ab781-9e32-45d4-a564-f50738d9acfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:23.812027 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724ab781-9e32-45d4-a564-f50738d9acfb admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:23.822126 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1108/2202] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:33:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:33:23.826562 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814511c-6302-449c-a47d-bf9abfefb5b9 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:23.836592 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814511c-6302-449c-a47d-bf9abfefb5b9 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:23.841780 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383bdecd-1fc5-4114-b9c8-2b602f1758ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:23.842450 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bdecd-1fc5-4114-b9c8-2b602f1758ed admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:23.842774 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bdecd-1fc5-4114-b9c8-2b602f1758ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:23.843049 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bdecd-1fc5-4114-b9c8-2b602f1758ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:23.843771 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383bdecd-1fc5-4114-b9c8-2b602f1758ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:23.845363 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383bdecd-1fc5-4114-b9c8-2b602f1758ed admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:23.856066 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1095/2203] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:33:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:33:23.860049 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ab781-9e32-45d4-a564-f50738d9acfb admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:23.869827 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ab781-9e32-45d4-a564-f50738d9acfb admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:23.874732 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b673c0c5-1e0a-435d-8f71-a2c5cdb10d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:23.875823 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673c0c5-1e0a-435d-8f71-a2c5cdb10d3f admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:23.876101 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673c0c5-1e0a-435d-8f71-a2c5cdb10d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:23.876376 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673c0c5-1e0a-435d-8f71-a2c5cdb10d3f admin admin] PATH_INFO: `/v3/projects/303eac921f124ecdadd26f8c34c50576/users/b6450175fd4145cf8399ccc6b9a2cd60/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:23.891160 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b673c0c5-1e0a-435d-8f71-a2c5cdb10d3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=303eac921f124ecdadd26f8c34c50576, user_id=b6450175fd4145cf8399ccc6b9a2cd60, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:23.893765 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b673c0c5-1e0a-435d-8f71-a2c5cdb10d3f admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:23.907675 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1109/2204] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:33:23 2022] PUT /identity/v3/projects/303eac921f124ecdadd26f8c34c50576/users/b6450175fd4145cf8399ccc6b9a2cd60/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:23.917875 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba427bb-ff60-4f96-8f64-46aeed0b3ecb None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:23.918171 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba427bb-ff60-4f96-8f64-46aeed0b3ecb None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:23.918452 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba427bb-ff60-4f96-8f64-46aeed0b3ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:23.947363 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-fba427bb-ff60-4f96-8f64-46aeed0b3ecb None None] MFA Rules not processed for user `b6450175fd4145cf8399ccc6b9a2cd60`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:23.948546 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-fba427bb-ff60-4f96-8f64-46aeed0b3ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:24.015848 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1096/2205] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:33:24.026259 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b673c0c5-1e0a-435d-8f71-a2c5cdb10d3f admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:24.027952 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-b673c0c5-1e0a-435d-8f71-a2c5cdb10d3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:24.082737 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b673c0c5-1e0a-435d-8f71-a2c5cdb10d3f admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:24.086868 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391f667-61a2-4805-8035-59353ab20b34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:24.087494 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391f667-61a2-4805-8035-59353ab20b34 service cinder] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:24.087767 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391f667-61a2-4805-8035-59353ab20b34 service cinder] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:24.088040 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391f667-61a2-4805-8035-59353ab20b34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:24.097395 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9391f667-61a2-4805-8035-59353ab20b34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:24.098813 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9391f667-61a2-4805-8035-59353ab20b34 service cinder] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:24.107348 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1110/2206] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:33:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:33:26.368005 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68bc9c-a1cc-41c3-9949-0baafacb216a None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:26.368642 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68bc9c-a1cc-41c3-9949-0baafacb216a None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:26.368642 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68bc9c-a1cc-41c3-9949-0baafacb216a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:26.394377 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-9c68bc9c-a1cc-41c3-9949-0baafacb216a None None] MFA Rules not processed for user `1c1284bfe6cc43848731ed2b3d9e914b`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:26.396396 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-9c68bc9c-a1cc-41c3-9949-0baafacb216a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:26.473148 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1097/2207] 10.222.0.21 () {58 vars in 1009 bytes} [Mon Feb 28 10:33:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:33:26.525414 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391f667-61a2-4805-8035-59353ab20b34 service cinder] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:26.527127 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-9391f667-61a2-4805-8035-59353ab20b34 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:26.613422 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391f667-61a2-4805-8035-59353ab20b34 service cinder] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:26.618980 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b1f08-76bf-49c0-8238-570dee3a5dc8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8696fe8a37aa4d73a62bdc2efd35a23d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:26.620286 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b1f08-76bf-49c0-8238-570dee3a5dc8 service swift] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:26.620286 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b1f08-76bf-49c0-8238-570dee3a5dc8 service swift] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:26.620658 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b1f08-76bf-49c0-8238-570dee3a5dc8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:26.630737 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b1f08-76bf-49c0-8238-570dee3a5dc8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:26.632324 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b1f08-76bf-49c0-8238-570dee3a5dc8 service swift] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:26.642099 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1111/2208] 10.222.0.21 () {60 vars in 1384 bytes} [Mon Feb 28 10:33:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 10:33:31.148521 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68bc9c-a1cc-41c3-9949-0baafacb216a None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:31.149997 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-9c68bc9c-a1cc-41c3-9949-0baafacb216a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:31.162738 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68bc9c-a1cc-41c3-9949-0baafacb216a None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:31.166888 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef174a9-12fb-437d-9860-303658ddad55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:31.167535 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef174a9-12fb-437d-9860-303658ddad55 service cinder] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:31.167822 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef174a9-12fb-437d-9860-303658ddad55 service cinder] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:31.168166 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef174a9-12fb-437d-9860-303658ddad55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:31.170692 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-fef174a9-12fb-437d-9860-303658ddad55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:31.227869 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef174a9-12fb-437d-9860-303658ddad55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:31.229310 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef174a9-12fb-437d-9860-303658ddad55 service cinder] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:31.239455 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1098/2209] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:33:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:33:36.844871 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b1f08-76bf-49c0-8238-570dee3a5dc8 service swift] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:36.847630 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-b87b1f08-76bf-49c0-8238-570dee3a5dc8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:36.925382 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b1f08-76bf-49c0-8238-570dee3a5dc8 service swift] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:36.930043 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fbdc32-c8c3-4fad-974a-1614dae7e534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:36.931143 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fbdc32-c8c3-4fad-974a-1614dae7e534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:36.931492 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fbdc32-c8c3-4fad-974a-1614dae7e534 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:36.931829 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fbdc32-c8c3-4fad-974a-1614dae7e534 admin admin] PATH_INFO: `/v3/users/bc32cc34276f41d0a765fa618e6d538b` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:36.933088 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fbdc32-c8c3-4fad-974a-1614dae7e534 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc32cc34276f41d0a765fa618e6d538b)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:36.935877 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fbdc32-c8c3-4fad-974a-1614dae7e534 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:36.986970 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-55fbdc32-c8c3-4fad-974a-1614dae7e534 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc32cc34276f41d0a765fa618e6d538b'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:36.994370 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-55fbdc32-c8c3-4fad-974a-1614dae7e534 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc32cc34276f41d0a765fa618e6d538b'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:36.995004 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-55fbdc32-c8c3-4fad-974a-1614dae7e534 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc32cc34276f41d0a765fa618e6d538b'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:37.007242 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-55fbdc32-c8c3-4fad-974a-1614dae7e534 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc32cc34276f41d0a765fa618e6d538b'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:37.013862 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-55fbdc32-c8c3-4fad-974a-1614dae7e534 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc32cc34276f41d0a765fa618e6d538b'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:37.019850 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1112/2210] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:33:36 2022] DELETE /identity/v3/users/bc32cc34276f41d0a765fa618e6d538b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:37.024332 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c0d48-cec1-4fc5-a29e-07b506c0f7d2 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:37.024822 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c0d48-cec1-4fc5-a29e-07b506c0f7d2 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:37.024925 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c0d48-cec1-4fc5-a29e-07b506c0f7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:37.042529 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-416c0d48-cec1-4fc5-a29e-07b506c0f7d2 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:37.044391 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-416c0d48-cec1-4fc5-a29e-07b506c0f7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:37.100559 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1099/2211] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:33:37.111044 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fbdc32-c8c3-4fad-974a-1614dae7e534 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:37.112447 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-55fbdc32-c8c3-4fad-974a-1614dae7e534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:37.166862 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fbdc32-c8c3-4fad-974a-1614dae7e534 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:37.171659 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f575e1-6d5e-4cef-ab33-062947c489ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:37.172285 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f575e1-6d5e-4cef-ab33-062947c489ee service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:37.172561 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f575e1-6d5e-4cef-ab33-062947c489ee service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:37.172826 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f575e1-6d5e-4cef-ab33-062947c489ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:37.181609 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f575e1-6d5e-4cef-ab33-062947c489ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:37.183054 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f575e1-6d5e-4cef-ab33-062947c489ee service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:37.192493 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1113/2212] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:33:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:33:37.459736 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c0d48-cec1-4fc5-a29e-07b506c0f7d2 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:37.461470 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-416c0d48-cec1-4fc5-a29e-07b506c0f7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:37.479563 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c0d48-cec1-4fc5-a29e-07b506c0f7d2 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:37.485870 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac7634b-9058-4375-b570-0b651bec4d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:37.488663 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7634b-9058-4375-b570-0b651bec4d4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:37.489022 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7634b-9058-4375-b570-0b651bec4d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:37.489375 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7634b-9058-4375-b570-0b651bec4d4a admin admin] PATH_INFO: `/v3/projects/b2b104b0f29e4a18905b57bf9276c626` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:37.490938 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac7634b-9058-4375-b570-0b651bec4d4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2b104b0f29e4a18905b57bf9276c626)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:37.492930 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac7634b-9058-4375-b570-0b651bec4d4a admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:37.540153 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-fac7634b-9058-4375-b570-0b651bec4d4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2b104b0f29e4a18905b57bf9276c626', 'request_id': 'req-fac7634b-9058-4375-b570-0b651bec4d4a'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:37.546564 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-fac7634b-9058-4375-b570-0b651bec4d4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2b104b0f29e4a18905b57bf9276c626', 'request_id': 'req-fac7634b-9058-4375-b570-0b651bec4d4a'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:37.552683 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-fac7634b-9058-4375-b570-0b651bec4d4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2b104b0f29e4a18905b57bf9276c626', 'request_id': 'req-fac7634b-9058-4375-b570-0b651bec4d4a'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:37.565853 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-fac7634b-9058-4375-b570-0b651bec4d4a admin admin] The token cache is being invalidate because project b2b104b0f29e4a18905b57bf9276c626 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:33:37.566138 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-fac7634b-9058-4375-b570-0b651bec4d4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:37.566783 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-fac7634b-9058-4375-b570-0b651bec4d4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:37.568322 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1100/2213] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:33:37 2022] DELETE /identity/v3/projects/b2b104b0f29e4a18905b57bf9276c626 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:37.572441 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f575e1-6d5e-4cef-ab33-062947c489ee service neutron] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:37.581999 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f575e1-6d5e-4cef-ab33-062947c489ee service neutron] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:37.637576 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564fcb2c-04ab-4b04-a0f2-571a21968afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:37.638325 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fcb2c-04ab-4b04-a0f2-571a21968afb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:37.638620 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fcb2c-04ab-4b04-a0f2-571a21968afb admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:37.638899 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fcb2c-04ab-4b04-a0f2-571a21968afb admin admin] PATH_INFO: `/v3/users/180827dd7db24e5da033371a0e88cfcd` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:37.640061 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564fcb2c-04ab-4b04-a0f2-571a21968afb admin admin] RBAC: Authorizing `identity:delete_user(user_id=180827dd7db24e5da033371a0e88cfcd)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:37.641972 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564fcb2c-04ab-4b04-a0f2-571a21968afb admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:37.686139 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-564fcb2c-04ab-4b04-a0f2-571a21968afb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '180827dd7db24e5da033371a0e88cfcd'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:37.692180 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-564fcb2c-04ab-4b04-a0f2-571a21968afb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '180827dd7db24e5da033371a0e88cfcd'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:37.692800 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-564fcb2c-04ab-4b04-a0f2-571a21968afb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '180827dd7db24e5da033371a0e88cfcd'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:37.704083 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-564fcb2c-04ab-4b04-a0f2-571a21968afb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '180827dd7db24e5da033371a0e88cfcd'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:37.710470 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-564fcb2c-04ab-4b04-a0f2-571a21968afb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '180827dd7db24e5da033371a0e88cfcd'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:37.717170 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1114/2214] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:33:37 2022] DELETE /identity/v3/users/180827dd7db24e5da033371a0e88cfcd => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:37.987141 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac7634b-9058-4375-b570-0b651bec4d4a admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:37.988578 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-fac7634b-9058-4375-b570-0b651bec4d4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:38.004302 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac7634b-9058-4375-b570-0b651bec4d4a admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:38.065915 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90fa88-50a8-4be3-94e2-4332e1c5d30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:38.068051 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90fa88-50a8-4be3-94e2-4332e1c5d30d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:38.068504 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90fa88-50a8-4be3-94e2-4332e1c5d30d admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:38.069052 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90fa88-50a8-4be3-94e2-4332e1c5d30d admin admin] PATH_INFO: `/v3/projects/4a068a4673604d7ba2fd876f34761510` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:38.070419 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e90fa88-50a8-4be3-94e2-4332e1c5d30d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a068a4673604d7ba2fd876f34761510)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:38.072672 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e90fa88-50a8-4be3-94e2-4332e1c5d30d admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:38.128308 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-1e90fa88-50a8-4be3-94e2-4332e1c5d30d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a068a4673604d7ba2fd876f34761510', 'request_id': 'req-1e90fa88-50a8-4be3-94e2-4332e1c5d30d'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:38.133757 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-1e90fa88-50a8-4be3-94e2-4332e1c5d30d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a068a4673604d7ba2fd876f34761510', 'request_id': 'req-1e90fa88-50a8-4be3-94e2-4332e1c5d30d'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:38.140111 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-1e90fa88-50a8-4be3-94e2-4332e1c5d30d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a068a4673604d7ba2fd876f34761510', 'request_id': 'req-1e90fa88-50a8-4be3-94e2-4332e1c5d30d'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:38.152654 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-1e90fa88-50a8-4be3-94e2-4332e1c5d30d admin admin] The token cache is being invalidate because project 4a068a4673604d7ba2fd876f34761510 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:33:38.153107 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-1e90fa88-50a8-4be3-94e2-4332e1c5d30d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:38.153694 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-1e90fa88-50a8-4be3-94e2-4332e1c5d30d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:38.155274 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1101/2215] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:33:37 2022] DELETE /identity/v3/projects/4a068a4673604d7ba2fd876f34761510 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:33:38.159394 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564fcb2c-04ab-4b04-a0f2-571a21968afb admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:38.161129 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-564fcb2c-04ab-4b04-a0f2-571a21968afb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:38.174876 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564fcb2c-04ab-4b04-a0f2-571a21968afb admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:38.228775 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca84ad-dfd7-40cc-b33f-78791917b9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:38.229628 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca84ad-dfd7-40cc-b33f-78791917b9f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:38.229907 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca84ad-dfd7-40cc-b33f-78791917b9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:38.230177 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca84ad-dfd7-40cc-b33f-78791917b9f4 admin admin] PATH_INFO: `/v3/users/dbb5c654e4694075ab25e4517ba42e0b` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:38.231951 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca84ad-dfd7-40cc-b33f-78791917b9f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbb5c654e4694075ab25e4517ba42e0b)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:38.233852 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca84ad-dfd7-40cc-b33f-78791917b9f4 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:38.279838 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-16ca84ad-dfd7-40cc-b33f-78791917b9f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbb5c654e4694075ab25e4517ba42e0b'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:38.286770 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-16ca84ad-dfd7-40cc-b33f-78791917b9f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbb5c654e4694075ab25e4517ba42e0b'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:38.287367 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-16ca84ad-dfd7-40cc-b33f-78791917b9f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbb5c654e4694075ab25e4517ba42e0b'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:38.299503 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-16ca84ad-dfd7-40cc-b33f-78791917b9f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbb5c654e4694075ab25e4517ba42e0b'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:38.305867 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-16ca84ad-dfd7-40cc-b33f-78791917b9f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbb5c654e4694075ab25e4517ba42e0b'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:38.312126 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1115/2216] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:33:38 2022] DELETE /identity/v3/users/dbb5c654e4694075ab25e4517ba42e0b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:38.575832 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90fa88-50a8-4be3-94e2-4332e1c5d30d admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:38.577555 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-1e90fa88-50a8-4be3-94e2-4332e1c5d30d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:38.600382 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90fa88-50a8-4be3-94e2-4332e1c5d30d admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:38.668949 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b91914-fc0d-440b-afe3-87fed1b974e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:38.669977 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b91914-fc0d-440b-afe3-87fed1b974e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:38.670262 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b91914-fc0d-440b-afe3-87fed1b974e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:38.670539 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b91914-fc0d-440b-afe3-87fed1b974e4 admin admin] PATH_INFO: `/v3/projects/be32f3a45daa4a088697bea8d21927cf` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:38.671769 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b91914-fc0d-440b-afe3-87fed1b974e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be32f3a45daa4a088697bea8d21927cf)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:38.673654 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b91914-fc0d-440b-afe3-87fed1b974e4 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:38.718264 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-d5b91914-fc0d-440b-afe3-87fed1b974e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be32f3a45daa4a088697bea8d21927cf', 'request_id': 'req-d5b91914-fc0d-440b-afe3-87fed1b974e4'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:38.723376 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-d5b91914-fc0d-440b-afe3-87fed1b974e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be32f3a45daa4a088697bea8d21927cf', 'request_id': 'req-d5b91914-fc0d-440b-afe3-87fed1b974e4'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:38.729178 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-d5b91914-fc0d-440b-afe3-87fed1b974e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be32f3a45daa4a088697bea8d21927cf', 'request_id': 'req-d5b91914-fc0d-440b-afe3-87fed1b974e4'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:38.740954 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-d5b91914-fc0d-440b-afe3-87fed1b974e4 admin admin] The token cache is being invalidate because project be32f3a45daa4a088697bea8d21927cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:33:38.742627 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-d5b91914-fc0d-440b-afe3-87fed1b974e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:38.742627 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-d5b91914-fc0d-440b-afe3-87fed1b974e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:38.743724 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1102/2217] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:33:38 2022] DELETE /identity/v3/projects/be32f3a45daa4a088697bea8d21927cf => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:38.750407 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d70368-9df5-4e99-af55-9188dec08873 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:38.750734 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d70368-9df5-4e99-af55-9188dec08873 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:38.751012 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d70368-9df5-4e99-af55-9188dec08873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:38.769451 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-86d70368-9df5-4e99-af55-9188dec08873 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:38.770661 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-86d70368-9df5-4e99-af55-9188dec08873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:38.826261 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1116/2218] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:33:38.834522 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95977a-3dcf-4abc-ba74-34b9ea905796 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:38.834874 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95977a-3dcf-4abc-ba74-34b9ea905796 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:38.835158 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95977a-3dcf-4abc-ba74-34b9ea905796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:38.855012 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-dd95977a-3dcf-4abc-ba74-34b9ea905796 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:38.856117 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-dd95977a-3dcf-4abc-ba74-34b9ea905796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:38.865276 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1103/2219] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:33:38.869446 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d70368-9df5-4e99-af55-9188dec08873 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:38.879828 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d70368-9df5-4e99-af55-9188dec08873 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:38.884655 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99dac3a-999c-4f99-8f61-eff0f422d8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:38.885294 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99dac3a-999c-4f99-8f61-eff0f422d8af admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:38.885569 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99dac3a-999c-4f99-8f61-eff0f422d8af admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:38.885842 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99dac3a-999c-4f99-8f61-eff0f422d8af admin admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:38.886551 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99dac3a-999c-4f99-8f61-eff0f422d8af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:33:38.886884 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99dac3a-999c-4f99-8f61-eff0f422d8af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:38.888585 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99dac3a-999c-4f99-8f61-eff0f422d8af admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:38.900845 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1117/2220] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:33:38.905310 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95977a-3dcf-4abc-ba74-34b9ea905796 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:38.914348 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95977a-3dcf-4abc-ba74-34b9ea905796 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:38.919685 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec4ff4-b481-4f43-8596-9b1843d5e960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:38.920329 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec4ff4-b481-4f43-8596-9b1843d5e960 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:38.920612 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec4ff4-b481-4f43-8596-9b1843d5e960 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:38.920891 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec4ff4-b481-4f43-8596-9b1843d5e960 admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:38.921576 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec4ff4-b481-4f43-8596-9b1843d5e960 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:38.923500 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec4ff4-b481-4f43-8596-9b1843d5e960 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:38.948318 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1104/2221] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:33:38 2022] POST /identity/v3/projects => generated 365 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:33:38.952214 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99dac3a-999c-4f99-8f61-eff0f422d8af admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:38.962496 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99dac3a-999c-4f99-8f61-eff0f422d8af admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:39.016205 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3ecd5-4c5e-409a-81a0-e458c3d8773e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:39.016786 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3ecd5-4c5e-409a-81a0-e458c3d8773e admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:39.017067 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3ecd5-4c5e-409a-81a0-e458c3d8773e admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:39.017340 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3ecd5-4c5e-409a-81a0-e458c3d8773e admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:39.018028 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3ecd5-4c5e-409a-81a0-e458c3d8773e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:39.019960 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3ecd5-4c5e-409a-81a0-e458c3d8773e admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:39.039104 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1118/2222] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:33:38 2022] POST /identity/v3/users => generated 283 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:33:39.043206 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec4ff4-b481-4f43-8596-9b1843d5e960 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:39.054068 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec4ff4-b481-4f43-8596-9b1843d5e960 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:39.058545 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98016bce-5691-44ef-902e-48620158e646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:39.059217 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98016bce-5691-44ef-902e-48620158e646 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:39.060912 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98016bce-5691-44ef-902e-48620158e646 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:39.061196 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98016bce-5691-44ef-902e-48620158e646 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:39.061905 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98016bce-5691-44ef-902e-48620158e646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:39.063504 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98016bce-5691-44ef-902e-48620158e646 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:39.073473 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1105/2223] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:33:39.077608 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3ecd5-4c5e-409a-81a0-e458c3d8773e admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:39.088010 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3ecd5-4c5e-409a-81a0-e458c3d8773e admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:39.092831 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be67b1-3d74-4acc-82a7-722a2b4c0bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:39.093478 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be67b1-3d74-4acc-82a7-722a2b4c0bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:39.093772 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be67b1-3d74-4acc-82a7-722a2b4c0bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:39.094046 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be67b1-3d74-4acc-82a7-722a2b4c0bc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:39.094827 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60be67b1-3d74-4acc-82a7-722a2b4c0bc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:39.096543 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60be67b1-3d74-4acc-82a7-722a2b4c0bc8 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:39.107377 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1119/2224] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:33:39.111222 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98016bce-5691-44ef-902e-48620158e646 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:39.121161 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98016bce-5691-44ef-902e-48620158e646 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:39.127004 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f86fa6-1070-43e6-89e8-dce44fcfefc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:39.128002 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f86fa6-1070-43e6-89e8-dce44fcfefc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:39.128347 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f86fa6-1070-43e6-89e8-dce44fcfefc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:39.128688 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f86fa6-1070-43e6-89e8-dce44fcfefc1 admin admin] PATH_INFO: `/v3/projects/2634b84c41be490a885d7e470f4c8315/users/edab800875a54d8cad44229f0d01e511/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:39.144283 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f86fa6-1070-43e6-89e8-dce44fcfefc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2634b84c41be490a885d7e470f4c8315, user_id=edab800875a54d8cad44229f0d01e511, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:39.147038 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f86fa6-1070-43e6-89e8-dce44fcfefc1 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:39.159343 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1106/2225] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:33:39 2022] PUT /identity/v3/projects/2634b84c41be490a885d7e470f4c8315/users/edab800875a54d8cad44229f0d01e511/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:39.172092 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8ae23-5596-4b12-a0fa-1f605d0c133c None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:39.172597 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8ae23-5596-4b12-a0fa-1f605d0c133c None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:39.172699 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8ae23-5596-4b12-a0fa-1f605d0c133c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:39.201123 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-3ef8ae23-5596-4b12-a0fa-1f605d0c133c None None] MFA Rules not processed for user `edab800875a54d8cad44229f0d01e511`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:39.202320 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-3ef8ae23-5596-4b12-a0fa-1f605d0c133c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:39.265999 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1120/2226] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:39 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:33:39.270561 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f86fa6-1070-43e6-89e8-dce44fcfefc1 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:39.330430 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f86fa6-1070-43e6-89e8-dce44fcfefc1 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:39.335071 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85feb0-6fa5-488c-94b8-7a429bf24a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:39.335712 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85feb0-6fa5-488c-94b8-7a429bf24a03 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:39.335992 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85feb0-6fa5-488c-94b8-7a429bf24a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:39.336514 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85feb0-6fa5-488c-94b8-7a429bf24a03 admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:39.337222 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc85feb0-6fa5-488c-94b8-7a429bf24a03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:39.339104 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc85feb0-6fa5-488c-94b8-7a429bf24a03 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:39.363572 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1107/2227] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:33:39 2022] POST /identity/v3/projects => generated 367 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:33:39.367583 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8ae23-5596-4b12-a0fa-1f605d0c133c None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:39.378938 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8ae23-5596-4b12-a0fa-1f605d0c133c None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:39.433367 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af0a19-e4a4-4391-a7f0-ab23df7be89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:39.434015 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af0a19-e4a4-4391-a7f0-ab23df7be89f admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:39.434877 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af0a19-e4a4-4391-a7f0-ab23df7be89f admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:39.435609 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af0a19-e4a4-4391-a7f0-ab23df7be89f admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:39.436287 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79af0a19-e4a4-4391-a7f0-ab23df7be89f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:39.438189 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79af0a19-e4a4-4391-a7f0-ab23df7be89f admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:39.458290 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1121/2228] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:33:39 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:33:39.462714 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85feb0-6fa5-488c-94b8-7a429bf24a03 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:39.472931 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85feb0-6fa5-488c-94b8-7a429bf24a03 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:39.477677 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99b9e8-7290-453f-8701-35fced6993fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:39.478316 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99b9e8-7290-453f-8701-35fced6993fd admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:39.478623 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99b9e8-7290-453f-8701-35fced6993fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:39.478900 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99b9e8-7290-453f-8701-35fced6993fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:39.479649 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99b9e8-7290-453f-8701-35fced6993fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:39.481237 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99b9e8-7290-453f-8701-35fced6993fd admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:39.491996 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1108/2229] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:33:39.496232 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af0a19-e4a4-4391-a7f0-ab23df7be89f admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:39.507031 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af0a19-e4a4-4391-a7f0-ab23df7be89f admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:39.514101 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77825799-ec2b-4cc7-a6c6-88a5664fbd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:39.515010 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77825799-ec2b-4cc7-a6c6-88a5664fbd85 admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:39.515302 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77825799-ec2b-4cc7-a6c6-88a5664fbd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:39.515561 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77825799-ec2b-4cc7-a6c6-88a5664fbd85 admin admin] PATH_INFO: `/v3/projects/4f98227eadc747178d77b0c7b21d9c66/users/35f50135a0f6469cbe021a3dd95b26cf/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:39.531000 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77825799-ec2b-4cc7-a6c6-88a5664fbd85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f98227eadc747178d77b0c7b21d9c66, user_id=35f50135a0f6469cbe021a3dd95b26cf, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:39.533561 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77825799-ec2b-4cc7-a6c6-88a5664fbd85 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:39.548040 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1122/2230] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:33:39 2022] PUT /identity/v3/projects/4f98227eadc747178d77b0c7b21d9c66/users/35f50135a0f6469cbe021a3dd95b26cf/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:39.551516 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99b9e8-7290-453f-8701-35fced6993fd admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:39.564786 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99b9e8-7290-453f-8701-35fced6993fd admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:39.621418 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4858b8c-2ab4-4faa-b980-e5788989a091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:39.622847 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4858b8c-2ab4-4faa-b980-e5788989a091 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:39.623212 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4858b8c-2ab4-4faa-b980-e5788989a091 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:39.623526 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4858b8c-2ab4-4faa-b980-e5788989a091 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:39.624382 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4858b8c-2ab4-4faa-b980-e5788989a091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:39.626256 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4858b8c-2ab4-4faa-b980-e5788989a091 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:39.636083 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1109/2231] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:33:39.640264 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77825799-ec2b-4cc7-a6c6-88a5664fbd85 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:39.650306 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77825799-ec2b-4cc7-a6c6-88a5664fbd85 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:39.658519 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c92ba8-59d9-4108-92f6-59486c7ad9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:39.659446 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c92ba8-59d9-4108-92f6-59486c7ad9bb admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:39.659727 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c92ba8-59d9-4108-92f6-59486c7ad9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:39.660000 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c92ba8-59d9-4108-92f6-59486c7ad9bb admin admin] PATH_INFO: `/v3/projects/4f98227eadc747178d77b0c7b21d9c66/users/35f50135a0f6469cbe021a3dd95b26cf/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:39.662003 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c92ba8-59d9-4108-92f6-59486c7ad9bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f98227eadc747178d77b0c7b21d9c66, user_id=35f50135a0f6469cbe021a3dd95b26cf, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:39.664650 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c92ba8-59d9-4108-92f6-59486c7ad9bb admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:39.678318 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1123/2232] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:33:39 2022] PUT /identity/v3/projects/4f98227eadc747178d77b0c7b21d9c66/users/35f50135a0f6469cbe021a3dd95b26cf/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:39.689296 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1bbba-7118-4350-8804-a1443805f64a None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:39.689585 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1bbba-7118-4350-8804-a1443805f64a None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:39.690307 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1bbba-7118-4350-8804-a1443805f64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:39.727181 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-a8f1bbba-7118-4350-8804-a1443805f64a None None] MFA Rules not processed for user `35f50135a0f6469cbe021a3dd95b26cf`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:39.728380 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-a8f1bbba-7118-4350-8804-a1443805f64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:39.842641 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1110/2233] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:39 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:33:39.859529 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c92ba8-59d9-4108-92f6-59486c7ad9bb admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:39.865570 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-50c92ba8-59d9-4108-92f6-59486c7ad9bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:39.955346 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c92ba8-59d9-4108-92f6-59486c7ad9bb admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:39.959873 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd4635-af3c-47db-b607-20108e3254c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:39.960527 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd4635-af3c-47db-b607-20108e3254c4 service cinder] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:39.960803 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd4635-af3c-47db-b607-20108e3254c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:39.961075 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd4635-af3c-47db-b607-20108e3254c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:39.972561 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd4635-af3c-47db-b607-20108e3254c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:39.973985 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd4635-af3c-47db-b607-20108e3254c4 service cinder] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:39.996969 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1124/2234] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:33:39 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:33:40.092253 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1bbba-7118-4350-8804-a1443805f64a None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:40.108526 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1bbba-7118-4350-8804-a1443805f64a None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:40.114251 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a4d8ae-aaf6-4284-b815-fb0d7885fff2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:40.115542 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4d8ae-aaf6-4284-b815-fb0d7885fff2 service cinder] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:40.116043 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4d8ae-aaf6-4284-b815-fb0d7885fff2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:40.116520 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4d8ae-aaf6-4284-b815-fb0d7885fff2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:40.195769 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a4d8ae-aaf6-4284-b815-fb0d7885fff2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:40.197209 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a4d8ae-aaf6-4284-b815-fb0d7885fff2 service cinder] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:40.230739 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1111/2235] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:33:40 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:33:47.964850 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd4635-af3c-47db-b607-20108e3254c4 service cinder] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:47.967550 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-21dd4635-af3c-47db-b607-20108e3254c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:48.056667 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd4635-af3c-47db-b607-20108e3254c4 service cinder] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:48.061265 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d1646-e6e0-41c1-aed3-cfad9eed7c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:48.062120 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d1646-e6e0-41c1-aed3-cfad9eed7c68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:48.062399 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d1646-e6e0-41c1-aed3-cfad9eed7c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:48.062772 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d1646-e6e0-41c1-aed3-cfad9eed7c68 admin admin] PATH_INFO: `/v3/users/b6450175fd4145cf8399ccc6b9a2cd60` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:48.063981 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d1646-e6e0-41c1-aed3-cfad9eed7c68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6450175fd4145cf8399ccc6b9a2cd60)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:48.065951 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d1646-e6e0-41c1-aed3-cfad9eed7c68 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:48.124847 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-8b0d1646-e6e0-41c1-aed3-cfad9eed7c68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6450175fd4145cf8399ccc6b9a2cd60'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:48.132279 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-8b0d1646-e6e0-41c1-aed3-cfad9eed7c68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6450175fd4145cf8399ccc6b9a2cd60'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:48.133177 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-8b0d1646-e6e0-41c1-aed3-cfad9eed7c68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6450175fd4145cf8399ccc6b9a2cd60'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:48.146795 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-8b0d1646-e6e0-41c1-aed3-cfad9eed7c68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6450175fd4145cf8399ccc6b9a2cd60'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:48.155024 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-8b0d1646-e6e0-41c1-aed3-cfad9eed7c68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6450175fd4145cf8399ccc6b9a2cd60'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:48.162404 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1125/2236] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:33:47 2022] DELETE /identity/v3/users/b6450175fd4145cf8399ccc6b9a2cd60 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:48.169679 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2bb34-3313-4f6e-ad19-0f4ba4a171d1 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:48.171236 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2bb34-3313-4f6e-ad19-0f4ba4a171d1 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:48.174097 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2bb34-3313-4f6e-ad19-0f4ba4a171d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:48.196815 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-93a2bb34-3313-4f6e-ad19-0f4ba4a171d1 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:48.198036 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-93a2bb34-3313-4f6e-ad19-0f4ba4a171d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:48.275867 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1112/2237] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:33:48.291011 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d1646-e6e0-41c1-aed3-cfad9eed7c68 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:48.293343 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-8b0d1646-e6e0-41c1-aed3-cfad9eed7c68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:48.389958 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d1646-e6e0-41c1-aed3-cfad9eed7c68 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:48.396689 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b62439-c136-4855-a7e9-eef9edc37ceb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:48.400660 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b62439-c136-4855-a7e9-eef9edc37ceb service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:48.401203 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b62439-c136-4855-a7e9-eef9edc37ceb service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:48.401556 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b62439-c136-4855-a7e9-eef9edc37ceb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:48.421174 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b62439-c136-4855-a7e9-eef9edc37ceb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:48.424278 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b62439-c136-4855-a7e9-eef9edc37ceb service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:48.441928 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1126/2238] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:33:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:33:48.851382 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2bb34-3313-4f6e-ad19-0f4ba4a171d1 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:48.852969 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-93a2bb34-3313-4f6e-ad19-0f4ba4a171d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:48.971430 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2bb34-3313-4f6e-ad19-0f4ba4a171d1 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:48.977934 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d08be-3204-4690-b371-3d26b57f73fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:48.979179 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d08be-3204-4690-b371-3d26b57f73fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:48.979675 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d08be-3204-4690-b371-3d26b57f73fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:48.980151 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d08be-3204-4690-b371-3d26b57f73fb admin admin] PATH_INFO: `/v3/projects/303eac921f124ecdadd26f8c34c50576` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:48.983005 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d08be-3204-4690-b371-3d26b57f73fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=303eac921f124ecdadd26f8c34c50576)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:48.987502 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d08be-3204-4690-b371-3d26b57f73fb admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:49.070449 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-b15d08be-3204-4690-b371-3d26b57f73fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '303eac921f124ecdadd26f8c34c50576', 'request_id': 'req-b15d08be-3204-4690-b371-3d26b57f73fb'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:49.088775 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-b15d08be-3204-4690-b371-3d26b57f73fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '303eac921f124ecdadd26f8c34c50576', 'request_id': 'req-b15d08be-3204-4690-b371-3d26b57f73fb'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:49.097423 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-b15d08be-3204-4690-b371-3d26b57f73fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '303eac921f124ecdadd26f8c34c50576', 'request_id': 'req-b15d08be-3204-4690-b371-3d26b57f73fb'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:49.114726 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-b15d08be-3204-4690-b371-3d26b57f73fb admin admin] The token cache is being invalidate because project 303eac921f124ecdadd26f8c34c50576 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:33:49.115055 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-b15d08be-3204-4690-b371-3d26b57f73fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:49.120694 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-b15d08be-3204-4690-b371-3d26b57f73fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:49.126898 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1113/2239] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:33:48 2022] DELETE /identity/v3/projects/303eac921f124ecdadd26f8c34c50576 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:49.128547 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e28a7-a59f-48cf-9574-17ed98bfdd5e None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:49.129042 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e28a7-a59f-48cf-9574-17ed98bfdd5e None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:49.129130 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e28a7-a59f-48cf-9574-17ed98bfdd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:49.188035 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-568e28a7-a59f-48cf-9574-17ed98bfdd5e None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:49.189259 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-568e28a7-a59f-48cf-9574-17ed98bfdd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:49.282896 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1127/2240] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:33:49.287181 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc1de3-2fc7-41cc-995e-b46156db2af8 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:49.287659 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc1de3-2fc7-41cc-995e-b46156db2af8 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:49.287852 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc1de3-2fc7-41cc-995e-b46156db2af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:49.307557 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-00fc1de3-2fc7-41cc-995e-b46156db2af8 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:49.308712 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-00fc1de3-2fc7-41cc-995e-b46156db2af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:49.317414 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1114/2241] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:33:49.322415 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e28a7-a59f-48cf-9574-17ed98bfdd5e None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:49.332700 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e28a7-a59f-48cf-9574-17ed98bfdd5e None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:49.337522 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a2459b-bc2b-4d96-849e-d0e850ff9a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:49.338319 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2459b-bc2b-4d96-849e-d0e850ff9a8a admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:49.338750 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2459b-bc2b-4d96-849e-d0e850ff9a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:49.339757 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2459b-bc2b-4d96-849e-d0e850ff9a8a admin admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:49.340523 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a2459b-bc2b-4d96-849e-d0e850ff9a8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:33:49.340899 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a2459b-bc2b-4d96-849e-d0e850ff9a8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:49.342499 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a2459b-bc2b-4d96-849e-d0e850ff9a8a admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:49.354731 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1128/2242] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:33:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:33:49.359738 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc1de3-2fc7-41cc-995e-b46156db2af8 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:49.370623 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc1de3-2fc7-41cc-995e-b46156db2af8 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:49.376640 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae46a8d-bbe3-4249-9e4f-9d8b77dd0e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:49.377277 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae46a8d-bbe3-4249-9e4f-9d8b77dd0e8f admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:49.377553 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae46a8d-bbe3-4249-9e4f-9d8b77dd0e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:49.377822 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae46a8d-bbe3-4249-9e4f-9d8b77dd0e8f admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:49.378506 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae46a8d-bbe3-4249-9e4f-9d8b77dd0e8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:49.380414 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae46a8d-bbe3-4249-9e4f-9d8b77dd0e8f admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:49.408187 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1115/2243] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:33:49 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:33:49.411861 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a2459b-bc2b-4d96-849e-d0e850ff9a8a admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:49.425117 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a2459b-bc2b-4d96-849e-d0e850ff9a8a admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:49.501931 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07278316-142d-4a8e-a81d-363cdc20c2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:49.502662 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07278316-142d-4a8e-a81d-363cdc20c2ed admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:49.502946 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07278316-142d-4a8e-a81d-363cdc20c2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:49.503293 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07278316-142d-4a8e-a81d-363cdc20c2ed admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:49.503909 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07278316-142d-4a8e-a81d-363cdc20c2ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:49.505933 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07278316-142d-4a8e-a81d-363cdc20c2ed admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:49.530838 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1129/2244] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:33:49 2022] POST /identity/v3/users => generated 287 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:33:49.533816 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae46a8d-bbe3-4249-9e4f-9d8b77dd0e8f admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:49.545157 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae46a8d-bbe3-4249-9e4f-9d8b77dd0e8f admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:49.550207 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7cb13b-4aa5-47e6-b769-52ee444e702b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:49.550892 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7cb13b-4aa5-47e6-b769-52ee444e702b admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:49.551169 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7cb13b-4aa5-47e6-b769-52ee444e702b admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:49.551440 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7cb13b-4aa5-47e6-b769-52ee444e702b admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:49.552311 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7cb13b-4aa5-47e6-b769-52ee444e702b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:49.553886 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7cb13b-4aa5-47e6-b769-52ee444e702b admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:49.565886 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1116/2245] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:33:49.571961 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07278316-142d-4a8e-a81d-363cdc20c2ed admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:49.593860 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07278316-142d-4a8e-a81d-363cdc20c2ed admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:49.603755 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a6e941-bb05-4af8-94ad-32aa8ac0dc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:49.605207 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6e941-bb05-4af8-94ad-32aa8ac0dc76 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:49.605550 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6e941-bb05-4af8-94ad-32aa8ac0dc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:49.605892 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6e941-bb05-4af8-94ad-32aa8ac0dc76 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:49.608475 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a6e941-bb05-4af8-94ad-32aa8ac0dc76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:49.610340 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a6e941-bb05-4af8-94ad-32aa8ac0dc76 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:49.638639 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1130/2246] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:33:49.642575 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7cb13b-4aa5-47e6-b769-52ee444e702b admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:49.654170 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7cb13b-4aa5-47e6-b769-52ee444e702b admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:49.661157 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0295a71-7879-4084-91da-12b36a722887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:49.662104 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0295a71-7879-4084-91da-12b36a722887 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:49.662380 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0295a71-7879-4084-91da-12b36a722887 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:49.662690 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0295a71-7879-4084-91da-12b36a722887 admin admin] PATH_INFO: `/v3/projects/b55c46d5c05b41adb823461813ee1e5b/users/5b21c9002601480eaabdbcb74d337f2a/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:49.681972 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0295a71-7879-4084-91da-12b36a722887 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b55c46d5c05b41adb823461813ee1e5b, user_id=5b21c9002601480eaabdbcb74d337f2a, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:49.686288 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0295a71-7879-4084-91da-12b36a722887 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:49.721498 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1117/2247] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:33:49 2022] PUT /identity/v3/projects/b55c46d5c05b41adb823461813ee1e5b/users/5b21c9002601480eaabdbcb74d337f2a/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:49.728335 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c9833-01d8-4bdc-8452-2eeddb21937c None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:49.728653 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c9833-01d8-4bdc-8452-2eeddb21937c None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:49.729080 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c9833-01d8-4bdc-8452-2eeddb21937c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:49.774237 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-a50c9833-01d8-4bdc-8452-2eeddb21937c None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:49.776505 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-a50c9833-01d8-4bdc-8452-2eeddb21937c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:49.895040 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0295a71-7879-4084-91da-12b36a722887 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:49.899139 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1131/2248] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:33:49.899271 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-e0295a71-7879-4084-91da-12b36a722887 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:49.907453 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c9833-01d8-4bdc-8452-2eeddb21937c None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:49.911395 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-a50c9833-01d8-4bdc-8452-2eeddb21937c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:49.916869 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0295a71-7879-4084-91da-12b36a722887 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:49.929500 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87628c94-74c1-40d8-b426-8128c62f25cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:49.930615 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87628c94-74c1-40d8-b426-8128c62f25cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:49.931193 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87628c94-74c1-40d8-b426-8128c62f25cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:49.931314 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87628c94-74c1-40d8-b426-8128c62f25cf admin admin] PATH_INFO: `/v3/users/edab800875a54d8cad44229f0d01e511` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:49.933043 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87628c94-74c1-40d8-b426-8128c62f25cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=edab800875a54d8cad44229f0d01e511)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:49.936692 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87628c94-74c1-40d8-b426-8128c62f25cf admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:50.028157 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-87628c94-74c1-40d8-b426-8128c62f25cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edab800875a54d8cad44229f0d01e511'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:50.029221 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-87628c94-74c1-40d8-b426-8128c62f25cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edab800875a54d8cad44229f0d01e511'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:50.043516 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-87628c94-74c1-40d8-b426-8128c62f25cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edab800875a54d8cad44229f0d01e511'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:50.052656 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-87628c94-74c1-40d8-b426-8128c62f25cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edab800875a54d8cad44229f0d01e511'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:50.062121 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c9833-01d8-4bdc-8452-2eeddb21937c None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:50.062425 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-87628c94-74c1-40d8-b426-8128c62f25cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edab800875a54d8cad44229f0d01e511'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:50.066628 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d10ddf-d435-4868-9c38-ddd4904eb130 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:50.067366 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d10ddf-d435-4868-9c38-ddd4904eb130 service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:50.067655 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d10ddf-d435-4868-9c38-ddd4904eb130 service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:50.068125 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d10ddf-d435-4868-9c38-ddd4904eb130 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:50.073183 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-32d10ddf-d435-4868-9c38-ddd4904eb130 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:50.074679 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1118/2249] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:33:49 2022] DELETE /identity/v3/users/edab800875a54d8cad44229f0d01e511 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:33:50.080091 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554fa84-645b-477c-878b-665e665fb27d None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:50.080553 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554fa84-645b-477c-878b-665e665fb27d None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:50.082064 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554fa84-645b-477c-878b-665e665fb27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:50.099750 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d10ddf-d435-4868-9c38-ddd4904eb130 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:50.102034 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d10ddf-d435-4868-9c38-ddd4904eb130 service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:50.107230 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-8554fa84-645b-477c-878b-665e665fb27d None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:50.109270 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-8554fa84-645b-477c-878b-665e665fb27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:50.117643 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1132/2250] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:33:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:33:50.200961 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1119/2251] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:33:50.221374 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d10ddf-d435-4868-9c38-ddd4904eb130 service neutron] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:50.223400 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-32d10ddf-d435-4868-9c38-ddd4904eb130 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:50.240611 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d10ddf-d435-4868-9c38-ddd4904eb130 service neutron] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:50.319553 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec49020a-d618-408e-a048-8f7ff254f048 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:50.321121 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49020a-d618-408e-a048-8f7ff254f048 service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:50.322490 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49020a-d618-408e-a048-8f7ff254f048 service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:50.322985 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49020a-d618-408e-a048-8f7ff254f048 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:50.339024 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec49020a-d618-408e-a048-8f7ff254f048 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:50.340576 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec49020a-d618-408e-a048-8f7ff254f048 service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:50.360667 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1133/2252] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:33:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:33:50.968049 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554fa84-645b-477c-878b-665e665fb27d None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:50.970115 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-8554fa84-645b-477c-878b-665e665fb27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:50.999813 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554fa84-645b-477c-878b-665e665fb27d None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:51.019109 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78314878-1a45-4395-9d74-3a0357dde163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:51.020905 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78314878-1a45-4395-9d74-3a0357dde163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:51.021522 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78314878-1a45-4395-9d74-3a0357dde163 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:51.021956 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78314878-1a45-4395-9d74-3a0357dde163 admin admin] PATH_INFO: `/v3/projects/2634b84c41be490a885d7e470f4c8315` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:51.024905 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78314878-1a45-4395-9d74-3a0357dde163 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2634b84c41be490a885d7e470f4c8315)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:51.027334 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78314878-1a45-4395-9d74-3a0357dde163 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:51.112990 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-78314878-1a45-4395-9d74-3a0357dde163 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2634b84c41be490a885d7e470f4c8315', 'request_id': 'req-78314878-1a45-4395-9d74-3a0357dde163'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:51.126047 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-78314878-1a45-4395-9d74-3a0357dde163 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2634b84c41be490a885d7e470f4c8315', 'request_id': 'req-78314878-1a45-4395-9d74-3a0357dde163'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:51.134401 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-78314878-1a45-4395-9d74-3a0357dde163 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2634b84c41be490a885d7e470f4c8315', 'request_id': 'req-78314878-1a45-4395-9d74-3a0357dde163'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:51.158072 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-78314878-1a45-4395-9d74-3a0357dde163 admin admin] The token cache is being invalidate because project 2634b84c41be490a885d7e470f4c8315 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:33:51.159366 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-78314878-1a45-4395-9d74-3a0357dde163 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:51.160263 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-78314878-1a45-4395-9d74-3a0357dde163 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:51.162918 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1120/2253] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:33:50 2022] DELETE /identity/v3/projects/2634b84c41be490a885d7e470f4c8315 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:51.167199 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec49020a-d618-408e-a048-8f7ff254f048 service neutron] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:51.180954 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec49020a-d618-408e-a048-8f7ff254f048 service neutron] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:51.287547 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d2330-3155-4af8-bb77-cf7034ec89bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:51.288569 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d2330-3155-4af8-bb77-cf7034ec89bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:51.289058 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d2330-3155-4af8-bb77-cf7034ec89bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:51.289440 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d2330-3155-4af8-bb77-cf7034ec89bc admin admin] PATH_INFO: `/v3/users/35f50135a0f6469cbe021a3dd95b26cf` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:51.290799 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d2330-3155-4af8-bb77-cf7034ec89bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=35f50135a0f6469cbe021a3dd95b26cf)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:51.292786 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d2330-3155-4af8-bb77-cf7034ec89bc admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:51.380213 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-d11d2330-3155-4af8-bb77-cf7034ec89bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35f50135a0f6469cbe021a3dd95b26cf'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:51.392137 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-d11d2330-3155-4af8-bb77-cf7034ec89bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35f50135a0f6469cbe021a3dd95b26cf'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:51.396156 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-d11d2330-3155-4af8-bb77-cf7034ec89bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35f50135a0f6469cbe021a3dd95b26cf'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:51.415101 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-d11d2330-3155-4af8-bb77-cf7034ec89bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35f50135a0f6469cbe021a3dd95b26cf'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:51.423478 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-d11d2330-3155-4af8-bb77-cf7034ec89bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35f50135a0f6469cbe021a3dd95b26cf'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:51.432541 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1134/2254] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:33:51 2022] DELETE /identity/v3/users/35f50135a0f6469cbe021a3dd95b26cf => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:51.973314 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78314878-1a45-4395-9d74-3a0357dde163 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:51.975450 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-78314878-1a45-4395-9d74-3a0357dde163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:52.011190 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78314878-1a45-4395-9d74-3a0357dde163 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:52.122780 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce0f03-8c03-4a77-b194-cb16c693f365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:52.123701 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce0f03-8c03-4a77-b194-cb16c693f365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:52.124065 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce0f03-8c03-4a77-b194-cb16c693f365 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:52.124556 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce0f03-8c03-4a77-b194-cb16c693f365 admin admin] PATH_INFO: `/v3/projects/4f98227eadc747178d77b0c7b21d9c66` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:52.130025 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cce0f03-8c03-4a77-b194-cb16c693f365 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f98227eadc747178d77b0c7b21d9c66)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:52.134328 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cce0f03-8c03-4a77-b194-cb16c693f365 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:52.220592 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-3cce0f03-8c03-4a77-b194-cb16c693f365 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f98227eadc747178d77b0c7b21d9c66', 'request_id': 'req-3cce0f03-8c03-4a77-b194-cb16c693f365'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:52.227903 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-3cce0f03-8c03-4a77-b194-cb16c693f365 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f98227eadc747178d77b0c7b21d9c66', 'request_id': 'req-3cce0f03-8c03-4a77-b194-cb16c693f365'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:52.235804 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-3cce0f03-8c03-4a77-b194-cb16c693f365 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f98227eadc747178d77b0c7b21d9c66', 'request_id': 'req-3cce0f03-8c03-4a77-b194-cb16c693f365'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:52.264546 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-3cce0f03-8c03-4a77-b194-cb16c693f365 admin admin] The token cache is being invalidate because project 4f98227eadc747178d77b0c7b21d9c66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:33:52.265270 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-3cce0f03-8c03-4a77-b194-cb16c693f365 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:52.266229 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-3cce0f03-8c03-4a77-b194-cb16c693f365 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:52.268755 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1121/2255] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:33:51 2022] DELETE /identity/v3/projects/4f98227eadc747178d77b0c7b21d9c66 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:52.273511 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facce18b-39dd-4b2f-b669-6d272dd5943d None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:52.273818 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facce18b-39dd-4b2f-b669-6d272dd5943d None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:52.274085 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facce18b-39dd-4b2f-b669-6d272dd5943d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:52.300793 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-facce18b-39dd-4b2f-b669-6d272dd5943d None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:52.302950 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-facce18b-39dd-4b2f-b669-6d272dd5943d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:52.408596 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1135/2256] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:33:52.417795 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1c89c-6c69-448b-bf1a-5d67064b094e None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:52.418441 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1c89c-6c69-448b-bf1a-5d67064b094e None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:52.419664 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1c89c-6c69-448b-bf1a-5d67064b094e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:52.470951 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-04c1c89c-6c69-448b-bf1a-5d67064b094e None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:52.472732 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-04c1c89c-6c69-448b-bf1a-5d67064b094e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:52.490433 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1122/2257] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:33:52.494508 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facce18b-39dd-4b2f-b669-6d272dd5943d None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:52.511665 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facce18b-39dd-4b2f-b669-6d272dd5943d None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:52.517461 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c19a3a-dbc2-46e5-89a4-ba125147814c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:52.518857 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c19a3a-dbc2-46e5-89a4-ba125147814c admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:52.519148 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c19a3a-dbc2-46e5-89a4-ba125147814c admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:52.519428 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c19a3a-dbc2-46e5-89a4-ba125147814c admin admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:52.520172 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c19a3a-dbc2-46e5-89a4-ba125147814c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:33:52.520479 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c19a3a-dbc2-46e5-89a4-ba125147814c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:52.524699 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c19a3a-dbc2-46e5-89a4-ba125147814c admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:52.541480 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1136/2258] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:33:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:33:52.541985 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c1c89c-6c69-448b-bf1a-5d67064b094e None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:52.559880 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c1c89c-6c69-448b-bf1a-5d67064b094e None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:52.569544 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916beb3-4efe-4880-bfe0-7bb4799046f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:52.570221 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916beb3-4efe-4880-bfe0-7bb4799046f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:52.570520 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916beb3-4efe-4880-bfe0-7bb4799046f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:52.570831 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916beb3-4efe-4880-bfe0-7bb4799046f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:52.571532 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8916beb3-4efe-4880-bfe0-7bb4799046f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:52.574737 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8916beb3-4efe-4880-bfe0-7bb4799046f1 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:52.627527 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1123/2259] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:33:52 2022] POST /identity/v3/projects => generated 383 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:33:52.632065 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c19a3a-dbc2-46e5-89a4-ba125147814c admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:52.645248 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c19a3a-dbc2-46e5-89a4-ba125147814c admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:52.715825 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb7526d-70ef-4947-af43-52b4274ad208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:52.716936 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7526d-70ef-4947-af43-52b4274ad208 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:52.717417 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7526d-70ef-4947-af43-52b4274ad208 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:52.718430 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7526d-70ef-4947-af43-52b4274ad208 admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:52.719510 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb7526d-70ef-4947-af43-52b4274ad208 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:52.721974 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb7526d-70ef-4947-af43-52b4274ad208 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:52.759752 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1137/2260] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:33:52 2022] POST /identity/v3/users => generated 292 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:33:52.763899 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916beb3-4efe-4880-bfe0-7bb4799046f1 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:52.774732 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916beb3-4efe-4880-bfe0-7bb4799046f1 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:52.783474 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959110c-027a-4796-bd27-a45219ec9b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:52.784053 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959110c-027a-4796-bd27-a45219ec9b64 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:52.784432 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959110c-027a-4796-bd27-a45219ec9b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:52.784803 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959110c-027a-4796-bd27-a45219ec9b64 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:52.785633 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0959110c-027a-4796-bd27-a45219ec9b64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:52.787514 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0959110c-027a-4796-bd27-a45219ec9b64 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:52.799704 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1124/2261] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:33:52.803513 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb7526d-70ef-4947-af43-52b4274ad208 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:52.816067 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb7526d-70ef-4947-af43-52b4274ad208 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:52.831897 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d76a1-f7b3-4702-aa67-31f6580ed45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:52.832710 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d76a1-f7b3-4702-aa67-31f6580ed45f admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:52.833123 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d76a1-f7b3-4702-aa67-31f6580ed45f admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:52.833499 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d76a1-f7b3-4702-aa67-31f6580ed45f admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:52.834442 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d76a1-f7b3-4702-aa67-31f6580ed45f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:52.838513 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d76a1-f7b3-4702-aa67-31f6580ed45f admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:52.856301 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1138/2262] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:33:52.860520 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959110c-027a-4796-bd27-a45219ec9b64 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:52.875566 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959110c-027a-4796-bd27-a45219ec9b64 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:52.883730 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0587e7c-3563-4f94-826b-b1b338bab14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:52.885571 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0587e7c-3563-4f94-826b-b1b338bab14a admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:52.886477 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0587e7c-3563-4f94-826b-b1b338bab14a admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:52.886881 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0587e7c-3563-4f94-826b-b1b338bab14a admin admin] PATH_INFO: `/v3/projects/ffabba40ee0f441b9968a86eca9ec6d3/users/6a0d5502615f450988cba59e35a65a6a/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:52.910572 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0587e7c-3563-4f94-826b-b1b338bab14a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffabba40ee0f441b9968a86eca9ec6d3, user_id=6a0d5502615f450988cba59e35a65a6a, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:52.913400 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0587e7c-3563-4f94-826b-b1b338bab14a admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:52.959371 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1125/2263] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:33:52 2022] PUT /identity/v3/projects/ffabba40ee0f441b9968a86eca9ec6d3/users/6a0d5502615f450988cba59e35a65a6a/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:52.960675 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c132d4-5fc9-4890-a81e-28e3bcc0c5eb None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:52.961270 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c132d4-5fc9-4890-a81e-28e3bcc0c5eb None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:52.961270 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c132d4-5fc9-4890-a81e-28e3bcc0c5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:52.999842 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-a0c132d4-5fc9-4890-a81e-28e3bcc0c5eb None None] MFA Rules not processed for user `6a0d5502615f450988cba59e35a65a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:53.002040 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-a0c132d4-5fc9-4890-a81e-28e3bcc0c5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:53.105647 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1139/2264] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:33:53.111780 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0587e7c-3563-4f94-826b-b1b338bab14a admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:53.297238 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0587e7c-3563-4f94-826b-b1b338bab14a admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:53.307498 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbbc92-8b21-4f80-b50e-f53f05255214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:53.312269 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbbc92-8b21-4f80-b50e-f53f05255214 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:53.312673 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbbc92-8b21-4f80-b50e-f53f05255214 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:53.312946 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbbc92-8b21-4f80-b50e-f53f05255214 admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:53.313764 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fbbc92-8b21-4f80-b50e-f53f05255214 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:53.315806 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fbbc92-8b21-4f80-b50e-f53f05255214 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:53.380282 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1126/2265] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:33:53 2022] POST /identity/v3/projects => generated 383 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:33:53.381614 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c132d4-5fc9-4890-a81e-28e3bcc0c5eb None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:53.396114 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c132d4-5fc9-4890-a81e-28e3bcc0c5eb None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:53.567278 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f16a0d-bfdd-46e4-8bde-df6b98a8752a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:53.568792 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f16a0d-bfdd-46e4-8bde-df6b98a8752a admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:53.570734 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f16a0d-bfdd-46e4-8bde-df6b98a8752a admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:53.571236 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f16a0d-bfdd-46e4-8bde-df6b98a8752a admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:53.574697 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f16a0d-bfdd-46e4-8bde-df6b98a8752a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:53.577616 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f16a0d-bfdd-46e4-8bde-df6b98a8752a admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:53.635088 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1140/2266] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:33:53 2022] POST /identity/v3/users => generated 298 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:33:53.639959 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbbc92-8b21-4f80-b50e-f53f05255214 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:53.668577 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbbc92-8b21-4f80-b50e-f53f05255214 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:53.678263 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4588f0-cb13-4c7e-a52c-a314813b5c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:53.679568 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4588f0-cb13-4c7e-a52c-a314813b5c57 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:53.680431 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4588f0-cb13-4c7e-a52c-a314813b5c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:53.680941 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4588f0-cb13-4c7e-a52c-a314813b5c57 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:53.682444 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4588f0-cb13-4c7e-a52c-a314813b5c57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:53.685813 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4588f0-cb13-4c7e-a52c-a314813b5c57 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:53.701036 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1127/2267] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:33:53.705726 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f16a0d-bfdd-46e4-8bde-df6b98a8752a admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:53.724123 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f16a0d-bfdd-46e4-8bde-df6b98a8752a admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:53.742809 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902618d-9bc8-4342-9633-6e1b714de835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:53.744085 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902618d-9bc8-4342-9633-6e1b714de835 admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:53.744593 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902618d-9bc8-4342-9633-6e1b714de835 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:53.745086 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902618d-9bc8-4342-9633-6e1b714de835 admin admin] PATH_INFO: `/v3/projects/7fd3c18f56294a6c80e47d5343ebcf26/users/540a93e0374549e48f6b1f51cfbdc7f0/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:53.767754 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e902618d-9bc8-4342-9633-6e1b714de835 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fd3c18f56294a6c80e47d5343ebcf26, user_id=540a93e0374549e48f6b1f51cfbdc7f0, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:53.771204 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e902618d-9bc8-4342-9633-6e1b714de835 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:53.817277 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1141/2268] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:33:53 2022] PUT /identity/v3/projects/7fd3c18f56294a6c80e47d5343ebcf26/users/540a93e0374549e48f6b1f51cfbdc7f0/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:53.818914 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4588f0-cb13-4c7e-a52c-a314813b5c57 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:53.836340 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4588f0-cb13-4c7e-a52c-a314813b5c57 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:54.130546 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e7887-521f-45c9-ad83-835f1e51560e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:54.138011 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e7887-521f-45c9-ad83-835f1e51560e admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:54.138326 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e7887-521f-45c9-ad83-835f1e51560e admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:54.138688 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e7887-521f-45c9-ad83-835f1e51560e admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:54.147500 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e7887-521f-45c9-ad83-835f1e51560e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:54.149428 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e7887-521f-45c9-ad83-835f1e51560e admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:54.189050 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1128/2269] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:33:54.194782 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902618d-9bc8-4342-9633-6e1b714de835 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:54.206379 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902618d-9bc8-4342-9633-6e1b714de835 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:54.228766 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd91cf65-3194-41a2-bf4f-54e47d460326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:54.229959 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91cf65-3194-41a2-bf4f-54e47d460326 admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:54.230335 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91cf65-3194-41a2-bf4f-54e47d460326 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:54.230736 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91cf65-3194-41a2-bf4f-54e47d460326 admin admin] PATH_INFO: `/v3/projects/7fd3c18f56294a6c80e47d5343ebcf26/users/540a93e0374549e48f6b1f51cfbdc7f0/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:54.241433 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd91cf65-3194-41a2-bf4f-54e47d460326 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fd3c18f56294a6c80e47d5343ebcf26, user_id=540a93e0374549e48f6b1f51cfbdc7f0, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:54.244292 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd91cf65-3194-41a2-bf4f-54e47d460326 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:54.283678 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1142/2270] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:33:54 2022] PUT /identity/v3/projects/7fd3c18f56294a6c80e47d5343ebcf26/users/540a93e0374549e48f6b1f51cfbdc7f0/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:54.294008 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca62aed-112c-48a1-ba53-dc8c502fc5fe None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:54.294296 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca62aed-112c-48a1-ba53-dc8c502fc5fe None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:54.294578 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca62aed-112c-48a1-ba53-dc8c502fc5fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:54.371860 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-2ca62aed-112c-48a1-ba53-dc8c502fc5fe None None] MFA Rules not processed for user `540a93e0374549e48f6b1f51cfbdc7f0`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:54.373130 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-2ca62aed-112c-48a1-ba53-dc8c502fc5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:54.609484 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1129/2271] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:54 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:33:54.692934 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd91cf65-3194-41a2-bf4f-54e47d460326 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:54.695419 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-dd91cf65-3194-41a2-bf4f-54e47d460326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:54.796246 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd91cf65-3194-41a2-bf4f-54e47d460326 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:54.801339 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf57372f-2687-49b5-8db2-3bd0ef583230 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:54.802216 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57372f-2687-49b5-8db2-3bd0ef583230 service cinder] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:54.802780 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57372f-2687-49b5-8db2-3bd0ef583230 service cinder] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:54.803228 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57372f-2687-49b5-8db2-3bd0ef583230 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:54.838867 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf57372f-2687-49b5-8db2-3bd0ef583230 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:54.840635 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf57372f-2687-49b5-8db2-3bd0ef583230 service cinder] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:54.865963 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1143/2272] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:33:54 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:33:55.002467 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca62aed-112c-48a1-ba53-dc8c502fc5fe None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:55.019933 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca62aed-112c-48a1-ba53-dc8c502fc5fe None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:55.037967 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82938de4-a208-4882-99d3-2b527f5321b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:55.038813 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82938de4-a208-4882-99d3-2b527f5321b6 service cinder] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:55.039196 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82938de4-a208-4882-99d3-2b527f5321b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:55.039570 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82938de4-a208-4882-99d3-2b527f5321b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:55.193949 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82938de4-a208-4882-99d3-2b527f5321b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:55.196547 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82938de4-a208-4882-99d3-2b527f5321b6 service cinder] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:55.232630 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1130/2273] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:33:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:33:55.782041 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf57372f-2687-49b5-8db2-3bd0ef583230 service cinder] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:55.923548 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf57372f-2687-49b5-8db2-3bd0ef583230 service cinder] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:55.935793 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d736033-592e-4ba6-b44f-4c0ca5e9949d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:55.937035 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d736033-592e-4ba6-b44f-4c0ca5e9949d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:55.937478 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d736033-592e-4ba6-b44f-4c0ca5e9949d admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:55.937935 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d736033-592e-4ba6-b44f-4c0ca5e9949d admin admin] PATH_INFO: `/v3/users/6a0d5502615f450988cba59e35a65a6a` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:55.944179 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d736033-592e-4ba6-b44f-4c0ca5e9949d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a0d5502615f450988cba59e35a65a6a)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:55.946159 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d736033-592e-4ba6-b44f-4c0ca5e9949d admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:56.146162 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-8d736033-592e-4ba6-b44f-4c0ca5e9949d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a0d5502615f450988cba59e35a65a6a'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:56.158775 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-8d736033-592e-4ba6-b44f-4c0ca5e9949d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a0d5502615f450988cba59e35a65a6a'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:56.160057 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-8d736033-592e-4ba6-b44f-4c0ca5e9949d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a0d5502615f450988cba59e35a65a6a'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:56.194150 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-8d736033-592e-4ba6-b44f-4c0ca5e9949d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a0d5502615f450988cba59e35a65a6a'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:56.313845 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-8d736033-592e-4ba6-b44f-4c0ca5e9949d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a0d5502615f450988cba59e35a65a6a'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:56.328183 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1144/2274] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:33:55 2022] DELETE /identity/v3/users/6a0d5502615f450988cba59e35a65a6a => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:56.335735 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccf9f0-d1ff-44a6-a105-cf1e1b127233 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:56.337076 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccf9f0-d1ff-44a6-a105-cf1e1b127233 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:56.337578 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccf9f0-d1ff-44a6-a105-cf1e1b127233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:56.375405 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-a4ccf9f0-d1ff-44a6-a105-cf1e1b127233 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:56.379840 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-a4ccf9f0-d1ff-44a6-a105-cf1e1b127233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:56.502486 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1131/2275] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:33:56.553358 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d736033-592e-4ba6-b44f-4c0ca5e9949d admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:56.556155 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-8d736033-592e-4ba6-b44f-4c0ca5e9949d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:56.725506 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d736033-592e-4ba6-b44f-4c0ca5e9949d admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:56.733755 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e51219-6d59-4b05-bac9-18a6ccf81887 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:56.734445 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e51219-6d59-4b05-bac9-18a6ccf81887 service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:56.734869 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e51219-6d59-4b05-bac9-18a6ccf81887 service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:56.735152 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e51219-6d59-4b05-bac9-18a6ccf81887 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:56.758959 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e51219-6d59-4b05-bac9-18a6ccf81887 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:56.760544 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e51219-6d59-4b05-bac9-18a6ccf81887 service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:56.775041 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1145/2276] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:33:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:33:57.059011 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb21615-9031-49b0-aab2-2ef2a1f0bfb2 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:57.059944 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb21615-9031-49b0-aab2-2ef2a1f0bfb2 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:57.060709 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb21615-9031-49b0-aab2-2ef2a1f0bfb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:57.093443 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-3fb21615-9031-49b0-aab2-2ef2a1f0bfb2 None None] MFA Rules not processed for user `1c1284bfe6cc43848731ed2b3d9e914b`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:57.097068 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-3fb21615-9031-49b0-aab2-2ef2a1f0bfb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:57.186307 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1132/2277] 10.222.0.21 () {58 vars in 1009 bytes} [Mon Feb 28 10:33:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:33:57.205739 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e51219-6d59-4b05-bac9-18a6ccf81887 service neutron] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:57.207227 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-e0e51219-6d59-4b05-bac9-18a6ccf81887 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:57.322503 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e51219-6d59-4b05-bac9-18a6ccf81887 service neutron] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:57.334968 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b1dbe9-6778-45c3-a2e8-c67de0db3e33 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8696fe8a37aa4d73a62bdc2efd35a23d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:57.335636 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1dbe9-6778-45c3-a2e8-c67de0db3e33 service swift] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:57.335922 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1dbe9-6778-45c3-a2e8-c67de0db3e33 service swift] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:57.336199 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1dbe9-6778-45c3-a2e8-c67de0db3e33 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:57.359238 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b1dbe9-6778-45c3-a2e8-c67de0db3e33 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:57.361436 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b1dbe9-6778-45c3-a2e8-c67de0db3e33 service swift] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:57.378223 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1146/2278] 10.222.0.21 () {60 vars in 1384 bytes} [Mon Feb 28 10:33:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 10:33:57.615510 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb21615-9031-49b0-aab2-2ef2a1f0bfb2 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:57.617157 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-3fb21615-9031-49b0-aab2-2ef2a1f0bfb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:57.650651 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb21615-9031-49b0-aab2-2ef2a1f0bfb2 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:57.667406 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b39d75-0abd-4bba-a6ae-02eddf0c7c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:57.669237 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b39d75-0abd-4bba-a6ae-02eddf0c7c64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:57.669746 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b39d75-0abd-4bba-a6ae-02eddf0c7c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:57.670384 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b39d75-0abd-4bba-a6ae-02eddf0c7c64 admin admin] PATH_INFO: `/v3/projects/ffabba40ee0f441b9968a86eca9ec6d3` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:57.672681 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b39d75-0abd-4bba-a6ae-02eddf0c7c64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffabba40ee0f441b9968a86eca9ec6d3)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:57.715218 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b39d75-0abd-4bba-a6ae-02eddf0c7c64 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:57.946744 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-85b39d75-0abd-4bba-a6ae-02eddf0c7c64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffabba40ee0f441b9968a86eca9ec6d3', 'request_id': 'req-85b39d75-0abd-4bba-a6ae-02eddf0c7c64'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:57.963916 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-85b39d75-0abd-4bba-a6ae-02eddf0c7c64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffabba40ee0f441b9968a86eca9ec6d3', 'request_id': 'req-85b39d75-0abd-4bba-a6ae-02eddf0c7c64'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:57.975008 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-85b39d75-0abd-4bba-a6ae-02eddf0c7c64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffabba40ee0f441b9968a86eca9ec6d3', 'request_id': 'req-85b39d75-0abd-4bba-a6ae-02eddf0c7c64'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:58.034285 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-85b39d75-0abd-4bba-a6ae-02eddf0c7c64 admin admin] The token cache is being invalidate because project ffabba40ee0f441b9968a86eca9ec6d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:33:58.034754 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-85b39d75-0abd-4bba-a6ae-02eddf0c7c64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:58.036757 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-85b39d75-0abd-4bba-a6ae-02eddf0c7c64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:58.044587 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1133/2279] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:33:57 2022] DELETE /identity/v3/projects/ffabba40ee0f441b9968a86eca9ec6d3 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:58.046103 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b1dbe9-6778-45c3-a2e8-c67de0db3e33 service swift] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:58.058717 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b1dbe9-6778-45c3-a2e8-c67de0db3e33 service swift] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:58.198440 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8bb049-b96b-4701-8cfd-899ffb152202 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:58.199451 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8bb049-b96b-4701-8cfd-899ffb152202 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:58.199767 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8bb049-b96b-4701-8cfd-899ffb152202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:58.239263 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690184e7-95f9-4b62-b1ea-3643985b0d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:58.240860 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690184e7-95f9-4b62-b1ea-3643985b0d34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:58.241337 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690184e7-95f9-4b62-b1ea-3643985b0d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:58.241802 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690184e7-95f9-4b62-b1ea-3643985b0d34 admin admin] PATH_INFO: `/v3/users/540a93e0374549e48f6b1f51cfbdc7f0` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:58.251552 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690184e7-95f9-4b62-b1ea-3643985b0d34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=540a93e0374549e48f6b1f51cfbdc7f0)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:58.253842 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690184e7-95f9-4b62-b1ea-3643985b0d34 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:58.338541 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-6d8bb049-b96b-4701-8cfd-899ffb152202 None None] MFA Rules not processed for user `5b21c9002601480eaabdbcb74d337f2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:58.343858 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-6d8bb049-b96b-4701-8cfd-899ffb152202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:58.387817 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-690184e7-95f9-4b62-b1ea-3643985b0d34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '540a93e0374549e48f6b1f51cfbdc7f0'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:58.404302 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-690184e7-95f9-4b62-b1ea-3643985b0d34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '540a93e0374549e48f6b1f51cfbdc7f0'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:58.406452 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-690184e7-95f9-4b62-b1ea-3643985b0d34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '540a93e0374549e48f6b1f51cfbdc7f0'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:58.439059 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-690184e7-95f9-4b62-b1ea-3643985b0d34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '540a93e0374549e48f6b1f51cfbdc7f0'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:58.449374 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-690184e7-95f9-4b62-b1ea-3643985b0d34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '540a93e0374549e48f6b1f51cfbdc7f0'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:58.458724 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1147/2280] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:33:58 2022] DELETE /identity/v3/users/540a93e0374549e48f6b1f51cfbdc7f0 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:58.580586 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1134/2281] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:33:58.588427 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690184e7-95f9-4b62-b1ea-3643985b0d34 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:58.592034 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-690184e7-95f9-4b62-b1ea-3643985b0d34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:58.802957 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690184e7-95f9-4b62-b1ea-3643985b0d34 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:58.820939 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87009102-a73c-4132-9d51-6037af61a11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:58.823247 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87009102-a73c-4132-9d51-6037af61a11b admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:58.824051 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87009102-a73c-4132-9d51-6037af61a11b admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:58.824824 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87009102-a73c-4132-9d51-6037af61a11b admin admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:58.826234 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87009102-a73c-4132-9d51-6037af61a11b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:58.830487 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87009102-a73c-4132-9d51-6037af61a11b admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:58.908015 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1148/2282] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:33:58 2022] POST /identity/v3/projects => generated 373 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:33:58.912323 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8bb049-b96b-4701-8cfd-899ffb152202 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:58.939974 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8bb049-b96b-4701-8cfd-899ffb152202 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:59.193084 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b182b-d5d0-440b-873b-066ea78f8554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:59.194208 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b182b-d5d0-440b-873b-066ea78f8554 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:59.194732 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b182b-d5d0-440b-873b-066ea78f8554 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:59.198057 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b182b-d5d0-440b-873b-066ea78f8554 admin admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:59.199448 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b182b-d5d0-440b-873b-066ea78f8554 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:59.202941 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b182b-d5d0-440b-873b-066ea78f8554 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:59.266471 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1135/2283] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:33:58 2022] POST /identity/v3/users => generated 293 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:33:59.269094 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87009102-a73c-4132-9d51-6037af61a11b admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:59.284215 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87009102-a73c-4132-9d51-6037af61a11b admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:59.294037 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d8211-fd3f-4cfe-835c-c9795595bd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:59.295360 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d8211-fd3f-4cfe-835c-c9795595bd6e admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:59.295881 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d8211-fd3f-4cfe-835c-c9795595bd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:59.296425 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d8211-fd3f-4cfe-835c-c9795595bd6e admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:59.297542 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28d8211-fd3f-4cfe-835c-c9795595bd6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:59.299951 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28d8211-fd3f-4cfe-835c-c9795595bd6e admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:59.311401 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b182b-d5d0-440b-873b-066ea78f8554 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:59.315555 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-171b182b-d5d0-440b-873b-066ea78f8554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:59.351350 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b182b-d5d0-440b-873b-066ea78f8554 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:59.391950 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1149/2284] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:33:59.396338 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d8211-fd3f-4cfe-835c-c9795595bd6e admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:59.397019 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2f1d8-6ed8-4d77-8e40-76b4243c06be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:59.399368 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2f1d8-6ed8-4d77-8e40-76b4243c06be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:59.404008 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2f1d8-6ed8-4d77-8e40-76b4243c06be admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:59.407087 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2f1d8-6ed8-4d77-8e40-76b4243c06be admin admin] PATH_INFO: `/v3/projects/7fd3c18f56294a6c80e47d5343ebcf26` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:59.410632 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f2f1d8-6ed8-4d77-8e40-76b4243c06be admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fd3c18f56294a6c80e47d5343ebcf26)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:59.417107 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f2f1d8-6ed8-4d77-8e40-76b4243c06be admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:59.426155 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d8211-fd3f-4cfe-835c-c9795595bd6e admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:59.444123 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc877e-9fed-477b-8d2b-020540bec63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:59.448157 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc877e-9fed-477b-8d2b-020540bec63a admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:59.462253 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc877e-9fed-477b-8d2b-020540bec63a admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:59.470731 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc877e-9fed-477b-8d2b-020540bec63a admin admin] PATH_INFO: `/v3/projects/3600bc55c6f84479864d57e9a8f9e0af/users/b30b85344f25478c895e766f33edaf21/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:59.539691 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc877e-9fed-477b-8d2b-020540bec63a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3600bc55c6f84479864d57e9a8f9e0af, user_id=b30b85344f25478c895e766f33edaf21, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:59.549143 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc877e-9fed-477b-8d2b-020540bec63a admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:59.589031 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1150/2285] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:33:59 2022] PUT /identity/v3/projects/3600bc55c6f84479864d57e9a8f9e0af/users/b30b85344f25478c895e766f33edaf21/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:59.594673 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc877e-9fed-477b-8d2b-020540bec63a admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:59.603306 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-06f2f1d8-6ed8-4d77-8e40-76b4243c06be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fd3c18f56294a6c80e47d5343ebcf26', 'request_id': 'req-06f2f1d8-6ed8-4d77-8e40-76b4243c06be'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:59.623477 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-06f2f1d8-6ed8-4d77-8e40-76b4243c06be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fd3c18f56294a6c80e47d5343ebcf26', 'request_id': 'req-06f2f1d8-6ed8-4d77-8e40-76b4243c06be'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:59.635248 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-06f2f1d8-6ed8-4d77-8e40-76b4243c06be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fd3c18f56294a6c80e47d5343ebcf26', 'request_id': 'req-06f2f1d8-6ed8-4d77-8e40-76b4243c06be'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:59.674893 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-06f2f1d8-6ed8-4d77-8e40-76b4243c06be admin admin] The token cache is being invalidate because project 7fd3c18f56294a6c80e47d5343ebcf26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:33:59.675130 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-06f2f1d8-6ed8-4d77-8e40-76b4243c06be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:59.677706 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-06f2f1d8-6ed8-4d77-8e40-76b4243c06be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:33:59.684149 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1136/2286] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:33:59 2022] DELETE /identity/v3/projects/7fd3c18f56294a6c80e47d5343ebcf26 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:33:59.685035 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2f1d8-6ed8-4d77-8e40-76b4243c06be admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:59.691712 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-06f2f1d8-6ed8-4d77-8e40-76b4243c06be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:59.752212 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc877e-9fed-477b-8d2b-020540bec63a admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:59.758897 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0deb932-e87f-428e-80e5-3b3ae6f9e371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:59.759948 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0deb932-e87f-428e-80e5-3b3ae6f9e371 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:59.760496 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0deb932-e87f-428e-80e5-3b3ae6f9e371 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:59.760985 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0deb932-e87f-428e-80e5-3b3ae6f9e371 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:59.762718 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0deb932-e87f-428e-80e5-3b3ae6f9e371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:59.765500 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0deb932-e87f-428e-80e5-3b3ae6f9e371 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:59.781772 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1151/2287] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:33:59.783493 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ee3a3-e0bd-429c-9450-039bd755c64e None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:59.784012 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ee3a3-e0bd-429c-9450-039bd755c64e None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:59.784864 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ee3a3-e0bd-429c-9450-039bd755c64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:59.854618 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-966ee3a3-e0bd-429c-9450-039bd755c64e None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:33:59.855848 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-966ee3a3-e0bd-429c-9450-039bd755c64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:59.890226 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1152/2288] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:33:59.892633 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ee3a3-e0bd-429c-9450-039bd755c64e None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:33:59.895686 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2f1d8-6ed8-4d77-8e40-76b4243c06be admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:59.897120 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-966ee3a3-e0bd-429c-9450-039bd755c64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:33:59.912271 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19000994-880c-48dc-b72c-e0a7ff990256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:59.913212 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19000994-880c-48dc-b72c-e0a7ff990256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:59.914110 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19000994-880c-48dc-b72c-e0a7ff990256 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:59.914110 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19000994-880c-48dc-b72c-e0a7ff990256 admin admin] PATH_INFO: `/v3/users/d1caf03a51b043f0b10bc7993127ce9a` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:59.915712 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19000994-880c-48dc-b72c-e0a7ff990256 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1caf03a51b043f0b10bc7993127ce9a)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:59.917704 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19000994-880c-48dc-b72c-e0a7ff990256 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:33:59.923293 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ee3a3-e0bd-429c-9450-039bd755c64e None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:33:59.940914 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae206fcc-a95b-4764-8cb7-e15811982b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:33:59.941279 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae206fcc-a95b-4764-8cb7-e15811982b84 admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:33:59.942627 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae206fcc-a95b-4764-8cb7-e15811982b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:33:59.942913 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae206fcc-a95b-4764-8cb7-e15811982b84 admin admin] PATH_INFO: `/v3/projects/3600bc55c6f84479864d57e9a8f9e0af/users/b30b85344f25478c895e766f33edaf21/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:33:59.959679 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae206fcc-a95b-4764-8cb7-e15811982b84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3600bc55c6f84479864d57e9a8f9e0af, user_id=b30b85344f25478c895e766f33edaf21, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:33:59.964499 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae206fcc-a95b-4764-8cb7-e15811982b84 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:00.021987 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1153/2289] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:33:59 2022] PUT /identity/v3/projects/3600bc55c6f84479864d57e9a8f9e0af/users/b30b85344f25478c895e766f33edaf21/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:34:00.023798 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd974e-a2c0-4500-8df4-1c85ceadcfb8 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:00.024093 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd974e-a2c0-4500-8df4-1c85ceadcfb8 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:00.024406 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd974e-a2c0-4500-8df4-1c85ceadcfb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:00.074741 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-19000994-880c-48dc-b72c-e0a7ff990256 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1caf03a51b043f0b10bc7993127ce9a'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:00.075669 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-2edd974e-a2c0-4500-8df4-1c85ceadcfb8 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:34:00.076129 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-19000994-880c-48dc-b72c-e0a7ff990256 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1caf03a51b043f0b10bc7993127ce9a'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:00.079490 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-2edd974e-a2c0-4500-8df4-1c85ceadcfb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:00.102655 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-19000994-880c-48dc-b72c-e0a7ff990256 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1caf03a51b043f0b10bc7993127ce9a'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:00.120333 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-19000994-880c-48dc-b72c-e0a7ff990256 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1caf03a51b043f0b10bc7993127ce9a'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:00.137107 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-19000994-880c-48dc-b72c-e0a7ff990256 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1caf03a51b043f0b10bc7993127ce9a'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:00.155450 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1137/2290] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:33:59 2022] DELETE /identity/v3/users/d1caf03a51b043f0b10bc7993127ce9a => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:34:00.157779 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1b017-0fd0-4a08-afe3-2d7a71de0bef None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:00.161306 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1b017-0fd0-4a08-afe3-2d7a71de0bef None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:00.161879 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1b017-0fd0-4a08-afe3-2d7a71de0bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:00.217424 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-22e1b017-0fd0-4a08-afe3-2d7a71de0bef None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:34:00.230762 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-22e1b017-0fd0-4a08-afe3-2d7a71de0bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:00.359934 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1154/2291] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:34:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:34:00.362107 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd974e-a2c0-4500-8df4-1c85ceadcfb8 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:00.437776 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd974e-a2c0-4500-8df4-1c85ceadcfb8 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:00.522040 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1138/2292] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:34:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:34:00.539915 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1b017-0fd0-4a08-afe3-2d7a71de0bef None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:00.545086 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-22e1b017-0fd0-4a08-afe3-2d7a71de0bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:00.658525 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36b7ca-dd1b-4cd6-b0b0-2437bd292939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:00.660408 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36b7ca-dd1b-4cd6-b0b0-2437bd292939 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:00.661639 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36b7ca-dd1b-4cd6-b0b0-2437bd292939 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:00.662411 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36b7ca-dd1b-4cd6-b0b0-2437bd292939 admin admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:00.664987 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36b7ca-dd1b-4cd6-b0b0-2437bd292939 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:34:00.666381 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36b7ca-dd1b-4cd6-b0b0-2437bd292939 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:00.670073 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36b7ca-dd1b-4cd6-b0b0-2437bd292939 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:00.709618 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1155/2293] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:34:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:34:00.728002 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36b7ca-dd1b-4cd6-b0b0-2437bd292939 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:00.763382 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36b7ca-dd1b-4cd6-b0b0-2437bd292939 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:00.771275 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1b017-0fd0-4a08-afe3-2d7a71de0bef None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:00.775904 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a96a5d-1d05-4ef7-b1f9-ed56ced920d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:00.779513 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a96a5d-1d05-4ef7-b1f9-ed56ced920d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:00.779905 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a96a5d-1d05-4ef7-b1f9-ed56ced920d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:00.780188 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a96a5d-1d05-4ef7-b1f9-ed56ced920d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:00.780943 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a96a5d-1d05-4ef7-b1f9-ed56ced920d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:00.784644 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a96a5d-1d05-4ef7-b1f9-ed56ced920d1 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:00.788888 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa402c4-5540-46d6-9f46-9c6eec235a37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:00.789677 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa402c4-5540-46d6-9f46-9c6eec235a37 service neutron] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:00.792188 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa402c4-5540-46d6-9f46-9c6eec235a37 service neutron] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:00.792482 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa402c4-5540-46d6-9f46-9c6eec235a37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:00.822070 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa402c4-5540-46d6-9f46-9c6eec235a37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:00.823554 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa402c4-5540-46d6-9f46-9c6eec235a37 service neutron] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:00.868158 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1139/2294] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:34:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:34:00.882392 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1156/2295] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:34:00 2022] POST /identity/v3/projects => generated 385 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:34:00.886297 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa402c4-5540-46d6-9f46-9c6eec235a37 service neutron] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:00.904975 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa402c4-5540-46d6-9f46-9c6eec235a37 service neutron] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:01.063444 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce666d6-c5ac-485b-b1bb-b8122b54ad05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:01.064935 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce666d6-c5ac-485b-b1bb-b8122b54ad05 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:01.065438 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce666d6-c5ac-485b-b1bb-b8122b54ad05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:01.065930 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce666d6-c5ac-485b-b1bb-b8122b54ad05 admin admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:01.068061 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce666d6-c5ac-485b-b1bb-b8122b54ad05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:01.070779 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce666d6-c5ac-485b-b1bb-b8122b54ad05 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:01.141260 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a96a5d-1d05-4ef7-b1f9-ed56ced920d1 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:01.149836 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1140/2296] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:34:00 2022] POST /identity/v3/users => generated 293 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:34:01.156115 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a96a5d-1d05-4ef7-b1f9-ed56ced920d1 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:01.172200 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf4011-4a62-4165-b2ca-a69fe27f4126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:01.174517 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf4011-4a62-4165-b2ca-a69fe27f4126 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:01.175217 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf4011-4a62-4165-b2ca-a69fe27f4126 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:01.175716 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf4011-4a62-4165-b2ca-a69fe27f4126 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:01.177355 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf4011-4a62-4165-b2ca-a69fe27f4126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:01.180802 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf4011-4a62-4165-b2ca-a69fe27f4126 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:01.200540 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1157/2297] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:34:01 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:34:01.202924 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce666d6-c5ac-485b-b1bb-b8122b54ad05 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:01.217657 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce666d6-c5ac-485b-b1bb-b8122b54ad05 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:01.225798 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68bb5c5-763b-4c6e-bf39-444335f73252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:01.226611 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bb5c5-763b-4c6e-bf39-444335f73252 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:01.227046 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bb5c5-763b-4c6e-bf39-444335f73252 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:01.227456 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bb5c5-763b-4c6e-bf39-444335f73252 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:01.228306 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68bb5c5-763b-4c6e-bf39-444335f73252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:01.234725 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68bb5c5-763b-4c6e-bf39-444335f73252 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:01.255360 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1141/2298] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:34:01 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:34:01.256305 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf4011-4a62-4165-b2ca-a69fe27f4126 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:01.287974 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf4011-4a62-4165-b2ca-a69fe27f4126 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:01.342581 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fbe0f1-9612-4264-95c1-7265a5b30f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:01.345057 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbe0f1-9612-4264-95c1-7265a5b30f7b admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:01.345544 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbe0f1-9612-4264-95c1-7265a5b30f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:01.345832 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbe0f1-9612-4264-95c1-7265a5b30f7b admin admin] PATH_INFO: `/v3/projects/acd2bda038a04ea3bc634f70ba149bef/users/bb9550d2d7fa4e868168410f89a53457/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:01.416196 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fbe0f1-9612-4264-95c1-7265a5b30f7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=acd2bda038a04ea3bc634f70ba149bef, user_id=bb9550d2d7fa4e868168410f89a53457, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:01.440408 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fbe0f1-9612-4264-95c1-7265a5b30f7b admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:01.490054 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1158/2299] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:34:01 2022] PUT /identity/v3/projects/acd2bda038a04ea3bc634f70ba149bef/users/bb9550d2d7fa4e868168410f89a53457/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:34:01.502199 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2784cc-020c-45dd-9ac4-2486449646e2 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:01.502584 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2784cc-020c-45dd-9ac4-2486449646e2 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:01.502961 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2784cc-020c-45dd-9ac4-2486449646e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:01.535886 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-3c2784cc-020c-45dd-9ac4-2486449646e2 None None] MFA Rules not processed for user `bb9550d2d7fa4e868168410f89a53457`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:34:01.537222 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-3c2784cc-020c-45dd-9ac4-2486449646e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:01.661890 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1142/2300] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:34:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:34:01.667874 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fbe0f1-9612-4264-95c1-7265a5b30f7b admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:01.808238 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fbe0f1-9612-4264-95c1-7265a5b30f7b admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:01.830948 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8738f8ee-a043-498a-8c1f-dd72610d6941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:01.832030 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738f8ee-a043-498a-8c1f-dd72610d6941 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:01.832536 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738f8ee-a043-498a-8c1f-dd72610d6941 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:01.833052 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738f8ee-a043-498a-8c1f-dd72610d6941 admin admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:01.833989 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8738f8ee-a043-498a-8c1f-dd72610d6941 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:01.836182 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8738f8ee-a043-498a-8c1f-dd72610d6941 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:01.897991 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1159/2301] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:34:01 2022] POST /identity/v3/projects => generated 385 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:34:01.900366 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2784cc-020c-45dd-9ac4-2486449646e2 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:01.924076 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2784cc-020c-45dd-9ac4-2486449646e2 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:02.111558 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144bb57b-3ae1-421f-9aa6-3de3da2855a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:02.112287 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144bb57b-3ae1-421f-9aa6-3de3da2855a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:02.112439 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144bb57b-3ae1-421f-9aa6-3de3da2855a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:02.112683 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144bb57b-3ae1-421f-9aa6-3de3da2855a4 admin admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:02.113383 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144bb57b-3ae1-421f-9aa6-3de3da2855a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:02.115523 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144bb57b-3ae1-421f-9aa6-3de3da2855a4 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:02.160730 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1143/2302] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:34:01 2022] POST /identity/v3/users => generated 299 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:34:02.165714 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8738f8ee-a043-498a-8c1f-dd72610d6941 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:02.212586 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8738f8ee-a043-498a-8c1f-dd72610d6941 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:02.233617 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bcf5b7-c6e0-47f9-beac-b377d168c3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:02.234510 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bcf5b7-c6e0-47f9-beac-b377d168c3ab admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:02.234993 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bcf5b7-c6e0-47f9-beac-b377d168c3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:02.235300 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bcf5b7-c6e0-47f9-beac-b377d168c3ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:02.237141 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bcf5b7-c6e0-47f9-beac-b377d168c3ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:02.239510 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bcf5b7-c6e0-47f9-beac-b377d168c3ab admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:02.297109 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1160/2303] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:34:02.298905 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144bb57b-3ae1-421f-9aa6-3de3da2855a4 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:02.300651 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-144bb57b-3ae1-421f-9aa6-3de3da2855a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:02.304479 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bcf5b7-c6e0-47f9-beac-b377d168c3ab admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:02.362423 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144bb57b-3ae1-421f-9aa6-3de3da2855a4 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:02.365875 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bcf5b7-c6e0-47f9-beac-b377d168c3ab admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:02.389347 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5121ae-36f1-4af2-9e97-86045c70f631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:02.390227 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5121ae-36f1-4af2-9e97-86045c70f631 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:02.390534 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5121ae-36f1-4af2-9e97-86045c70f631 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:02.390812 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5121ae-36f1-4af2-9e97-86045c70f631 admin admin] PATH_INFO: `/v3/projects/6cf4ea175d3c4c7fb2f4fca8aaebb163` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:02.406455 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5121ae-36f1-4af2-9e97-86045c70f631 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cf4ea175d3c4c7fb2f4fca8aaebb163)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:02.408426 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5121ae-36f1-4af2-9e97-86045c70f631 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:02.412943 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45883e-9a80-441d-aa38-29da8dcd6eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:02.414053 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45883e-9a80-441d-aa38-29da8dcd6eee admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:02.418376 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45883e-9a80-441d-aa38-29da8dcd6eee admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:02.420072 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45883e-9a80-441d-aa38-29da8dcd6eee admin admin] PATH_INFO: `/v3/projects/773c6aa55abd47b69f05ffb5454113a5/users/f942d2ea86e44c2fabc0437aaeee81af/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:02.468659 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a45883e-9a80-441d-aa38-29da8dcd6eee admin admin] RBAC: Authorizing `identity:create_grant(project_id=773c6aa55abd47b69f05ffb5454113a5, user_id=f942d2ea86e44c2fabc0437aaeee81af, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:02.471338 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a45883e-9a80-441d-aa38-29da8dcd6eee admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:02.508431 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1161/2304] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:34:02 2022] PUT /identity/v3/projects/773c6aa55abd47b69f05ffb5454113a5/users/f942d2ea86e44c2fabc0437aaeee81af/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:34:02.513580 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45883e-9a80-441d-aa38-29da8dcd6eee admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:02.608032 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-bc5121ae-36f1-4af2-9e97-86045c70f631 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cf4ea175d3c4c7fb2f4fca8aaebb163', 'request_id': 'req-bc5121ae-36f1-4af2-9e97-86045c70f631'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:02.632661 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-bc5121ae-36f1-4af2-9e97-86045c70f631 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cf4ea175d3c4c7fb2f4fca8aaebb163', 'request_id': 'req-bc5121ae-36f1-4af2-9e97-86045c70f631'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:02.647023 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-bc5121ae-36f1-4af2-9e97-86045c70f631 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cf4ea175d3c4c7fb2f4fca8aaebb163', 'request_id': 'req-bc5121ae-36f1-4af2-9e97-86045c70f631'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:02.675549 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-bc5121ae-36f1-4af2-9e97-86045c70f631 admin admin] The token cache is being invalidate because project 6cf4ea175d3c4c7fb2f4fca8aaebb163 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:34:02.678611 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-bc5121ae-36f1-4af2-9e97-86045c70f631 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:02.680723 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-bc5121ae-36f1-4af2-9e97-86045c70f631 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:02.695441 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1144/2305] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:34:02 2022] DELETE /identity/v3/projects/6cf4ea175d3c4c7fb2f4fca8aaebb163 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:34:02.702216 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698358b-c000-4c4e-b5d0-eb90c8c91500 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:02.702775 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698358b-c000-4c4e-b5d0-eb90c8c91500 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:02.703201 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698358b-c000-4c4e-b5d0-eb90c8c91500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:02.740644 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-6698358b-c000-4c4e-b5d0-eb90c8c91500 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:34:02.748737 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-6698358b-c000-4c4e-b5d0-eb90c8c91500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:02.781158 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45883e-9a80-441d-aa38-29da8dcd6eee admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:02.857975 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1145/2306] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:34:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:34:02.869504 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6825b1-f735-41af-ba20-7b789cf02837 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:02.872740 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6825b1-f735-41af-ba20-7b789cf02837 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:02.873112 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6825b1-f735-41af-ba20-7b789cf02837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:02.899610 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-9c6825b1-f735-41af-ba20-7b789cf02837 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:34:02.901298 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-9c6825b1-f735-41af-ba20-7b789cf02837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:02.916039 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1146/2307] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:34:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:34:02.917509 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6825b1-f735-41af-ba20-7b789cf02837 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:02.932114 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6825b1-f735-41af-ba20-7b789cf02837 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:02.941408 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a0ac54-4a26-49a7-879c-5515f106488b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:02.942667 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0ac54-4a26-49a7-879c-5515f106488b admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:02.943187 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0ac54-4a26-49a7-879c-5515f106488b admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:02.943690 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0ac54-4a26-49a7-879c-5515f106488b admin admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:02.944635 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a0ac54-4a26-49a7-879c-5515f106488b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:34:02.945200 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a0ac54-4a26-49a7-879c-5515f106488b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:02.947072 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a0ac54-4a26-49a7-879c-5515f106488b admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:02.966509 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1147/2308] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:34:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:34:02.967824 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a0ac54-4a26-49a7-879c-5515f106488b admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:02.981882 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a0ac54-4a26-49a7-879c-5515f106488b admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:02.989064 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad021a78-9f17-4695-b702-65dd655a55c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:02.990293 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad021a78-9f17-4695-b702-65dd655a55c3 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:02.990920 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad021a78-9f17-4695-b702-65dd655a55c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:02.991548 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad021a78-9f17-4695-b702-65dd655a55c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:02.992965 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad021a78-9f17-4695-b702-65dd655a55c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:02.995296 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad021a78-9f17-4695-b702-65dd655a55c3 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:03.018658 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336f696-4572-43e7-9a69-d0e4148d0831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:03.019708 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336f696-4572-43e7-9a69-d0e4148d0831 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:03.020247 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336f696-4572-43e7-9a69-d0e4148d0831 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:03.020768 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336f696-4572-43e7-9a69-d0e4148d0831 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:03.022142 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2336f696-4572-43e7-9a69-d0e4148d0831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:03.025041 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2336f696-4572-43e7-9a69-d0e4148d0831 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:03.049143 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1148/2309] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:34:02 2022] POST /identity/v3/projects => generated 383 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:34:03.051054 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad021a78-9f17-4695-b702-65dd655a55c3 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:03.083087 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1162/2310] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 571 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:34:03.090729 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336f696-4572-43e7-9a69-d0e4148d0831 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:03.114690 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-2336f696-4572-43e7-9a69-d0e4148d0831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:03.139139 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336f696-4572-43e7-9a69-d0e4148d0831 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:03.145477 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad021a78-9f17-4695-b702-65dd655a55c3 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:03.150572 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c6cd0-2ae5-47a7-825c-1c3e04d812f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:03.152179 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c6cd0-2ae5-47a7-825c-1c3e04d812f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:03.152921 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c6cd0-2ae5-47a7-825c-1c3e04d812f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:03.153602 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c6cd0-2ae5-47a7-825c-1c3e04d812f6 admin admin] PATH_INFO: `/v3/projects/773c6aa55abd47b69f05ffb5454113a5/users/f942d2ea86e44c2fabc0437aaeee81af/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:03.159265 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7230305a-53a4-4a2e-b067-4365f81d5b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:03.163984 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230305a-53a4-4a2e-b067-4365f81d5b0e admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:03.164392 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230305a-53a4-4a2e-b067-4365f81d5b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:03.164772 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230305a-53a4-4a2e-b067-4365f81d5b0e admin admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:03.165393 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c6cd0-2ae5-47a7-825c-1c3e04d812f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=773c6aa55abd47b69f05ffb5454113a5, user_id=f942d2ea86e44c2fabc0437aaeee81af, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:03.165679 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7230305a-53a4-4a2e-b067-4365f81d5b0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:03.167889 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7230305a-53a4-4a2e-b067-4365f81d5b0e admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:03.169264 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c6cd0-2ae5-47a7-825c-1c3e04d812f6 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:03.194745 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1163/2311] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:34:03 2022] PUT /identity/v3/projects/773c6aa55abd47b69f05ffb5454113a5/users/f942d2ea86e44c2fabc0437aaeee81af/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:34:03.207395 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652750f-7a96-4d8e-9816-0cdd9594f6f7 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:03.208413 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652750f-7a96-4d8e-9816-0cdd9594f6f7 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:03.209080 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652750f-7a96-4d8e-9816-0cdd9594f6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:03.232241 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1149/2312] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:34:03 2022] POST /identity/v3/users => generated 292 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:34:03.233344 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7230305a-53a4-4a2e-b067-4365f81d5b0e admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:03.264718 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7230305a-53a4-4a2e-b067-4365f81d5b0e admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:03.266264 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-1652750f-7a96-4d8e-9816-0cdd9594f6f7 None None] MFA Rules not processed for user `f942d2ea86e44c2fabc0437aaeee81af`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:34:03.267751 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-1652750f-7a96-4d8e-9816-0cdd9594f6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:03.566972 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5179640c-11d0-4f77-988c-92b993520ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:03.567684 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1164/2313] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:34:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:34:03.568195 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179640c-11d0-4f77-988c-92b993520ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:03.568345 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179640c-11d0-4f77-988c-92b993520ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:03.568733 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179640c-11d0-4f77-988c-92b993520ae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:03.576842 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5179640c-11d0-4f77-988c-92b993520ae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:03.579581 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5179640c-11d0-4f77-988c-92b993520ae2 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:03.592945 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652750f-7a96-4d8e-9816-0cdd9594f6f7 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:03.594922 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-1652750f-7a96-4d8e-9816-0cdd9594f6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:03.653704 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1150/2314] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:34:03.655040 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5179640c-11d0-4f77-988c-92b993520ae2 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:03.701622 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5179640c-11d0-4f77-988c-92b993520ae2 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:03.724142 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448ec45-3b4b-42c4-a238-021edd4f18d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:03.724930 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448ec45-3b4b-42c4-a238-021edd4f18d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:03.725271 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448ec45-3b4b-42c4-a238-021edd4f18d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:03.727035 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448ec45-3b4b-42c4-a238-021edd4f18d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:03.730852 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c448ec45-3b4b-42c4-a238-021edd4f18d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:03.734254 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c448ec45-3b4b-42c4-a238-021edd4f18d2 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:03.778369 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1151/2315] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:34:03.779887 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448ec45-3b4b-42c4-a238-021edd4f18d2 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:03.813330 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448ec45-3b4b-42c4-a238-021edd4f18d2 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:03.823825 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652750f-7a96-4d8e-9816-0cdd9594f6f7 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:03.828499 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f56c4-f0c7-4810-aa42-f8e6c727aeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:03.829815 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f56c4-f0c7-4810-aa42-f8e6c727aeaf admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:03.832706 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f56c4-f0c7-4810-aa42-f8e6c727aeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:03.834028 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f56c4-f0c7-4810-aa42-f8e6c727aeaf admin admin] PATH_INFO: `/v3/projects/b8784f6a53624f7688d9ae0ae0e15169/users/e840e28ad3194d7ea995ea2d2b57843e/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:03.840251 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e92ad-02a3-4e4b-94e6-b288df7762c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:03.841683 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e92ad-02a3-4e4b-94e6-b288df7762c3 service cinder] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:03.841954 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e92ad-02a3-4e4b-94e6-b288df7762c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:03.850360 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e92ad-02a3-4e4b-94e6-b288df7762c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:03.854464 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-559e92ad-02a3-4e4b-94e6-b288df7762c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:03.882626 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f56c4-f0c7-4810-aa42-f8e6c727aeaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8784f6a53624f7688d9ae0ae0e15169, user_id=e840e28ad3194d7ea995ea2d2b57843e, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:03.890730 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f56c4-f0c7-4810-aa42-f8e6c727aeaf admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:03.947211 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1152/2316] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:34:03 2022] PUT /identity/v3/projects/b8784f6a53624f7688d9ae0ae0e15169/users/e840e28ad3194d7ea995ea2d2b57843e/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:34:03.954607 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7defcd-8223-41ab-9e6b-cff1f8667f49 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:03.954908 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7defcd-8223-41ab-9e6b-cff1f8667f49 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:03.955169 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7defcd-8223-41ab-9e6b-cff1f8667f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:04.018908 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-8c7defcd-8223-41ab-9e6b-cff1f8667f49 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:34:04.020058 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-8c7defcd-8223-41ab-9e6b-cff1f8667f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:04.099243 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e92ad-02a3-4e4b-94e6-b288df7762c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:04.105403 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e92ad-02a3-4e4b-94e6-b288df7762c3 service cinder] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:04.147057 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1165/2317] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:34:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:34:04.196300 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1153/2318] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:34:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:34:04.208131 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e92ad-02a3-4e4b-94e6-b288df7762c3 service cinder] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:04.209555 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-559e92ad-02a3-4e4b-94e6-b288df7762c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:04.367811 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e92ad-02a3-4e4b-94e6-b288df7762c3 service cinder] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:04.539849 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7fc26-28d9-476c-9b03-a39abab1c04f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:04.542995 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7fc26-28d9-476c-9b03-a39abab1c04f service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:04.545549 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7fc26-28d9-476c-9b03-a39abab1c04f service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:04.546812 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7fc26-28d9-476c-9b03-a39abab1c04f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:04.566709 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d7fc26-28d9-476c-9b03-a39abab1c04f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:04.568409 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d7fc26-28d9-476c-9b03-a39abab1c04f service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:04.593259 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1166/2319] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:34:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:34:07.344421 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c197e1-0d0c-4791-98bc-7b4422ec8fd6 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:07.344421 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c197e1-0d0c-4791-98bc-7b4422ec8fd6 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:07.344421 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c197e1-0d0c-4791-98bc-7b4422ec8fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:07.447439 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-f2c197e1-0d0c-4791-98bc-7b4422ec8fd6 None None] MFA Rules not processed for user `1c1284bfe6cc43848731ed2b3d9e914b`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:34:07.455126 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-f2c197e1-0d0c-4791-98bc-7b4422ec8fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:07.642908 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1154/2320] 10.222.0.21 () {58 vars in 967 bytes} [Mon Feb 28 10:34:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:34:07.662166 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7fc26-28d9-476c-9b03-a39abab1c04f service neutron] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:07.665041 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-74d7fc26-28d9-476c-9b03-a39abab1c04f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:07.826930 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7fc26-28d9-476c-9b03-a39abab1c04f service neutron] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:07.833596 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3be8a-f407-4287-a836-eedda74175e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8696fe8a37aa4d73a62bdc2efd35a23d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:07.834523 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3be8a-f407-4287-a836-eedda74175e3 service swift] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:07.835013 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3be8a-f407-4287-a836-eedda74175e3 service swift] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:07.835528 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3be8a-f407-4287-a836-eedda74175e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:07.852911 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e3be8a-f407-4287-a836-eedda74175e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:07.855224 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e3be8a-f407-4287-a836-eedda74175e3 service swift] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:07.865950 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1167/2321] 10.222.0.21 () {60 vars in 1384 bytes} [Mon Feb 28 10:34:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 10:34:09.910521 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c197e1-0d0c-4791-98bc-7b4422ec8fd6 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:10.072580 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c197e1-0d0c-4791-98bc-7b4422ec8fd6 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:10.091633 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a73a5-31b7-45fc-ab03-bfbe6dfe95ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:10.092306 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a73a5-31b7-45fc-ab03-bfbe6dfe95ee service cinder] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:10.092592 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a73a5-31b7-45fc-ab03-bfbe6dfe95ee service cinder] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:10.092865 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a73a5-31b7-45fc-ab03-bfbe6dfe95ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:10.306483 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a73a5-31b7-45fc-ab03-bfbe6dfe95ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:10.308443 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a73a5-31b7-45fc-ab03-bfbe6dfe95ee service cinder] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:10.352253 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1155/2322] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:34:09 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:34:13.208666 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3be8a-f407-4287-a836-eedda74175e3 service swift] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:13.210400 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-99e3be8a-f407-4287-a836-eedda74175e3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:13.242288 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3be8a-f407-4287-a836-eedda74175e3 service swift] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:13.265890 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e22e5-82fc-4d0e-aeee-67c7ca5c850f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:13.267151 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e22e5-82fc-4d0e-aeee-67c7ca5c850f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:13.267582 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e22e5-82fc-4d0e-aeee-67c7ca5c850f admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:13.267925 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e22e5-82fc-4d0e-aeee-67c7ca5c850f admin admin] PATH_INFO: `/v3/users/2c32548c092048afaf0a89eaccdc05cd` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:13.270213 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e22e5-82fc-4d0e-aeee-67c7ca5c850f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c32548c092048afaf0a89eaccdc05cd)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:13.274261 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e22e5-82fc-4d0e-aeee-67c7ca5c850f admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:13.391896 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-a38e22e5-82fc-4d0e-aeee-67c7ca5c850f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c32548c092048afaf0a89eaccdc05cd'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:13.421870 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-a38e22e5-82fc-4d0e-aeee-67c7ca5c850f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c32548c092048afaf0a89eaccdc05cd'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:13.422679 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-a38e22e5-82fc-4d0e-aeee-67c7ca5c850f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c32548c092048afaf0a89eaccdc05cd'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:13.447599 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-a38e22e5-82fc-4d0e-aeee-67c7ca5c850f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c32548c092048afaf0a89eaccdc05cd'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:13.477454 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-a38e22e5-82fc-4d0e-aeee-67c7ca5c850f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c32548c092048afaf0a89eaccdc05cd'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:13.495825 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1168/2323] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:34:13 2022] DELETE /identity/v3/users/2c32548c092048afaf0a89eaccdc05cd => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:34:14.076964 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a73a5-31b7-45fc-ab03-bfbe6dfe95ee service cinder] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:14.113236 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a73a5-31b7-45fc-ab03-bfbe6dfe95ee service cinder] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:14.315995 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711418c4-846e-457c-9f93-275039744fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:14.316873 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711418c4-846e-457c-9f93-275039744fd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:14.317159 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711418c4-846e-457c-9f93-275039744fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:14.317430 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711418c4-846e-457c-9f93-275039744fd3 admin admin] PATH_INFO: `/v3/projects/6098811200df4998b4c983c44640d16f` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:14.322589 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711418c4-846e-457c-9f93-275039744fd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6098811200df4998b4c983c44640d16f)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:14.328839 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711418c4-846e-457c-9f93-275039744fd3 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:14.459641 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-711418c4-846e-457c-9f93-275039744fd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6098811200df4998b4c983c44640d16f', 'request_id': 'req-711418c4-846e-457c-9f93-275039744fd3'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:14.472030 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-711418c4-846e-457c-9f93-275039744fd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6098811200df4998b4c983c44640d16f', 'request_id': 'req-711418c4-846e-457c-9f93-275039744fd3'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:14.489907 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-711418c4-846e-457c-9f93-275039744fd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6098811200df4998b4c983c44640d16f', 'request_id': 'req-711418c4-846e-457c-9f93-275039744fd3'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:14.530058 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-711418c4-846e-457c-9f93-275039744fd3 admin admin] The token cache is being invalidate because project 6098811200df4998b4c983c44640d16f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:34:14.530423 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-711418c4-846e-457c-9f93-275039744fd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:14.531288 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-711418c4-846e-457c-9f93-275039744fd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:14.532880 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1156/2324] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:34:14 2022] DELETE /identity/v3/projects/6098811200df4998b4c983c44640d16f => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:34:14.539978 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15fb9c-7814-43ef-a955-6a52f1858da5 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:14.540804 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15fb9c-7814-43ef-a955-6a52f1858da5 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:14.540804 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15fb9c-7814-43ef-a955-6a52f1858da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:14.635457 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-8f15fb9c-7814-43ef-a955-6a52f1858da5 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:34:14.640987 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-8f15fb9c-7814-43ef-a955-6a52f1858da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:14.802543 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1169/2325] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:34:14.808276 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0ade6-6c19-412f-91a0-73c0fad06672 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:14.808789 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0ade6-6c19-412f-91a0-73c0fad06672 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:14.810328 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0ade6-6c19-412f-91a0-73c0fad06672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:14.857179 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-eaf0ade6-6c19-412f-91a0-73c0fad06672 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:34:14.860248 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-eaf0ade6-6c19-412f-91a0-73c0fad06672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:14.881669 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1157/2326] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:34:14.885505 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15fb9c-7814-43ef-a955-6a52f1858da5 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:14.896680 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15fb9c-7814-43ef-a955-6a52f1858da5 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:14.923403 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40256d-7fa7-43cb-9205-75985ebfa2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:14.924085 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40256d-7fa7-43cb-9205-75985ebfa2c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:14.924369 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40256d-7fa7-43cb-9205-75985ebfa2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:14.924646 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40256d-7fa7-43cb-9205-75985ebfa2c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:14.925378 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af40256d-7fa7-43cb-9205-75985ebfa2c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:34:14.925683 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af40256d-7fa7-43cb-9205-75985ebfa2c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:14.927341 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af40256d-7fa7-43cb-9205-75985ebfa2c2 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:14.987441 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1170/2327] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:34:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:34:14.991447 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0ade6-6c19-412f-91a0-73c0fad06672 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:15.003040 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0ade6-6c19-412f-91a0-73c0fad06672 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:15.026046 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6cfe25-9d42-449e-b85c-d3142373263c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:15.029907 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6cfe25-9d42-449e-b85c-d3142373263c admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:15.030208 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6cfe25-9d42-449e-b85c-d3142373263c admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:15.030453 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6cfe25-9d42-449e-b85c-d3142373263c admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:15.031216 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6cfe25-9d42-449e-b85c-d3142373263c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:15.033205 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6cfe25-9d42-449e-b85c-d3142373263c admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:15.169104 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1158/2328] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:34:14 2022] POST /identity/v3/projects => generated 373 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:34:15.173329 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40256d-7fa7-43cb-9205-75985ebfa2c2 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:15.188300 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40256d-7fa7-43cb-9205-75985ebfa2c2 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:15.318297 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a4e16-b6c3-4028-b56f-33ebbcc8e97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:15.319612 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a4e16-b6c3-4028-b56f-33ebbcc8e97a admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:15.321039 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a4e16-b6c3-4028-b56f-33ebbcc8e97a admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:15.321494 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a4e16-b6c3-4028-b56f-33ebbcc8e97a admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:15.324405 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a4e16-b6c3-4028-b56f-33ebbcc8e97a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:15.326418 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a4e16-b6c3-4028-b56f-33ebbcc8e97a admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:15.341277 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ffe3c-45c6-4cd3-b071-f5ffb1b2e300 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:15.341690 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ffe3c-45c6-4cd3-b071-f5ffb1b2e300 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:15.342240 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ffe3c-45c6-4cd3-b071-f5ffb1b2e300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:15.389753 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1171/2329] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:34:15 2022] POST /identity/v3/users => generated 287 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:34:15.397192 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a4e16-b6c3-4028-b56f-33ebbcc8e97a admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:15.399738 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-180ffe3c-45c6-4cd3-b071-f5ffb1b2e300 None None] MFA Rules not processed for user `e840e28ad3194d7ea995ea2d2b57843e`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:34:15.405734 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-180ffe3c-45c6-4cd3-b071-f5ffb1b2e300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:15.424829 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a4e16-b6c3-4028-b56f-33ebbcc8e97a admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:15.431098 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9080d38a-f25b-4ce4-88f8-90563d8c555c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:15.432252 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9080d38a-f25b-4ce4-88f8-90563d8c555c admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:15.432706 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9080d38a-f25b-4ce4-88f8-90563d8c555c admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:15.433155 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9080d38a-f25b-4ce4-88f8-90563d8c555c admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:15.435771 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9080d38a-f25b-4ce4-88f8-90563d8c555c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:15.439563 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9080d38a-f25b-4ce4-88f8-90563d8c555c admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:15.463670 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1172/2330] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:34:15.471937 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26ddee-f792-4f76-94ac-24264153e644 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:15.472828 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26ddee-f792-4f76-94ac-24264153e644 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:15.473400 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26ddee-f792-4f76-94ac-24264153e644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:15.522367 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-3c26ddee-f792-4f76-94ac-24264153e644 None None] MFA Rules not processed for user `b30b85344f25478c895e766f33edaf21`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:34:15.529195 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-3c26ddee-f792-4f76-94ac-24264153e644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:15.561628 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1159/2331] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:34:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:34:15.565295 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ffe3c-45c6-4cd3-b071-f5ffb1b2e300 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:15.583788 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ffe3c-45c6-4cd3-b071-f5ffb1b2e300 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:15.600633 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67caa7db-57eb-48d0-96e8-c13ebf3f4f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:15.601729 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67caa7db-57eb-48d0-96e8-c13ebf3f4f9a admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:15.602162 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67caa7db-57eb-48d0-96e8-c13ebf3f4f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:15.602649 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67caa7db-57eb-48d0-96e8-c13ebf3f4f9a admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:15.603533 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67caa7db-57eb-48d0-96e8-c13ebf3f4f9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:15.605287 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67caa7db-57eb-48d0-96e8-c13ebf3f4f9a admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:15.649922 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1160/2332] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:34:15.650838 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67caa7db-57eb-48d0-96e8-c13ebf3f4f9a admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:15.659038 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-67caa7db-57eb-48d0-96e8-c13ebf3f4f9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:15.703271 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67caa7db-57eb-48d0-96e8-c13ebf3f4f9a admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:15.717012 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9071d57-6fe4-432c-902d-ce848515508c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:15.719212 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9071d57-6fe4-432c-902d-ce848515508c admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:15.719725 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9071d57-6fe4-432c-902d-ce848515508c admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:15.720010 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9071d57-6fe4-432c-902d-ce848515508c admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:15.720938 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9071d57-6fe4-432c-902d-ce848515508c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:15.726630 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9071d57-6fe4-432c-902d-ce848515508c admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:15.763154 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1173/2333] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:34:15 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:34:15.766053 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26ddee-f792-4f76-94ac-24264153e644 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:15.805896 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26ddee-f792-4f76-94ac-24264153e644 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:15.823963 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43439f8-8508-4bef-9b6a-af79a9a7371b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:15.825588 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43439f8-8508-4bef-9b6a-af79a9a7371b admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:15.826006 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43439f8-8508-4bef-9b6a-af79a9a7371b admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:15.826291 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43439f8-8508-4bef-9b6a-af79a9a7371b admin admin] PATH_INFO: `/v3/projects/4aa1580aa3bb4e399ac0c6a4a2a28465/users/50143c0cddf04675af5b19a5c341bb27/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:15.836571 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1161/2334] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:34:15 2022] POST /identity/v3/projects => generated 385 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:34:15.838299 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9071d57-6fe4-432c-902d-ce848515508c admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:15.845235 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-f9071d57-6fe4-432c-902d-ce848515508c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:15.870761 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43439f8-8508-4bef-9b6a-af79a9a7371b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aa1580aa3bb4e399ac0c6a4a2a28465, user_id=50143c0cddf04675af5b19a5c341bb27, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:15.874934 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43439f8-8508-4bef-9b6a-af79a9a7371b admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:15.904375 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1174/2335] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:34:15 2022] PUT /identity/v3/projects/4aa1580aa3bb4e399ac0c6a4a2a28465/users/50143c0cddf04675af5b19a5c341bb27/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:34:15.905447 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43439f8-8508-4bef-9b6a-af79a9a7371b admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:16.020802 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9071d57-6fe4-432c-902d-ce848515508c admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:16.035017 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43439f8-8508-4bef-9b6a-af79a9a7371b admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:16.044711 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de4519-6645-4299-b57b-ed5a6cd3e10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:16.046924 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de4519-6645-4299-b57b-ed5a6cd3e10b admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:16.047385 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de4519-6645-4299-b57b-ed5a6cd3e10b admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:16.048264 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de4519-6645-4299-b57b-ed5a6cd3e10b admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:16.050572 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de4519-6645-4299-b57b-ed5a6cd3e10b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:16.065250 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de4519-6645-4299-b57b-ed5a6cd3e10b admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:16.165930 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8db6b8-6795-49e7-b0a8-a6c31fdacedd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec202a34db8e47f4a6c18285245e3f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:16.166904 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8db6b8-6795-49e7-b0a8-a6c31fdacedd service nova] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:16.167340 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8db6b8-6795-49e7-b0a8-a6c31fdacedd service nova] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:16.168493 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8db6b8-6795-49e7-b0a8-a6c31fdacedd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:16.171307 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-4a8db6b8-6795-49e7-b0a8-a6c31fdacedd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:16.176200 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1175/2336] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:34:15 2022] POST /identity/v3/users => generated 299 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:34:16.177837 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6c000-093f-44a8-b361-a2aa15adab54 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:16.178229 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6c000-093f-44a8-b361-a2aa15adab54 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:16.178634 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6c000-093f-44a8-b361-a2aa15adab54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:16.252339 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-eff6c000-093f-44a8-b361-a2aa15adab54 None None] MFA Rules not processed for user `50143c0cddf04675af5b19a5c341bb27`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:34:16.253739 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-eff6c000-093f-44a8-b361-a2aa15adab54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:16.278232 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8db6b8-6795-49e7-b0a8-a6c31fdacedd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:16.280994 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8db6b8-6795-49e7-b0a8-a6c31fdacedd service nova] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:16.308024 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1162/2337] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:34:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:34:16.308964 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8db6b8-6795-49e7-b0a8-a6c31fdacedd service nova] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:16.342942 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8db6b8-6795-49e7-b0a8-a6c31fdacedd service nova] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:16.358255 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1560d27c-83ae-438c-a648-f70a7591b64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:16.359211 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560d27c-83ae-438c-a648-f70a7591b64e admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:16.359649 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560d27c-83ae-438c-a648-f70a7591b64e admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:16.360079 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560d27c-83ae-438c-a648-f70a7591b64e admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:16.361479 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1560d27c-83ae-438c-a648-f70a7591b64e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:16.363981 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1560d27c-83ae-438c-a648-f70a7591b64e admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:16.378200 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1163/2338] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:34:16 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:34:16.381960 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1560d27c-83ae-438c-a648-f70a7591b64e admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:16.398279 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1560d27c-83ae-438c-a648-f70a7591b64e admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:16.421581 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de58b41c-5c43-41b6-953d-04bc91a192a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:16.422784 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58b41c-5c43-41b6-953d-04bc91a192a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:16.423223 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58b41c-5c43-41b6-953d-04bc91a192a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:16.423658 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58b41c-5c43-41b6-953d-04bc91a192a2 admin admin] PATH_INFO: `/v3/projects/f2cc8158f70a4daa967243f70196b5fc/users/8d9dc15798084af1b70e015e8755943e/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:16.441900 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de58b41c-5c43-41b6-953d-04bc91a192a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2cc8158f70a4daa967243f70196b5fc, user_id=8d9dc15798084af1b70e015e8755943e, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:16.443746 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1176/2339] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:34:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:34:16.445636 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de58b41c-5c43-41b6-953d-04bc91a192a2 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:16.457562 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6c000-093f-44a8-b361-a2aa15adab54 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:16.459427 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-eff6c000-093f-44a8-b361-a2aa15adab54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:16.486430 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1164/2340] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:34:16 2022] PUT /identity/v3/projects/f2cc8158f70a4daa967243f70196b5fc/users/8d9dc15798084af1b70e015e8755943e/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:34:16.490029 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de58b41c-5c43-41b6-953d-04bc91a192a2 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:16.595666 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6c000-093f-44a8-b361-a2aa15adab54 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:16.609509 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de58b41c-5c43-41b6-953d-04bc91a192a2 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:16.615144 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2849261c-c922-48da-89c3-97e945466b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:16.615822 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849261c-c922-48da-89c3-97e945466b95 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:16.616106 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849261c-c922-48da-89c3-97e945466b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:16.616382 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849261c-c922-48da-89c3-97e945466b95 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:16.617117 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2849261c-c922-48da-89c3-97e945466b95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:16.618750 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2849261c-c922-48da-89c3-97e945466b95 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:16.637414 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1165/2341] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:34:16 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:34:16.638289 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2849261c-c922-48da-89c3-97e945466b95 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:16.643257 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-2849261c-c922-48da-89c3-97e945466b95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:16.672593 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2849261c-c922-48da-89c3-97e945466b95 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:16.680840 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d5d78-8cad-4b26-8c2b-ac607738ec49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:16.681726 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d5d78-8cad-4b26-8c2b-ac607738ec49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:16.682013 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d5d78-8cad-4b26-8c2b-ac607738ec49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:16.682292 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d5d78-8cad-4b26-8c2b-ac607738ec49 admin admin] PATH_INFO: `/v3/users/bb9550d2d7fa4e868168410f89a53457` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:16.683941 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d5d78-8cad-4b26-8c2b-ac607738ec49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb9550d2d7fa4e868168410f89a53457)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:16.687255 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d5d78-8cad-4b26-8c2b-ac607738ec49 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:16.711347 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2ab60-1224-462c-bf28-10c7dbeeac7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:16.712348 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2ab60-1224-462c-bf28-10c7dbeeac7f service cinder] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:16.712987 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2ab60-1224-462c-bf28-10c7dbeeac7f service cinder] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:16.713338 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2ab60-1224-462c-bf28-10c7dbeeac7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:16.777356 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-198d5d78-8cad-4b26-8c2b-ac607738ec49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb9550d2d7fa4e868168410f89a53457'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:16.778754 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-198d5d78-8cad-4b26-8c2b-ac607738ec49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb9550d2d7fa4e868168410f89a53457'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:16.797385 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-198d5d78-8cad-4b26-8c2b-ac607738ec49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb9550d2d7fa4e868168410f89a53457'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:16.816731 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-198d5d78-8cad-4b26-8c2b-ac607738ec49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb9550d2d7fa4e868168410f89a53457'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:16.835841 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-198d5d78-8cad-4b26-8c2b-ac607738ec49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb9550d2d7fa4e868168410f89a53457'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:16.868219 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1166/2342] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:34:16 2022] DELETE /identity/v3/users/bb9550d2d7fa4e868168410f89a53457 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:34:16.872292 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae2ab60-1224-462c-bf28-10c7dbeeac7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:16.873743 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae2ab60-1224-462c-bf28-10c7dbeeac7f service cinder] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:16.876862 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d5d78-8cad-4b26-8c2b-ac607738ec49 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:16.883546 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-198d5d78-8cad-4b26-8c2b-ac607738ec49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:16.918487 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1177/2343] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:34:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:34:16.920449 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e76ec-7280-49ed-b04f-39e39efdfec7 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:16.921928 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e76ec-7280-49ed-b04f-39e39efdfec7 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:16.925860 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e76ec-7280-49ed-b04f-39e39efdfec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:16.975112 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-b70e76ec-7280-49ed-b04f-39e39efdfec7 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:34:16.975112 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-b70e76ec-7280-49ed-b04f-39e39efdfec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:17.094243 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d5d78-8cad-4b26-8c2b-ac607738ec49 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:17.121750 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0a14e-6e15-4bb1-b887-89b2e21e2a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:17.125497 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0a14e-6e15-4bb1-b887-89b2e21e2a43 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:17.125812 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0a14e-6e15-4bb1-b887-89b2e21e2a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:17.135804 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0a14e-6e15-4bb1-b887-89b2e21e2a43 admin admin] PATH_INFO: `/v3/projects/f2cc8158f70a4daa967243f70196b5fc/users/8d9dc15798084af1b70e015e8755943e/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:17.142498 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a0a14e-6e15-4bb1-b887-89b2e21e2a43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2cc8158f70a4daa967243f70196b5fc, user_id=8d9dc15798084af1b70e015e8755943e, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:17.147703 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a0a14e-6e15-4bb1-b887-89b2e21e2a43 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:17.184934 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1167/2344] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:34:16 2022] PUT /identity/v3/projects/f2cc8158f70a4daa967243f70196b5fc/users/8d9dc15798084af1b70e015e8755943e/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:34:17.192064 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0a14e-6e15-4bb1-b887-89b2e21e2a43 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:17.198880 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-f3a0a14e-6e15-4bb1-b887-89b2e21e2a43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:17.199529 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1178/2345] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:34:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:34:17.245981 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e76ec-7280-49ed-b04f-39e39efdfec7 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:17.248425 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-b70e76ec-7280-49ed-b04f-39e39efdfec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:17.451912 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e76ec-7280-49ed-b04f-39e39efdfec7 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:17.462869 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0a14e-6e15-4bb1-b887-89b2e21e2a43 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:17.496231 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed16b2-d178-4767-8051-6edbd3570e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:17.497425 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed16b2-d178-4767-8051-6edbd3570e05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:17.497652 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed16b2-d178-4767-8051-6edbd3570e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:17.497954 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed16b2-d178-4767-8051-6edbd3570e05 admin admin] PATH_INFO: `/v3/users/50143c0cddf04675af5b19a5c341bb27` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:17.499557 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ed16b2-d178-4767-8051-6edbd3570e05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50143c0cddf04675af5b19a5c341bb27)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:17.501557 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ed16b2-d178-4767-8051-6edbd3570e05 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:17.609033 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2961ed-6c42-4e77-a8c3-2064ad73ed11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:17.609781 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2961ed-6c42-4e77-a8c3-2064ad73ed11 service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:17.610102 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2961ed-6c42-4e77-a8c3-2064ad73ed11 service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:17.610384 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2961ed-6c42-4e77-a8c3-2064ad73ed11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:17.665448 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2961ed-6c42-4e77-a8c3-2064ad73ed11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:17.666969 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2961ed-6c42-4e77-a8c3-2064ad73ed11 service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:17.674516 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-e5ed16b2-d178-4767-8051-6edbd3570e05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50143c0cddf04675af5b19a5c341bb27'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:17.676776 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-e5ed16b2-d178-4767-8051-6edbd3570e05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50143c0cddf04675af5b19a5c341bb27'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:17.719827 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-e5ed16b2-d178-4767-8051-6edbd3570e05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50143c0cddf04675af5b19a5c341bb27'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:17.742802 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-e5ed16b2-d178-4767-8051-6edbd3570e05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50143c0cddf04675af5b19a5c341bb27'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:17.749763 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1179/2346] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:34:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:34:17.772431 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-e5ed16b2-d178-4767-8051-6edbd3570e05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50143c0cddf04675af5b19a5c341bb27'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:17.790657 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1168/2347] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:34:17 2022] DELETE /identity/v3/users/50143c0cddf04675af5b19a5c341bb27 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:34:17.794717 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746dd12d-f4a6-44d7-aba0-90aed12c1b3b None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:17.794893 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746dd12d-f4a6-44d7-aba0-90aed12c1b3b None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:17.795058 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746dd12d-f4a6-44d7-aba0-90aed12c1b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:17.879965 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-746dd12d-f4a6-44d7-aba0-90aed12c1b3b None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:34:17.882787 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-746dd12d-f4a6-44d7-aba0-90aed12c1b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:18.224820 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1180/2348] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:34:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:34:18.279928 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed16b2-d178-4767-8051-6edbd3570e05 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:18.282066 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-e5ed16b2-d178-4767-8051-6edbd3570e05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:18.523949 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed16b2-d178-4767-8051-6edbd3570e05 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:18.529206 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbfbae-9775-4ed7-947d-465224ebec14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:18.530421 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbfbae-9775-4ed7-947d-465224ebec14 service neutron] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:18.530749 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbfbae-9775-4ed7-947d-465224ebec14 service neutron] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:18.531039 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbfbae-9775-4ed7-947d-465224ebec14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:18.565881 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cbfbae-9775-4ed7-947d-465224ebec14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:18.576193 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cbfbae-9775-4ed7-947d-465224ebec14 service neutron] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:18.597028 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1169/2349] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:34:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:34:19.651329 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746dd12d-f4a6-44d7-aba0-90aed12c1b3b None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:19.653421 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-746dd12d-f4a6-44d7-aba0-90aed12c1b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:19.682384 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746dd12d-f4a6-44d7-aba0-90aed12c1b3b None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:19.698858 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c3990-c031-46f5-a886-b3a873dfa9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:19.699810 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c3990-c031-46f5-a886-b3a873dfa9f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:19.700107 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c3990-c031-46f5-a886-b3a873dfa9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:19.700352 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c3990-c031-46f5-a886-b3a873dfa9f2 admin admin] PATH_INFO: `/v3/projects/acd2bda038a04ea3bc634f70ba149bef` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:19.704729 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c3990-c031-46f5-a886-b3a873dfa9f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acd2bda038a04ea3bc634f70ba149bef)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:19.707100 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c3990-c031-46f5-a886-b3a873dfa9f2 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:19.874834 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-6d3c3990-c031-46f5-a886-b3a873dfa9f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acd2bda038a04ea3bc634f70ba149bef', 'request_id': 'req-6d3c3990-c031-46f5-a886-b3a873dfa9f2'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:19.912933 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-6d3c3990-c031-46f5-a886-b3a873dfa9f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acd2bda038a04ea3bc634f70ba149bef', 'request_id': 'req-6d3c3990-c031-46f5-a886-b3a873dfa9f2'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:19.936663 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-6d3c3990-c031-46f5-a886-b3a873dfa9f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acd2bda038a04ea3bc634f70ba149bef', 'request_id': 'req-6d3c3990-c031-46f5-a886-b3a873dfa9f2'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:19.981241 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-6d3c3990-c031-46f5-a886-b3a873dfa9f2 admin admin] The token cache is being invalidate because project acd2bda038a04ea3bc634f70ba149bef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:34:19.987628 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-6d3c3990-c031-46f5-a886-b3a873dfa9f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:19.990098 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-6d3c3990-c031-46f5-a886-b3a873dfa9f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:19.998675 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1181/2350] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:34:19 2022] DELETE /identity/v3/projects/acd2bda038a04ea3bc634f70ba149bef => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:34:20.002833 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbfbae-9775-4ed7-947d-465224ebec14 service neutron] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:20.019796 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbfbae-9775-4ed7-947d-465224ebec14 service neutron] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:20.108463 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a28e9a-7d3f-4d74-9868-e47a7f953dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:20.109617 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a28e9a-7d3f-4d74-9868-e47a7f953dd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:20.110056 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a28e9a-7d3f-4d74-9868-e47a7f953dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:20.110516 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a28e9a-7d3f-4d74-9868-e47a7f953dd3 admin admin] PATH_INFO: `/v3/users/f942d2ea86e44c2fabc0437aaeee81af` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:20.157097 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a28e9a-7d3f-4d74-9868-e47a7f953dd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f942d2ea86e44c2fabc0437aaeee81af)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:20.164083 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a28e9a-7d3f-4d74-9868-e47a7f953dd3 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:20.319234 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-d6a28e9a-7d3f-4d74-9868-e47a7f953dd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f942d2ea86e44c2fabc0437aaeee81af'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:20.324869 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-d6a28e9a-7d3f-4d74-9868-e47a7f953dd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f942d2ea86e44c2fabc0437aaeee81af'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:20.361377 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-d6a28e9a-7d3f-4d74-9868-e47a7f953dd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f942d2ea86e44c2fabc0437aaeee81af'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:20.388195 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-d6a28e9a-7d3f-4d74-9868-e47a7f953dd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f942d2ea86e44c2fabc0437aaeee81af'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:20.407068 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-d6a28e9a-7d3f-4d74-9868-e47a7f953dd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f942d2ea86e44c2fabc0437aaeee81af'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:20.430377 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1170/2351] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:34:20 2022] DELETE /identity/v3/users/f942d2ea86e44c2fabc0437aaeee81af => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:34:20.701661 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c3990-c031-46f5-a886-b3a873dfa9f2 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:20.703192 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-6d3c3990-c031-46f5-a886-b3a873dfa9f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:20.730808 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c3990-c031-46f5-a886-b3a873dfa9f2 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:20.898030 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb97a28-ca74-434e-b20a-555acb6a0d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:20.898947 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb97a28-ca74-434e-b20a-555acb6a0d2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:20.899228 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb97a28-ca74-434e-b20a-555acb6a0d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:20.899802 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb97a28-ca74-434e-b20a-555acb6a0d2e admin admin] PATH_INFO: `/v3/projects/4aa1580aa3bb4e399ac0c6a4a2a28465` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:20.901040 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb97a28-ca74-434e-b20a-555acb6a0d2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4aa1580aa3bb4e399ac0c6a4a2a28465)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:20.903743 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb97a28-ca74-434e-b20a-555acb6a0d2e admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:20.964848 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-1cb97a28-ca74-434e-b20a-555acb6a0d2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4aa1580aa3bb4e399ac0c6a4a2a28465', 'request_id': 'req-1cb97a28-ca74-434e-b20a-555acb6a0d2e'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:20.971366 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-1cb97a28-ca74-434e-b20a-555acb6a0d2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4aa1580aa3bb4e399ac0c6a4a2a28465', 'request_id': 'req-1cb97a28-ca74-434e-b20a-555acb6a0d2e'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:20.979189 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-1cb97a28-ca74-434e-b20a-555acb6a0d2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4aa1580aa3bb4e399ac0c6a4a2a28465', 'request_id': 'req-1cb97a28-ca74-434e-b20a-555acb6a0d2e'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:20.994138 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-1cb97a28-ca74-434e-b20a-555acb6a0d2e admin admin] The token cache is being invalidate because project 4aa1580aa3bb4e399ac0c6a4a2a28465 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:34:20.994437 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-1cb97a28-ca74-434e-b20a-555acb6a0d2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:20.995125 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-1cb97a28-ca74-434e-b20a-555acb6a0d2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:20.997200 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1182/2352] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:34:20 2022] DELETE /identity/v3/projects/4aa1580aa3bb4e399ac0c6a4a2a28465 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:34:21.001984 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fffb1-4ca6-4667-852f-7a913fce705d None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:21.002335 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fffb1-4ca6-4667-852f-7a913fce705d None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:21.002705 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fffb1-4ca6-4667-852f-7a913fce705d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:21.023706 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-e48fffb1-4ca6-4667-852f-7a913fce705d None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:34:21.025218 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-e48fffb1-4ca6-4667-852f-7a913fce705d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:21.125901 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1171/2353] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:34:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:34:21.127904 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc3179-4b07-43cf-bec6-a9765e068ae2 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:21.129217 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc3179-4b07-43cf-bec6-a9765e068ae2 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:21.130320 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc3179-4b07-43cf-bec6-a9765e068ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:21.161926 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-59bc3179-4b07-43cf-bec6-a9765e068ae2 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:34:21.163293 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-59bc3179-4b07-43cf-bec6-a9765e068ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:21.177669 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1183/2354] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:34:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:34:21.179478 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48fffb1-4ca6-4667-852f-7a913fce705d None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:21.195222 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48fffb1-4ca6-4667-852f-7a913fce705d None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:21.203166 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1bf07b-ff34-4cda-b66d-9a90bff44afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:21.204001 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1bf07b-ff34-4cda-b66d-9a90bff44afa admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:21.204395 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1bf07b-ff34-4cda-b66d-9a90bff44afa admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:21.204780 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1bf07b-ff34-4cda-b66d-9a90bff44afa admin admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:21.205622 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1bf07b-ff34-4cda-b66d-9a90bff44afa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:34:21.206173 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1bf07b-ff34-4cda-b66d-9a90bff44afa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:21.208592 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1bf07b-ff34-4cda-b66d-9a90bff44afa admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:21.227317 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1172/2355] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:34:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:34:21.232127 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc3179-4b07-43cf-bec6-a9765e068ae2 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:21.244194 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc3179-4b07-43cf-bec6-a9765e068ae2 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:21.259020 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b5fc43-5480-42f9-96e8-1a3a8087f77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:21.260269 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5fc43-5480-42f9-96e8-1a3a8087f77d admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:21.261207 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5fc43-5480-42f9-96e8-1a3a8087f77d admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:21.261577 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5fc43-5480-42f9-96e8-1a3a8087f77d admin admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:21.262967 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b5fc43-5480-42f9-96e8-1a3a8087f77d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:21.266174 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b5fc43-5480-42f9-96e8-1a3a8087f77d admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:21.320209 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1184/2356] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:34:21 2022] POST /identity/v3/projects => generated 375 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:34:21.325812 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1bf07b-ff34-4cda-b66d-9a90bff44afa admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:21.347346 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1bf07b-ff34-4cda-b66d-9a90bff44afa admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:21.471087 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52c880-8133-4856-bd34-a185aa47e2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:21.472556 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52c880-8133-4856-bd34-a185aa47e2e4 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:21.473127 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52c880-8133-4856-bd34-a185aa47e2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:21.473516 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52c880-8133-4856-bd34-a185aa47e2e4 admin admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:21.474377 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f52c880-8133-4856-bd34-a185aa47e2e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:21.478024 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f52c880-8133-4856-bd34-a185aa47e2e4 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:21.506724 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1173/2357] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:34:21 2022] POST /identity/v3/users => generated 288 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:34:21.508133 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b5fc43-5480-42f9-96e8-1a3a8087f77d admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:21.533375 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b5fc43-5480-42f9-96e8-1a3a8087f77d admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:21.539713 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58f59a-293c-4fd1-adc8-5fb1b051f607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:21.540399 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58f59a-293c-4fd1-adc8-5fb1b051f607 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:21.540673 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58f59a-293c-4fd1-adc8-5fb1b051f607 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:21.540949 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58f59a-293c-4fd1-adc8-5fb1b051f607 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:21.541683 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf58f59a-293c-4fd1-adc8-5fb1b051f607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:21.546520 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf58f59a-293c-4fd1-adc8-5fb1b051f607 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:21.611142 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1185/2358] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:34:21.611340 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52c880-8133-4856-bd34-a185aa47e2e4 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:21.629306 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52c880-8133-4856-bd34-a185aa47e2e4 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:21.647675 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb00c68-8de2-4c00-890b-243523937cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:21.649592 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb00c68-8de2-4c00-890b-243523937cfe admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:21.649926 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb00c68-8de2-4c00-890b-243523937cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:21.650155 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb00c68-8de2-4c00-890b-243523937cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:21.653168 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb00c68-8de2-4c00-890b-243523937cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:21.666482 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb00c68-8de2-4c00-890b-243523937cfe admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:21.721111 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1174/2359] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:34:21.725311 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58f59a-293c-4fd1-adc8-5fb1b051f607 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:21.756708 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58f59a-293c-4fd1-adc8-5fb1b051f607 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:21.772032 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95897d90-913b-406f-a5bb-f97b95b54ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:21.775728 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95897d90-913b-406f-a5bb-f97b95b54ef1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:21.776530 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95897d90-913b-406f-a5bb-f97b95b54ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:21.776986 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95897d90-913b-406f-a5bb-f97b95b54ef1 admin admin] PATH_INFO: `/v3/projects/5064c06558bb43eead0db5aa0ce93841/users/d8f75162c65b4e96a113adb0e1b2d11d/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:21.807607 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95897d90-913b-406f-a5bb-f97b95b54ef1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5064c06558bb43eead0db5aa0ce93841, user_id=d8f75162c65b4e96a113adb0e1b2d11d, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:21.812167 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95897d90-913b-406f-a5bb-f97b95b54ef1 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:21.847806 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1186/2360] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:34:21 2022] PUT /identity/v3/projects/5064c06558bb43eead0db5aa0ce93841/users/d8f75162c65b4e96a113adb0e1b2d11d/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:34:21.861064 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba2418-478b-46d4-bf38-a97397b5ade2 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:21.862576 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba2418-478b-46d4-bf38-a97397b5ade2 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:21.864156 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba2418-478b-46d4-bf38-a97397b5ade2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:21.929825 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-d9ba2418-478b-46d4-bf38-a97397b5ade2 None None] MFA Rules not processed for user `d8f75162c65b4e96a113adb0e1b2d11d`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:34:21.933186 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-d9ba2418-478b-46d4-bf38-a97397b5ade2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:22.049820 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1175/2361] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:34:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:34:22.065695 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95897d90-913b-406f-a5bb-f97b95b54ef1 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:22.070330 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-95897d90-913b-406f-a5bb-f97b95b54ef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:22.082156 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba2418-478b-46d4-bf38-a97397b5ade2 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:22.084397 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-d9ba2418-478b-46d4-bf38-a97397b5ade2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:22.207724 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95897d90-913b-406f-a5bb-f97b95b54ef1 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:22.240722 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f46421-8a2a-41f0-a77a-0dc6335c54de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:22.243519 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f46421-8a2a-41f0-a77a-0dc6335c54de admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:22.244580 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f46421-8a2a-41f0-a77a-0dc6335c54de admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:22.245733 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f46421-8a2a-41f0-a77a-0dc6335c54de admin admin] PATH_INFO: `/v3/projects/773c6aa55abd47b69f05ffb5454113a5` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:22.251261 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f46421-8a2a-41f0-a77a-0dc6335c54de admin admin] RBAC: Authorizing `identity:delete_project(project_id=773c6aa55abd47b69f05ffb5454113a5)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:22.257159 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f46421-8a2a-41f0-a77a-0dc6335c54de admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:22.310255 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba2418-478b-46d4-bf38-a97397b5ade2 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:22.336758 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c3014-fe03-4c48-baeb-4a69c9223a60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:22.338232 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c3014-fe03-4c48-baeb-4a69c9223a60 service cinder] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:22.338940 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c3014-fe03-4c48-baeb-4a69c9223a60 service cinder] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:22.339491 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c3014-fe03-4c48-baeb-4a69c9223a60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:22.400597 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-17f46421-8a2a-41f0-a77a-0dc6335c54de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '773c6aa55abd47b69f05ffb5454113a5', 'request_id': 'req-17f46421-8a2a-41f0-a77a-0dc6335c54de'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:22.415996 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651c3014-fe03-4c48-baeb-4a69c9223a60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:22.419741 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-17f46421-8a2a-41f0-a77a-0dc6335c54de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '773c6aa55abd47b69f05ffb5454113a5', 'request_id': 'req-17f46421-8a2a-41f0-a77a-0dc6335c54de'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:22.421441 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651c3014-fe03-4c48-baeb-4a69c9223a60 service cinder] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:22.443473 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-17f46421-8a2a-41f0-a77a-0dc6335c54de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '773c6aa55abd47b69f05ffb5454113a5', 'request_id': 'req-17f46421-8a2a-41f0-a77a-0dc6335c54de'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:22.462073 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1176/2362] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:34:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:34:22.467214 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-17f46421-8a2a-41f0-a77a-0dc6335c54de admin admin] The token cache is being invalidate because project 773c6aa55abd47b69f05ffb5454113a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:34:22.469136 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-17f46421-8a2a-41f0-a77a-0dc6335c54de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:22.470322 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-17f46421-8a2a-41f0-a77a-0dc6335c54de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:34:22.474013 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1187/2363] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:34:22 2022] DELETE /identity/v3/projects/773c6aa55abd47b69f05ffb5454113a5 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:34:22.484719 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b86dee-60aa-48b5-bd1e-21807e44e7ae None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:22.485278 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b86dee-60aa-48b5-bd1e-21807e44e7ae None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:22.497306 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b86dee-60aa-48b5-bd1e-21807e44e7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:22.532838 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-84b86dee-60aa-48b5-bd1e-21807e44e7ae None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:34:22.534079 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-84b86dee-60aa-48b5-bd1e-21807e44e7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:22.652368 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1177/2364] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:34:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:34:22.655068 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38f326-ae0f-43c4-9669-f81adbc5c6f2 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:22.655584 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38f326-ae0f-43c4-9669-f81adbc5c6f2 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:22.656275 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38f326-ae0f-43c4-9669-f81adbc5c6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:22.684792 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f805a-28b8-47a0-863c-0eb84de10d79 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:22.685253 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f805a-28b8-47a0-863c-0eb84de10d79 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:22.686012 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f805a-28b8-47a0-863c-0eb84de10d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:22.741892 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-1e38f326-ae0f-43c4-9669-f81adbc5c6f2 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:34:22.744954 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-1e38f326-ae0f-43c4-9669-f81adbc5c6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:22.748706 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-555f805a-28b8-47a0-863c-0eb84de10d79 None None] MFA Rules not processed for user `5b21c9002601480eaabdbcb74d337f2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:34:22.756937 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-555f805a-28b8-47a0-863c-0eb84de10d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:22.784594 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1188/2365] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:34:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:34:22.788325 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38f326-ae0f-43c4-9669-f81adbc5c6f2 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:22.820642 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38f326-ae0f-43c4-9669-f81adbc5c6f2 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:22.835099 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce85e7b2-5a96-4d83-9b00-1ec6f6f4a3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:22.835937 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85e7b2-5a96-4d83-9b00-1ec6f6f4a3fe admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:22.836450 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85e7b2-5a96-4d83-9b00-1ec6f6f4a3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:22.836787 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85e7b2-5a96-4d83-9b00-1ec6f6f4a3fe admin admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:22.837830 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce85e7b2-5a96-4d83-9b00-1ec6f6f4a3fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:34:22.838214 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce85e7b2-5a96-4d83-9b00-1ec6f6f4a3fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:22.845048 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce85e7b2-5a96-4d83-9b00-1ec6f6f4a3fe admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:22.881290 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1189/2366] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:34:22.883484 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce85e7b2-5a96-4d83-9b00-1ec6f6f4a3fe admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:22.913031 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce85e7b2-5a96-4d83-9b00-1ec6f6f4a3fe admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:22.943998 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ab4ea-ff5a-4f90-8639-ab05ff7540f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:22.944932 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1178/2367] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:34:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:34:22.945384 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ab4ea-ff5a-4f90-8639-ab05ff7540f3 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:22.946168 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ab4ea-ff5a-4f90-8639-ab05ff7540f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:22.946838 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ab4ea-ff5a-4f90-8639-ab05ff7540f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:22.948516 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ab4ea-ff5a-4f90-8639-ab05ff7540f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:22.955653 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ab4ea-ff5a-4f90-8639-ab05ff7540f3 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:23.030985 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1190/2368] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:34:22 2022] POST /identity/v3/projects => generated 363 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:34:23.034957 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f805a-28b8-47a0-863c-0eb84de10d79 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:23.061254 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f805a-28b8-47a0-863c-0eb84de10d79 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:23.266566 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68c30a-0fd8-4602-add7-a039ce1f1765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:23.267595 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68c30a-0fd8-4602-add7-a039ce1f1765 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:23.267868 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68c30a-0fd8-4602-add7-a039ce1f1765 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:23.268733 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68c30a-0fd8-4602-add7-a039ce1f1765 admin admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:23.268883 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db68c30a-0fd8-4602-add7-a039ce1f1765 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:23.271177 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db68c30a-0fd8-4602-add7-a039ce1f1765 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:23.306425 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1179/2369] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:34:23 2022] POST /identity/v3/users => generated 282 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:34:23.309591 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ab4ea-ff5a-4f90-8639-ab05ff7540f3 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:23.335489 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ab4ea-ff5a-4f90-8639-ab05ff7540f3 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:23.350250 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b8983-0c4f-4303-9e87-ab0e79182ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:23.351030 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b8983-0c4f-4303-9e87-ab0e79182ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:23.351315 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b8983-0c4f-4303-9e87-ab0e79182ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:23.351592 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b8983-0c4f-4303-9e87-ab0e79182ea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:23.352370 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18b8983-0c4f-4303-9e87-ab0e79182ea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:23.353988 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18b8983-0c4f-4303-9e87-ab0e79182ea0 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:23.380886 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1191/2370] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:34:23.385093 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68c30a-0fd8-4602-add7-a039ce1f1765 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:23.399471 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68c30a-0fd8-4602-add7-a039ce1f1765 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:23.409164 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1554a6-ad03-4f34-8801-353c9794bf05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:23.409841 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1554a6-ad03-4f34-8801-353c9794bf05 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:23.410123 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1554a6-ad03-4f34-8801-353c9794bf05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:23.415035 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1554a6-ad03-4f34-8801-353c9794bf05 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:23.415873 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1554a6-ad03-4f34-8801-353c9794bf05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:23.420620 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1554a6-ad03-4f34-8801-353c9794bf05 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:23.459432 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1180/2371] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:34:23.464746 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b8983-0c4f-4303-9e87-ab0e79182ea0 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:23.488423 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b8983-0c4f-4303-9e87-ab0e79182ea0 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:23.504120 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb118247-6afb-4ace-bc0a-56188ba83515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:23.505073 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb118247-6afb-4ace-bc0a-56188ba83515 admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:23.505407 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb118247-6afb-4ace-bc0a-56188ba83515 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:23.505849 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb118247-6afb-4ace-bc0a-56188ba83515 admin admin] PATH_INFO: `/v3/projects/4df253ddfb99459496dfd71ff4cd2bef/users/0e349e70903548f49259b629c42feb06/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:23.534308 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb118247-6afb-4ace-bc0a-56188ba83515 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4df253ddfb99459496dfd71ff4cd2bef, user_id=0e349e70903548f49259b629c42feb06, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:23.539832 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb118247-6afb-4ace-bc0a-56188ba83515 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:23.566786 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1192/2372] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:34:23 2022] PUT /identity/v3/projects/4df253ddfb99459496dfd71ff4cd2bef/users/0e349e70903548f49259b629c42feb06/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:34:23.591218 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc7b70-450e-40b0-b6b1-e24f042cb93d None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:23.591354 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc7b70-450e-40b0-b6b1-e24f042cb93d None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:23.591565 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc7b70-450e-40b0-b6b1-e24f042cb93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:23.686346 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-85fc7b70-450e-40b0-b6b1-e24f042cb93d None None] MFA Rules not processed for user `0e349e70903548f49259b629c42feb06`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:34:23.687666 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-85fc7b70-450e-40b0-b6b1-e24f042cb93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:23.879401 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1181/2373] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:34:23 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:34:23.913213 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb118247-6afb-4ace-bc0a-56188ba83515 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:23.917779 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-cb118247-6afb-4ace-bc0a-56188ba83515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:24.247831 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb118247-6afb-4ace-bc0a-56188ba83515 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:24.272039 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d352ed9a-deef-4889-a7b5-870421d39815 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:24.272632 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352ed9a-deef-4889-a7b5-870421d39815 service cinder] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:24.272918 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352ed9a-deef-4889-a7b5-870421d39815 service cinder] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:24.283970 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352ed9a-deef-4889-a7b5-870421d39815 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:24.327748 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d352ed9a-deef-4889-a7b5-870421d39815 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:24.338163 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d352ed9a-deef-4889-a7b5-870421d39815 service cinder] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:24.373460 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1193/2374] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:34:23 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:34:24.608929 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aac761-0de0-415f-bfbc-39af76b61bc9 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:24.609445 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aac761-0de0-415f-bfbc-39af76b61bc9 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:24.609661 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aac761-0de0-415f-bfbc-39af76b61bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:24.674837 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-c7aac761-0de0-415f-bfbc-39af76b61bc9 None None] MFA Rules not processed for user `d8f75162c65b4e96a113adb0e1b2d11d`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:34:24.677672 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-c7aac761-0de0-415f-bfbc-39af76b61bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:24.941126 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1182/2375] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:34:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:34:30.243228 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43c269-3dbc-44c4-a534-63f2f99c98b5 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:30.243740 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43c269-3dbc-44c4-a534-63f2f99c98b5 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:30.243825 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43c269-3dbc-44c4-a534-63f2f99c98b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:30.296288 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-7a43c269-3dbc-44c4-a534-63f2f99c98b5 None None] MFA Rules not processed for user `8d9dc15798084af1b70e015e8755943e`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:34:30.298272 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-7a43c269-3dbc-44c4-a534-63f2f99c98b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:30.412816 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1194/2376] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:34:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:34:30.427144 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aac761-0de0-415f-bfbc-39af76b61bc9 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:30.429525 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-c7aac761-0de0-415f-bfbc-39af76b61bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:30.534735 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aac761-0de0-415f-bfbc-39af76b61bc9 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:30.538799 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8245d79-1078-4d19-975e-5d8678c925bb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99b63b9b6e44219921569db1bf2e0dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:30.539454 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8245d79-1078-4d19-975e-5d8678c925bb service glance] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:30.539736 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8245d79-1078-4d19-975e-5d8678c925bb service glance] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:30.540012 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8245d79-1078-4d19-975e-5d8678c925bb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:30.542183 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-b8245d79-1078-4d19-975e-5d8678c925bb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:30.637937 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8245d79-1078-4d19-975e-5d8678c925bb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:30.640225 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8245d79-1078-4d19-975e-5d8678c925bb service glance] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:30.661847 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1183/2377] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:34:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:34:30.851925 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a1519-d1a4-48f3-8400-8248dcb5b49d None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:30.852312 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a1519-d1a4-48f3-8400-8248dcb5b49d None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:30.852686 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a1519-d1a4-48f3-8400-8248dcb5b49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:30.879421 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-ee8a1519-d1a4-48f3-8400-8248dcb5b49d None None] MFA Rules not processed for user `1c1284bfe6cc43848731ed2b3d9e914b`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:34:30.881104 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-ee8a1519-d1a4-48f3-8400-8248dcb5b49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:30.993700 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1195/2378] 10.222.0.21 () {58 vars in 1009 bytes} [Mon Feb 28 10:34:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:34:31.007726 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8245d79-1078-4d19-975e-5d8678c925bb service glance] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:31.009231 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-b8245d79-1078-4d19-975e-5d8678c925bb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:31.117808 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8245d79-1078-4d19-975e-5d8678c925bb service glance] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:31.125039 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67e1f7-1e1d-41a5-8d22-462c3d47c018 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8696fe8a37aa4d73a62bdc2efd35a23d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:31.126021 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67e1f7-1e1d-41a5-8d22-462c3d47c018 service swift] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:31.126382 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67e1f7-1e1d-41a5-8d22-462c3d47c018 service swift] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:31.127078 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67e1f7-1e1d-41a5-8d22-462c3d47c018 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:31.140978 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa67e1f7-1e1d-41a5-8d22-462c3d47c018 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:31.142698 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa67e1f7-1e1d-41a5-8d22-462c3d47c018 service swift] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:31.153650 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1184/2379] 10.222.0.21 () {60 vars in 1384 bytes} [Mon Feb 28 10:34:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 10:34:34.230117 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0057af-a2c5-4c3c-b4a2-83d0d265f5f1 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:34.231369 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0057af-a2c5-4c3c-b4a2-83d0d265f5f1 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:34.231747 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0057af-a2c5-4c3c-b4a2-83d0d265f5f1 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:34.233597 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1196/2380] 10.222.0.21 () {54 vars in 921 bytes} [Mon Feb 28 10:34:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:34:34.242226 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ccda1f-9712-4897-8790-4ae518d1cea8 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:34.243804 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ccda1f-9712-4897-8790-4ae518d1cea8 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:34.244085 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ccda1f-9712-4897-8790-4ae518d1cea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:34.365827 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-08ccda1f-9712-4897-8790-4ae518d1cea8 None None] MFA Rules not processed for user `ec202a34db8e47f4a6c18285245e3f5b`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:34:34.367585 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-08ccda1f-9712-4897-8790-4ae518d1cea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:34.559514 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1185/2381] 10.222.0.21 () {58 vars in 1018 bytes} [Mon Feb 28 10:34:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:34:35.923300 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0057af-a2c5-4c3c-b4a2-83d0d265f5f1 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:35.925780 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-ff0057af-a2c5-4c3c-b4a2-83d0d265f5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:35.942853 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0057af-a2c5-4c3c-b4a2-83d0d265f5f1 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:35.946678 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b5738-1f8e-4b7f-9e63-4ce11ce4dc85 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99b63b9b6e44219921569db1bf2e0dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:35.947377 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b5738-1f8e-4b7f-9e63-4ce11ce4dc85 service glance] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:35.947605 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b5738-1f8e-4b7f-9e63-4ce11ce4dc85 service glance] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:35.947880 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b5738-1f8e-4b7f-9e63-4ce11ce4dc85 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:35.966926 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b5738-1f8e-4b7f-9e63-4ce11ce4dc85 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:35.968656 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b5738-1f8e-4b7f-9e63-4ce11ce4dc85 service glance] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:35.983733 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1197/2382] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:34:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:34:36.078747 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c58e86-fab7-453a-9b59-33181136d8b9 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:36.079400 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c58e86-fab7-453a-9b59-33181136d8b9 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:36.079400 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c58e86-fab7-453a-9b59-33181136d8b9 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:36.081201 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1186/2383] 10.222.0.21 () {54 vars in 921 bytes} [Mon Feb 28 10:34:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:34:36.087017 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18e364-0a40-40af-9bf9-6e31dfc87846 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:36.087399 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18e364-0a40-40af-9bf9-6e31dfc87846 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:36.087801 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18e364-0a40-40af-9bf9-6e31dfc87846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:36.109328 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-9b18e364-0a40-40af-9bf9-6e31dfc87846 None None] MFA Rules not processed for user `abaa12b94c834676bb17bf997dace5d1`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:34:36.110573 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-9b18e364-0a40-40af-9bf9-6e31dfc87846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:36.171849 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1198/2384] 10.222.0.21 () {58 vars in 1018 bytes} [Mon Feb 28 10:34:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:34:36.184845 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c58e86-fab7-453a-9b59-33181136d8b9 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:36.186726 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-10c58e86-fab7-453a-9b59-33181136d8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:36.203105 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c58e86-fab7-453a-9b59-33181136d8b9 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:36.206865 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a50cc09-dd25-4950-b4c8-cea75e170109 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:36.207598 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50cc09-dd25-4950-b4c8-cea75e170109 service neutron] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:36.207944 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50cc09-dd25-4950-b4c8-cea75e170109 service neutron] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:36.208452 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50cc09-dd25-4950-b4c8-cea75e170109 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:36.217640 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a50cc09-dd25-4950-b4c8-cea75e170109 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:36.219252 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a50cc09-dd25-4950-b4c8-cea75e170109 service neutron] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:36.234883 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1187/2385] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:34:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:34:36.350002 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1953ead-d1cc-4215-a308-927ae2f14ddb None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:36.350290 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1953ead-d1cc-4215-a308-927ae2f14ddb None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:36.350565 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1953ead-d1cc-4215-a308-927ae2f14ddb None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:36.352384 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1199/2386] 10.222.0.21 () {54 vars in 921 bytes} [Mon Feb 28 10:34:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:34:36.359547 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9057c-96cc-44c2-ac1c-d7c69e20d856 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:36.360072 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9057c-96cc-44c2-ac1c-d7c69e20d856 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:36.360509 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9057c-96cc-44c2-ac1c-d7c69e20d856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:36.380699 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-00b9057c-96cc-44c2-ac1c-d7c69e20d856 None None] MFA Rules not processed for user `ec202a34db8e47f4a6c18285245e3f5b`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:34:36.382413 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-00b9057c-96cc-44c2-ac1c-d7c69e20d856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:36.392695 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1188/2387] 10.222.0.21 () {58 vars in 1018 bytes} [Mon Feb 28 10:34:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:34:36.406123 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1953ead-d1cc-4215-a308-927ae2f14ddb None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:36.419940 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1953ead-d1cc-4215-a308-927ae2f14ddb None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:36.424089 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab140b0a-308c-4ebe-960a-f457a73f7bd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:36.424732 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab140b0a-308c-4ebe-960a-f457a73f7bd1 service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:36.425030 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab140b0a-308c-4ebe-960a-f457a73f7bd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:36.425286 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab140b0a-308c-4ebe-960a-f457a73f7bd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:36.437048 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab140b0a-308c-4ebe-960a-f457a73f7bd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:36.438479 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab140b0a-308c-4ebe-960a-f457a73f7bd1 service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:36.451355 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1200/2388] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:34:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:34:39.196296 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b9057c-96cc-44c2-ac1c-d7c69e20d856 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:39.197917 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-00b9057c-96cc-44c2-ac1c-d7c69e20d856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:39.342943 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b9057c-96cc-44c2-ac1c-d7c69e20d856 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:39.351658 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df01bf-6f17-462a-8d9d-47cf105c9579 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b2346e4de5d45a79d4bb2abb01d4827', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:39.352679 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df01bf-6f17-462a-8d9d-47cf105c9579 service placement] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:39.353341 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df01bf-6f17-462a-8d9d-47cf105c9579 service placement] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:39.353944 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df01bf-6f17-462a-8d9d-47cf105c9579 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:39.357125 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-09df01bf-6f17-462a-8d9d-47cf105c9579 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:39.382329 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09df01bf-6f17-462a-8d9d-47cf105c9579 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:39.383777 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09df01bf-6f17-462a-8d9d-47cf105c9579 service placement] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:39.397333 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1189/2389] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:34:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:34:41.950426 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55374ac0-7dda-4caa-bd72-bf49e4ce7587 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:41.951486 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55374ac0-7dda-4caa-bd72-bf49e4ce7587 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:41.951993 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55374ac0-7dda-4caa-bd72-bf49e4ce7587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:41.979629 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-55374ac0-7dda-4caa-bd72-bf49e4ce7587 None None] MFA Rules not processed for user `1c1284bfe6cc43848731ed2b3d9e914b`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:34:41.983847 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-55374ac0-7dda-4caa-bd72-bf49e4ce7587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:41.998225 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1201/2390] 10.222.0.21 () {58 vars in 1009 bytes} [Mon Feb 28 10:34:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:34:42.024971 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df01bf-6f17-462a-8d9d-47cf105c9579 service placement] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:42.040493 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df01bf-6f17-462a-8d9d-47cf105c9579 service placement] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:42.046430 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1eadbf-6f26-42e5-b670-7c6e1e8b2746 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8696fe8a37aa4d73a62bdc2efd35a23d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:42.048813 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1eadbf-6f26-42e5-b670-7c6e1e8b2746 service swift] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:42.049090 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1eadbf-6f26-42e5-b670-7c6e1e8b2746 service swift] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:42.049587 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1eadbf-6f26-42e5-b670-7c6e1e8b2746 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:42.059503 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1eadbf-6f26-42e5-b670-7c6e1e8b2746 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:42.061550 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1eadbf-6f26-42e5-b670-7c6e1e8b2746 service swift] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:42.074347 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1190/2391] 10.222.0.21 () {60 vars in 1384 bytes} [Mon Feb 28 10:34:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 10:34:44.629889 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0015622-d3ad-4d64-9930-9bf84657918f None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:44.630509 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0015622-d3ad-4d64-9930-9bf84657918f None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:44.630509 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0015622-d3ad-4d64-9930-9bf84657918f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:44.674516 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-c0015622-d3ad-4d64-9930-9bf84657918f None None] MFA Rules not processed for user `e840e28ad3194d7ea995ea2d2b57843e`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:34:44.675292 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-c0015622-d3ad-4d64-9930-9bf84657918f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:44.703587 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1202/2392] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:34:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:34:53.820849 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0a7f0-055e-401a-bd20-f6b8840838e3 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:53.821405 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0a7f0-055e-401a-bd20-f6b8840838e3 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:53.821405 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0a7f0-055e-401a-bd20-f6b8840838e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:53.925814 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-d2f0a7f0-055e-401a-bd20-f6b8840838e3 None None] MFA Rules not processed for user `1c1284bfe6cc43848731ed2b3d9e914b`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:34:53.927447 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-d2f0a7f0-055e-401a-bd20-f6b8840838e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:34:53.961502 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1191/2393] 10.222.0.21 () {58 vars in 1009 bytes} [Mon Feb 28 10:34:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:34:53.963445 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0015622-d3ad-4d64-9930-9bf84657918f None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:34:53.992647 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0015622-d3ad-4d64-9930-9bf84657918f None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:34:53.999948 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5505ebb-7930-4152-aba6-e58ec9a73354 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8696fe8a37aa4d73a62bdc2efd35a23d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:34:54.001170 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5505ebb-7930-4152-aba6-e58ec9a73354 service swift] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:34:54.001760 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5505ebb-7930-4152-aba6-e58ec9a73354 service swift] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:34:54.016174 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5505ebb-7930-4152-aba6-e58ec9a73354 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:34:54.037962 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5505ebb-7930-4152-aba6-e58ec9a73354 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:34:54.042765 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5505ebb-7930-4152-aba6-e58ec9a73354 service swift] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:34:54.087839 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1203/2394] 10.222.0.21 () {60 vars in 1384 bytes} [Mon Feb 28 10:34:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 10:35:06.591969 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f0a7f0-055e-401a-bd20-f6b8840838e3 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:06.664069 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f0a7f0-055e-401a-bd20-f6b8840838e3 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:06.670099 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127c61f-763b-48cd-a5f6-016741474ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:06.671000 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127c61f-763b-48cd-a5f6-016741474ccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:06.671402 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127c61f-763b-48cd-a5f6-016741474ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:06.671682 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127c61f-763b-48cd-a5f6-016741474ccd admin admin] PATH_INFO: `/v3/users/0e349e70903548f49259b629c42feb06` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:06.672884 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7127c61f-763b-48cd-a5f6-016741474ccd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e349e70903548f49259b629c42feb06)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:06.675000 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7127c61f-763b-48cd-a5f6-016741474ccd admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:06.726709 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-7127c61f-763b-48cd-a5f6-016741474ccd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e349e70903548f49259b629c42feb06'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:06.727362 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-7127c61f-763b-48cd-a5f6-016741474ccd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e349e70903548f49259b629c42feb06'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:06.739944 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-7127c61f-763b-48cd-a5f6-016741474ccd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e349e70903548f49259b629c42feb06'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:06.747832 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-7127c61f-763b-48cd-a5f6-016741474ccd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e349e70903548f49259b629c42feb06'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:06.754863 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-7127c61f-763b-48cd-a5f6-016741474ccd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e349e70903548f49259b629c42feb06'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:06.760757 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1192/2395] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:35:06 2022] DELETE /identity/v3/users/0e349e70903548f49259b629c42feb06 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:35:06.765881 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe76ea-7088-43ae-92fe-9d959c2aa7e0 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:06.766412 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe76ea-7088-43ae-92fe-9d959c2aa7e0 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:06.766412 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe76ea-7088-43ae-92fe-9d959c2aa7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:06.786702 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-3cfe76ea-7088-43ae-92fe-9d959c2aa7e0 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:35:06.788125 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-3cfe76ea-7088-43ae-92fe-9d959c2aa7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:06.803835 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b98ca-86d7-428a-8cf1-cdcae1e615b0 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:06.804123 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b98ca-86d7-428a-8cf1-cdcae1e615b0 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:06.804469 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b98ca-86d7-428a-8cf1-cdcae1e615b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:06.822723 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-c18b98ca-86d7-428a-8cf1-cdcae1e615b0 None None] MFA Rules not processed for user `1c1284bfe6cc43848731ed2b3d9e914b`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:35:06.824223 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-c18b98ca-86d7-428a-8cf1-cdcae1e615b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:06.859564 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1204/2396] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:35:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:35:06.869552 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe76ea-7088-43ae-92fe-9d959c2aa7e0 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:06.870935 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-3cfe76ea-7088-43ae-92fe-9d959c2aa7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:06.899013 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1193/2397] 10.222.0.21 () {58 vars in 1009 bytes} [Mon Feb 28 10:35:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:35:06.922189 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b98ca-86d7-428a-8cf1-cdcae1e615b0 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:06.923937 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-c18b98ca-86d7-428a-8cf1-cdcae1e615b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:06.942660 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe76ea-7088-43ae-92fe-9d959c2aa7e0 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:06.947888 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b38277-e41c-4847-b20b-6c85a46fa3b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:06.948803 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b38277-e41c-4847-b20b-6c85a46fa3b1 service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:06.949471 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b38277-e41c-4847-b20b-6c85a46fa3b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:06.950080 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b38277-e41c-4847-b20b-6c85a46fa3b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:06.962064 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b38277-e41c-4847-b20b-6c85a46fa3b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:06.963729 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b38277-e41c-4847-b20b-6c85a46fa3b1 service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:06.976715 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1205/2398] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:35:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:35:07.019244 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b98ca-86d7-428a-8cf1-cdcae1e615b0 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:07.025798 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af19ca4-e0a0-4a9c-8c2c-305241059ccb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8696fe8a37aa4d73a62bdc2efd35a23d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:07.026557 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af19ca4-e0a0-4a9c-8c2c-305241059ccb service swift] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:07.026991 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af19ca4-e0a0-4a9c-8c2c-305241059ccb service swift] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:07.027355 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af19ca4-e0a0-4a9c-8c2c-305241059ccb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:07.037013 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af19ca4-e0a0-4a9c-8c2c-305241059ccb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:07.038846 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af19ca4-e0a0-4a9c-8c2c-305241059ccb service swift] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:07.049551 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1194/2399] 10.222.0.21 () {60 vars in 1384 bytes} [Mon Feb 28 10:35:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 28 10:35:07.321079 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b38277-e41c-4847-b20b-6c85a46fa3b1 service neutron] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:07.322567 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-b2b38277-e41c-4847-b20b-6c85a46fa3b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:07.342266 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b38277-e41c-4847-b20b-6c85a46fa3b1 service neutron] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:07.349179 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea64b1-6f77-4aba-b31b-dbc0f7bbd470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:07.350282 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea64b1-6f77-4aba-b31b-dbc0f7bbd470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:07.350907 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea64b1-6f77-4aba-b31b-dbc0f7bbd470 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:07.351359 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea64b1-6f77-4aba-b31b-dbc0f7bbd470 admin admin] PATH_INFO: `/v3/projects/4df253ddfb99459496dfd71ff4cd2bef` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:07.352995 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea64b1-6f77-4aba-b31b-dbc0f7bbd470 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4df253ddfb99459496dfd71ff4cd2bef)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:07.355200 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea64b1-6f77-4aba-b31b-dbc0f7bbd470 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:07.452621 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-82ea64b1-6f77-4aba-b31b-dbc0f7bbd470 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4df253ddfb99459496dfd71ff4cd2bef', 'request_id': 'req-82ea64b1-6f77-4aba-b31b-dbc0f7bbd470'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:07.458965 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-82ea64b1-6f77-4aba-b31b-dbc0f7bbd470 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4df253ddfb99459496dfd71ff4cd2bef', 'request_id': 'req-82ea64b1-6f77-4aba-b31b-dbc0f7bbd470'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:07.467680 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-82ea64b1-6f77-4aba-b31b-dbc0f7bbd470 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4df253ddfb99459496dfd71ff4cd2bef', 'request_id': 'req-82ea64b1-6f77-4aba-b31b-dbc0f7bbd470'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:07.495574 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-82ea64b1-6f77-4aba-b31b-dbc0f7bbd470 admin admin] The token cache is being invalidate because project 4df253ddfb99459496dfd71ff4cd2bef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:35:07.495912 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-82ea64b1-6f77-4aba-b31b-dbc0f7bbd470 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:07.496923 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-82ea64b1-6f77-4aba-b31b-dbc0f7bbd470 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:07.498555 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1206/2400] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:35:07 2022] DELETE /identity/v3/projects/4df253ddfb99459496dfd71ff4cd2bef => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:35:07.635380 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ffd47-f4db-47b3-9c43-2b4268eaf8df None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:07.635949 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ffd47-f4db-47b3-9c43-2b4268eaf8df None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:07.636305 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ffd47-f4db-47b3-9c43-2b4268eaf8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:07.657375 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-8c4ffd47-f4db-47b3-9c43-2b4268eaf8df None None] MFA Rules not processed for user `1c1284bfe6cc43848731ed2b3d9e914b`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:35:07.658803 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-8c4ffd47-f4db-47b3-9c43-2b4268eaf8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:07.728892 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1195/2401] 10.222.0.21 () {58 vars in 967 bytes} [Mon Feb 28 10:35:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:35:07.743203 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea64b1-6f77-4aba-b31b-dbc0f7bbd470 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:07.744723 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-82ea64b1-6f77-4aba-b31b-dbc0f7bbd470 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:07.822438 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea64b1-6f77-4aba-b31b-dbc0f7bbd470 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:07.828618 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad3e6e-7bc6-460f-87a8-0767a8f8cee3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8696fe8a37aa4d73a62bdc2efd35a23d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:07.829494 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad3e6e-7bc6-460f-87a8-0767a8f8cee3 service swift] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:07.830137 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad3e6e-7bc6-460f-87a8-0767a8f8cee3 service swift] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:07.830578 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad3e6e-7bc6-460f-87a8-0767a8f8cee3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:07.841349 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad3e6e-7bc6-460f-87a8-0767a8f8cee3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:07.843812 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad3e6e-7bc6-460f-87a8-0767a8f8cee3 service swift] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:07.862059 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1207/2402] 10.222.0.21 () {60 vars in 1384 bytes} [Mon Feb 28 10:35:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 10:35:08.078933 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd0a4d-5321-46bd-8e34-3ac72119205f None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:08.079220 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd0a4d-5321-46bd-8e34-3ac72119205f None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:08.079491 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd0a4d-5321-46bd-8e34-3ac72119205f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:08.099287 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-adbd0a4d-5321-46bd-8e34-3ac72119205f None None] MFA Rules not processed for user `1c1284bfe6cc43848731ed2b3d9e914b`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:35:08.100477 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-adbd0a4d-5321-46bd-8e34-3ac72119205f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:08.109479 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1196/2403] 10.222.0.21 () {58 vars in 1009 bytes} [Mon Feb 28 10:35:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:35:08.121642 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad3e6e-7bc6-460f-87a8-0767a8f8cee3 service swift] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:08.131982 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad3e6e-7bc6-460f-87a8-0767a8f8cee3 service swift] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:08.138030 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2714563-89c3-48d2-8bfd-12b50f145e71 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8696fe8a37aa4d73a62bdc2efd35a23d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:08.139128 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2714563-89c3-48d2-8bfd-12b50f145e71 service swift] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:08.139128 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2714563-89c3-48d2-8bfd-12b50f145e71 service swift] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:08.139394 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2714563-89c3-48d2-8bfd-12b50f145e71 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:08.147895 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2714563-89c3-48d2-8bfd-12b50f145e71 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:08.149429 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2714563-89c3-48d2-8bfd-12b50f145e71 service swift] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:08.158190 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1208/2404] 10.222.0.21 () {60 vars in 1384 bytes} [Mon Feb 28 10:35:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 10:35:08.483721 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9546f-cdbb-4151-84e1-d01e76dc0a6d None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:08.484007 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9546f-cdbb-4151-84e1-d01e76dc0a6d None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:08.484285 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9546f-cdbb-4151-84e1-d01e76dc0a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:08.503526 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-bad9546f-cdbb-4151-84e1-d01e76dc0a6d None None] MFA Rules not processed for user `1c1284bfe6cc43848731ed2b3d9e914b`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:35:08.504725 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-bad9546f-cdbb-4151-84e1-d01e76dc0a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:08.516261 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1197/2405] 10.222.0.21 () {58 vars in 967 bytes} [Mon Feb 28 10:35:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:35:08.530408 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2714563-89c3-48d2-8bfd-12b50f145e71 service swift] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:08.541505 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2714563-89c3-48d2-8bfd-12b50f145e71 service swift] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:08.552141 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b2bfe-0d3e-44eb-9e18-39bd306b37bb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8696fe8a37aa4d73a62bdc2efd35a23d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:08.552965 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b2bfe-0d3e-44eb-9e18-39bd306b37bb service swift] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:08.553246 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b2bfe-0d3e-44eb-9e18-39bd306b37bb service swift] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:08.553705 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b2bfe-0d3e-44eb-9e18-39bd306b37bb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:08.563505 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990b2bfe-0d3e-44eb-9e18-39bd306b37bb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:08.565082 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990b2bfe-0d3e-44eb-9e18-39bd306b37bb service swift] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:08.574234 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1209/2406] 10.222.0.21 () {60 vars in 1384 bytes} [Mon Feb 28 10:35:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 10:35:10.785939 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9546f-cdbb-4151-84e1-d01e76dc0a6d None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:10.787329 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-bad9546f-cdbb-4151-84e1-d01e76dc0a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:10.856559 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9546f-cdbb-4151-84e1-d01e76dc0a6d None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:10.862230 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab28ef6-4a96-4937-bac5-1ae853136eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:10.863120 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab28ef6-4a96-4937-bac5-1ae853136eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:10.863396 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab28ef6-4a96-4937-bac5-1ae853136eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:10.863667 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab28ef6-4a96-4937-bac5-1ae853136eb8 admin admin] PATH_INFO: `/v3/users/d8f75162c65b4e96a113adb0e1b2d11d` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:10.864857 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab28ef6-4a96-4937-bac5-1ae853136eb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8f75162c65b4e96a113adb0e1b2d11d)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:10.867064 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab28ef6-4a96-4937-bac5-1ae853136eb8 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:10.922066 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-5ab28ef6-4a96-4937-bac5-1ae853136eb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8f75162c65b4e96a113adb0e1b2d11d'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:10.923136 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-5ab28ef6-4a96-4937-bac5-1ae853136eb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8f75162c65b4e96a113adb0e1b2d11d'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:10.936113 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-5ab28ef6-4a96-4937-bac5-1ae853136eb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8f75162c65b4e96a113adb0e1b2d11d'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:10.945069 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-5ab28ef6-4a96-4937-bac5-1ae853136eb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8f75162c65b4e96a113adb0e1b2d11d'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:10.953311 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-5ab28ef6-4a96-4937-bac5-1ae853136eb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8f75162c65b4e96a113adb0e1b2d11d'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:10.959423 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1198/2407] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:35:10 2022] DELETE /identity/v3/users/d8f75162c65b4e96a113adb0e1b2d11d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:35:10.963793 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f97588-1e94-4618-9a75-10daf13f2a6b None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:10.964529 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f97588-1e94-4618-9a75-10daf13f2a6b None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:10.964789 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f97588-1e94-4618-9a75-10daf13f2a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:10.984265 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-d2f97588-1e94-4618-9a75-10daf13f2a6b None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:35:10.985651 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-d2f97588-1e94-4618-9a75-10daf13f2a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:11.046520 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1210/2408] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:35:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:35:11.055890 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab28ef6-4a96-4937-bac5-1ae853136eb8 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:11.057370 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-5ab28ef6-4a96-4937-bac5-1ae853136eb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:11.085762 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546cbfff-91b5-4137-b238-b0e2ab710be0 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:11.086050 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546cbfff-91b5-4137-b238-b0e2ab710be0 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:11.086322 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546cbfff-91b5-4137-b238-b0e2ab710be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:11.103971 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-546cbfff-91b5-4137-b238-b0e2ab710be0 None None] MFA Rules not processed for user `1c1284bfe6cc43848731ed2b3d9e914b`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:35:11.105175 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-546cbfff-91b5-4137-b238-b0e2ab710be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:11.116062 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab28ef6-4a96-4937-bac5-1ae853136eb8 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:11.120024 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d6366-b9ff-4ccb-8af7-41edfee21878 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:11.120663 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d6366-b9ff-4ccb-8af7-41edfee21878 service neutron] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:11.120948 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d6366-b9ff-4ccb-8af7-41edfee21878 service neutron] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:11.121641 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d6366-b9ff-4ccb-8af7-41edfee21878 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:11.139167 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724d6366-b9ff-4ccb-8af7-41edfee21878 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:11.140756 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724d6366-b9ff-4ccb-8af7-41edfee21878 service neutron] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:11.151101 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1199/2409] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:35:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:35:11.166164 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1211/2410] 10.222.0.21 () {58 vars in 967 bytes} [Mon Feb 28 10:35:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:35:11.179367 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d6366-b9ff-4ccb-8af7-41edfee21878 service neutron] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:11.180740 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-724d6366-b9ff-4ccb-8af7-41edfee21878 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:11.250136 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d6366-b9ff-4ccb-8af7-41edfee21878 service neutron] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:11.255439 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ee29a-ae18-4c9d-ac62-47015225f2e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8696fe8a37aa4d73a62bdc2efd35a23d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:11.256102 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ee29a-ae18-4c9d-ac62-47015225f2e8 service swift] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:11.256387 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ee29a-ae18-4c9d-ac62-47015225f2e8 service swift] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:11.256662 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ee29a-ae18-4c9d-ac62-47015225f2e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:11.266093 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6ee29a-ae18-4c9d-ac62-47015225f2e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:11.267751 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6ee29a-ae18-4c9d-ac62-47015225f2e8 service swift] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:11.276635 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1200/2411] 10.222.0.21 () {60 vars in 1384 bytes} [Mon Feb 28 10:35:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 10:35:11.657363 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546cbfff-91b5-4137-b238-b0e2ab710be0 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:11.659236 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-546cbfff-91b5-4137-b238-b0e2ab710be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:11.675513 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546cbfff-91b5-4137-b238-b0e2ab710be0 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:11.681887 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7880c335-12ce-405c-a4fe-ebc09aec8d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:11.683609 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880c335-12ce-405c-a4fe-ebc09aec8d62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:11.684321 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880c335-12ce-405c-a4fe-ebc09aec8d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:11.684780 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880c335-12ce-405c-a4fe-ebc09aec8d62 admin admin] PATH_INFO: `/v3/projects/5064c06558bb43eead0db5aa0ce93841` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:11.687478 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7880c335-12ce-405c-a4fe-ebc09aec8d62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5064c06558bb43eead0db5aa0ce93841)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:11.690074 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7880c335-12ce-405c-a4fe-ebc09aec8d62 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:11.752805 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-7880c335-12ce-405c-a4fe-ebc09aec8d62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5064c06558bb43eead0db5aa0ce93841', 'request_id': 'req-7880c335-12ce-405c-a4fe-ebc09aec8d62'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:11.758163 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-7880c335-12ce-405c-a4fe-ebc09aec8d62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5064c06558bb43eead0db5aa0ce93841', 'request_id': 'req-7880c335-12ce-405c-a4fe-ebc09aec8d62'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:11.764537 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-7880c335-12ce-405c-a4fe-ebc09aec8d62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5064c06558bb43eead0db5aa0ce93841', 'request_id': 'req-7880c335-12ce-405c-a4fe-ebc09aec8d62'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:11.776844 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-7880c335-12ce-405c-a4fe-ebc09aec8d62 admin admin] The token cache is being invalidate because project 5064c06558bb43eead0db5aa0ce93841 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:35:11.777125 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-7880c335-12ce-405c-a4fe-ebc09aec8d62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:11.778268 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-7880c335-12ce-405c-a4fe-ebc09aec8d62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:11.779843 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1212/2412] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:35:11 2022] DELETE /identity/v3/projects/5064c06558bb43eead0db5aa0ce93841 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:35:17.937900 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ee29a-ae18-4c9d-ac62-47015225f2e8 service swift] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:17.947094 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ee29a-ae18-4c9d-ac62-47015225f2e8 service swift] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:17.995080 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7da6b7-f7a0-4936-8508-00bc37d64869 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:17.995636 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7da6b7-f7a0-4936-8508-00bc37d64869 service neutron] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:17.995920 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7da6b7-f7a0-4936-8508-00bc37d64869 service neutron] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:17.996803 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7da6b7-f7a0-4936-8508-00bc37d64869 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:17.998763 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-7f7da6b7-f7a0-4936-8508-00bc37d64869 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:18.058209 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7da6b7-f7a0-4936-8508-00bc37d64869 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:18.060537 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7da6b7-f7a0-4936-8508-00bc37d64869 service neutron] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:18.070266 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1201/2413] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:35:17 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:35:20.344671 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7880c335-12ce-405c-a4fe-ebc09aec8d62 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:20.347750 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-7880c335-12ce-405c-a4fe-ebc09aec8d62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:20.431854 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7880c335-12ce-405c-a4fe-ebc09aec8d62 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:20.437568 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd0881-cc74-4dce-bd0e-d5ab8160043c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:20.438437 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd0881-cc74-4dce-bd0e-d5ab8160043c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:20.438837 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd0881-cc74-4dce-bd0e-d5ab8160043c admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:20.439120 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd0881-cc74-4dce-bd0e-d5ab8160043c admin admin] PATH_INFO: `/v3/users/28641197fb9b472dbe0aecd4dac3f4f3` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:20.440341 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd0881-cc74-4dce-bd0e-d5ab8160043c admin admin] RBAC: Authorizing `identity:delete_user(user_id=28641197fb9b472dbe0aecd4dac3f4f3)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:20.442291 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd0881-cc74-4dce-bd0e-d5ab8160043c admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:20.521562 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-9fcd0881-cc74-4dce-bd0e-d5ab8160043c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28641197fb9b472dbe0aecd4dac3f4f3'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:20.531248 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-9fcd0881-cc74-4dce-bd0e-d5ab8160043c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28641197fb9b472dbe0aecd4dac3f4f3'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:20.532220 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-9fcd0881-cc74-4dce-bd0e-d5ab8160043c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28641197fb9b472dbe0aecd4dac3f4f3'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:20.546683 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-9fcd0881-cc74-4dce-bd0e-d5ab8160043c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28641197fb9b472dbe0aecd4dac3f4f3'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:20.553383 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-9fcd0881-cc74-4dce-bd0e-d5ab8160043c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28641197fb9b472dbe0aecd4dac3f4f3'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:20.560224 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1213/2414] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:35:20 2022] DELETE /identity/v3/users/28641197fb9b472dbe0aecd4dac3f4f3 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:35:20.776259 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7da6b7-f7a0-4936-8508-00bc37d64869 service neutron] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:20.794492 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7da6b7-f7a0-4936-8508-00bc37d64869 service neutron] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:20.863556 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb80818a-923d-4b1c-97ce-47d438b571bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:20.864721 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80818a-923d-4b1c-97ce-47d438b571bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:20.864998 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80818a-923d-4b1c-97ce-47d438b571bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:20.865435 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80818a-923d-4b1c-97ce-47d438b571bc admin admin] PATH_INFO: `/v3/projects/b77d7fba24894206bc824b8dd499e696` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:20.866692 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb80818a-923d-4b1c-97ce-47d438b571bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b77d7fba24894206bc824b8dd499e696)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:20.868805 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb80818a-923d-4b1c-97ce-47d438b571bc admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:20.924687 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-fb80818a-923d-4b1c-97ce-47d438b571bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b77d7fba24894206bc824b8dd499e696', 'request_id': 'req-fb80818a-923d-4b1c-97ce-47d438b571bc'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:20.930445 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-fb80818a-923d-4b1c-97ce-47d438b571bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b77d7fba24894206bc824b8dd499e696', 'request_id': 'req-fb80818a-923d-4b1c-97ce-47d438b571bc'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:20.937403 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-fb80818a-923d-4b1c-97ce-47d438b571bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b77d7fba24894206bc824b8dd499e696', 'request_id': 'req-fb80818a-923d-4b1c-97ce-47d438b571bc'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:20.952840 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-fb80818a-923d-4b1c-97ce-47d438b571bc admin admin] The token cache is being invalidate because project b77d7fba24894206bc824b8dd499e696 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:35:20.953131 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-fb80818a-923d-4b1c-97ce-47d438b571bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:20.954206 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-fb80818a-923d-4b1c-97ce-47d438b571bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:20.958981 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1202/2415] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:35:20 2022] DELETE /identity/v3/projects/b77d7fba24894206bc824b8dd499e696 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:35:20.960814 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac56355-2562-4b68-b9db-e4204b381d2f None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:20.961208 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac56355-2562-4b68-b9db-e4204b381d2f None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:20.961533 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac56355-2562-4b68-b9db-e4204b381d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:20.983448 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-cac56355-2562-4b68-b9db-e4204b381d2f None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:35:20.984813 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-cac56355-2562-4b68-b9db-e4204b381d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:21.058287 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1214/2416] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:35:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:35:21.059339 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca51629-cdc7-4c81-9f16-3f687eb1f12c None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:21.059626 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca51629-cdc7-4c81-9f16-3f687eb1f12c None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:21.059903 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca51629-cdc7-4c81-9f16-3f687eb1f12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:21.085166 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-8ca51629-cdc7-4c81-9f16-3f687eb1f12c None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:35:21.086871 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-8ca51629-cdc7-4c81-9f16-3f687eb1f12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:21.102052 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac56355-2562-4b68-b9db-e4204b381d2f None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:21.109220 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1203/2417] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:35:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:35:21.113461 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac56355-2562-4b68-b9db-e4204b381d2f None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:21.118520 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb785383-f5c2-485f-8a52-9449edbd8937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:21.119289 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb785383-f5c2-485f-8a52-9449edbd8937 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:21.119632 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb785383-f5c2-485f-8a52-9449edbd8937 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:21.119968 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb785383-f5c2-485f-8a52-9449edbd8937 admin admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:21.120748 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb785383-f5c2-485f-8a52-9449edbd8937 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:35:21.122348 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb785383-f5c2-485f-8a52-9449edbd8937 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:21.124057 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb785383-f5c2-485f-8a52-9449edbd8937 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:21.144128 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca51629-cdc7-4c81-9f16-3f687eb1f12c None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:21.144397 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1215/2418] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:35:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:35:21.157865 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca51629-cdc7-4c81-9f16-3f687eb1f12c None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:21.163095 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c7b6f-ad3a-47ba-9366-a975678423a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:21.163948 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c7b6f-ad3a-47ba-9366-a975678423a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:21.164402 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c7b6f-ad3a-47ba-9366-a975678423a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:21.164822 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c7b6f-ad3a-47ba-9366-a975678423a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:21.165651 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c7b6f-ad3a-47ba-9366-a975678423a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:21.174915 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c7b6f-ad3a-47ba-9366-a975678423a4 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:21.207725 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1204/2419] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:35:21 2022] POST /identity/v3/projects => generated 369 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:35:21.209775 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb785383-f5c2-485f-8a52-9449edbd8937 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:21.221098 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb785383-f5c2-485f-8a52-9449edbd8937 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:21.283884 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ffb49-bc36-4c84-903f-1e93bf9fd667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:21.284559 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ffb49-bc36-4c84-903f-1e93bf9fd667 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:21.284838 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ffb49-bc36-4c84-903f-1e93bf9fd667 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:21.285112 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ffb49-bc36-4c84-903f-1e93bf9fd667 admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:21.286144 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ffb49-bc36-4c84-903f-1e93bf9fd667 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:21.288117 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ffb49-bc36-4c84-903f-1e93bf9fd667 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:21.309025 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1216/2420] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:35:21 2022] POST /identity/v3/users => generated 285 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:35:21.313282 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c7b6f-ad3a-47ba-9366-a975678423a4 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:21.323503 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c7b6f-ad3a-47ba-9366-a975678423a4 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:21.329027 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fbca25-902c-449d-8af2-b6e9d969a065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:21.329685 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fbca25-902c-449d-8af2-b6e9d969a065 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:21.329960 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fbca25-902c-449d-8af2-b6e9d969a065 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:21.330236 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fbca25-902c-449d-8af2-b6e9d969a065 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:21.330984 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fbca25-902c-449d-8af2-b6e9d969a065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:21.332562 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fbca25-902c-449d-8af2-b6e9d969a065 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:21.343917 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1205/2421] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:35:21.347857 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ffb49-bc36-4c84-903f-1e93bf9fd667 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:21.358960 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ffb49-bc36-4c84-903f-1e93bf9fd667 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:21.364436 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef6e08-2ac3-4b52-bc6e-5c63aa5c4fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:21.365100 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef6e08-2ac3-4b52-bc6e-5c63aa5c4fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:21.365380 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef6e08-2ac3-4b52-bc6e-5c63aa5c4fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:21.365651 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef6e08-2ac3-4b52-bc6e-5c63aa5c4fa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:21.366374 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ef6e08-2ac3-4b52-bc6e-5c63aa5c4fa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:21.368005 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ef6e08-2ac3-4b52-bc6e-5c63aa5c4fa2 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:21.378255 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1217/2422] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:35:21.382458 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fbca25-902c-449d-8af2-b6e9d969a065 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:21.392378 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fbca25-902c-449d-8af2-b6e9d969a065 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:21.397097 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be241f7-cc71-4fcb-a996-349db28c3cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:21.397970 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be241f7-cc71-4fcb-a996-349db28c3cd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:21.398250 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be241f7-cc71-4fcb-a996-349db28c3cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:21.398524 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be241f7-cc71-4fcb-a996-349db28c3cd3 admin admin] PATH_INFO: `/v3/projects/a16fff96391a41009f2965b670a6c631/users/d354aa11df01429d9ea39e273a6b4da6/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:21.415532 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be241f7-cc71-4fcb-a996-349db28c3cd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a16fff96391a41009f2965b670a6c631, user_id=d354aa11df01429d9ea39e273a6b4da6, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:21.418343 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be241f7-cc71-4fcb-a996-349db28c3cd3 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:21.433195 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1206/2423] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:35:21 2022] PUT /identity/v3/projects/a16fff96391a41009f2965b670a6c631/users/d354aa11df01429d9ea39e273a6b4da6/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:35:21.444393 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5e407-5225-4181-a7bc-a509b3d9fd72 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:21.444682 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5e407-5225-4181-a7bc-a509b3d9fd72 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:21.445470 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5e407-5225-4181-a7bc-a509b3d9fd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:21.473874 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-1da5e407-5225-4181-a7bc-a509b3d9fd72 None None] MFA Rules not processed for user `d354aa11df01429d9ea39e273a6b4da6`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:35:21.475136 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-1da5e407-5225-4181-a7bc-a509b3d9fd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:21.542125 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1218/2424] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:35:21 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:35:21.547759 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be241f7-cc71-4fcb-a996-349db28c3cd3 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:21.611212 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be241f7-cc71-4fcb-a996-349db28c3cd3 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:21.616273 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88443b15-039d-44fa-8ec7-dce8e6d09414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:21.616941 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88443b15-039d-44fa-8ec7-dce8e6d09414 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:21.617225 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88443b15-039d-44fa-8ec7-dce8e6d09414 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:21.617500 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88443b15-039d-44fa-8ec7-dce8e6d09414 admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:21.618210 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88443b15-039d-44fa-8ec7-dce8e6d09414 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:21.620189 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88443b15-039d-44fa-8ec7-dce8e6d09414 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:21.649183 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1207/2425] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:35:21 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:35:21.655220 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5e407-5225-4181-a7bc-a509b3d9fd72 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:21.670091 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5e407-5225-4181-a7bc-a509b3d9fd72 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:21.729586 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b25ed-2af4-41f2-a92d-aa15b31a019c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:21.730181 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b25ed-2af4-41f2-a92d-aa15b31a019c admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:21.731135 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b25ed-2af4-41f2-a92d-aa15b31a019c admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:21.731539 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b25ed-2af4-41f2-a92d-aa15b31a019c admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:21.732482 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236b25ed-2af4-41f2-a92d-aa15b31a019c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:21.734651 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236b25ed-2af4-41f2-a92d-aa15b31a019c admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:21.758570 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1219/2426] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:35:21 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:35:21.763590 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88443b15-039d-44fa-8ec7-dce8e6d09414 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:21.774178 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88443b15-039d-44fa-8ec7-dce8e6d09414 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:21.779532 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd0100-b574-49f8-adff-52bf56c16e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:21.780208 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd0100-b574-49f8-adff-52bf56c16e21 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:21.780485 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd0100-b574-49f8-adff-52bf56c16e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:21.780790 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd0100-b574-49f8-adff-52bf56c16e21 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:21.781750 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd0100-b574-49f8-adff-52bf56c16e21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:21.783598 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd0100-b574-49f8-adff-52bf56c16e21 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:21.795485 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1208/2427] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:35:21.799826 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b25ed-2af4-41f2-a92d-aa15b31a019c admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:21.810650 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b25ed-2af4-41f2-a92d-aa15b31a019c admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:21.815422 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c23d46-7f53-4e46-a127-ec3a54c59e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:21.816313 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c23d46-7f53-4e46-a127-ec3a54c59e8a admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:21.816595 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c23d46-7f53-4e46-a127-ec3a54c59e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:21.816871 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c23d46-7f53-4e46-a127-ec3a54c59e8a admin admin] PATH_INFO: `/v3/projects/b12ebf0103c64140b476eb036dd6971c/users/8956c9aca88f4e89969f0890f3d77535/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:21.832977 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c23d46-7f53-4e46-a127-ec3a54c59e8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b12ebf0103c64140b476eb036dd6971c, user_id=8956c9aca88f4e89969f0890f3d77535, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:21.835681 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c23d46-7f53-4e46-a127-ec3a54c59e8a admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:21.851102 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1220/2428] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:35:21 2022] PUT /identity/v3/projects/b12ebf0103c64140b476eb036dd6971c/users/8956c9aca88f4e89969f0890f3d77535/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:35:21.854956 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd0100-b574-49f8-adff-52bf56c16e21 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:21.866206 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd0100-b574-49f8-adff-52bf56c16e21 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:21.921854 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e52b6-fcc6-4a7c-ae84-649527e9fa4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:21.922515 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e52b6-fcc6-4a7c-ae84-649527e9fa4c admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:21.922824 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e52b6-fcc6-4a7c-ae84-649527e9fa4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:21.923098 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e52b6-fcc6-4a7c-ae84-649527e9fa4c admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:21.923811 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631e52b6-fcc6-4a7c-ae84-649527e9fa4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:21.925393 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631e52b6-fcc6-4a7c-ae84-649527e9fa4c admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:21.935776 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1209/2429] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:35:21.940287 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c23d46-7f53-4e46-a127-ec3a54c59e8a admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:21.952012 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c23d46-7f53-4e46-a127-ec3a54c59e8a admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:21.957623 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df144d6-a544-440f-902d-131073a120a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:21.958575 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df144d6-a544-440f-902d-131073a120a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:21.958891 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df144d6-a544-440f-902d-131073a120a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:21.959170 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df144d6-a544-440f-902d-131073a120a9 admin admin] PATH_INFO: `/v3/projects/b12ebf0103c64140b476eb036dd6971c/users/8956c9aca88f4e89969f0890f3d77535/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:21.961300 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df144d6-a544-440f-902d-131073a120a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b12ebf0103c64140b476eb036dd6971c, user_id=8956c9aca88f4e89969f0890f3d77535, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:21.964213 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df144d6-a544-440f-902d-131073a120a9 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:21.975568 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1221/2430] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:35:21 2022] PUT /identity/v3/projects/b12ebf0103c64140b476eb036dd6971c/users/8956c9aca88f4e89969f0890f3d77535/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:35:21.985853 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ccb69-e98e-4f16-ad59-df2c5e437457 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:21.986076 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ccb69-e98e-4f16-ad59-df2c5e437457 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:21.986354 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ccb69-e98e-4f16-ad59-df2c5e437457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:22.013686 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-417ccb69-e98e-4f16-ad59-df2c5e437457 None None] MFA Rules not processed for user `8956c9aca88f4e89969f0890f3d77535`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:35:22.014922 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-417ccb69-e98e-4f16-ad59-df2c5e437457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:22.081958 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1210/2431] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:35:21 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:35:22.095504 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df144d6-a544-440f-902d-131073a120a9 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:22.097614 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-4df144d6-a544-440f-902d-131073a120a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:22.178425 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df144d6-a544-440f-902d-131073a120a9 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:22.182565 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d78ccf-d34a-4f7e-a119-851490c03c5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:22.183294 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d78ccf-d34a-4f7e-a119-851490c03c5b service cinder] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:22.184111 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d78ccf-d34a-4f7e-a119-851490c03c5b service cinder] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:22.184359 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d78ccf-d34a-4f7e-a119-851490c03c5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:22.194281 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d78ccf-d34a-4f7e-a119-851490c03c5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:22.196248 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d78ccf-d34a-4f7e-a119-851490c03c5b service cinder] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:22.207349 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1222/2432] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:35:22 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:35:22.573843 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ccb69-e98e-4f16-ad59-df2c5e437457 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:22.634762 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ccb69-e98e-4f16-ad59-df2c5e437457 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:22.639735 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0ad4f-ac62-4dbf-803c-f255e01fb86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:22.640575 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0ad4f-ac62-4dbf-803c-f255e01fb86f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:22.640846 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0ad4f-ac62-4dbf-803c-f255e01fb86f admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:22.641111 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0ad4f-ac62-4dbf-803c-f255e01fb86f admin admin] PATH_INFO: `/v3/users/d354aa11df01429d9ea39e273a6b4da6` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:22.642263 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf0ad4f-ac62-4dbf-803c-f255e01fb86f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d354aa11df01429d9ea39e273a6b4da6)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:22.644185 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf0ad4f-ac62-4dbf-803c-f255e01fb86f admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:22.695118 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-dbf0ad4f-ac62-4dbf-803c-f255e01fb86f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd354aa11df01429d9ea39e273a6b4da6'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:22.695805 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-dbf0ad4f-ac62-4dbf-803c-f255e01fb86f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd354aa11df01429d9ea39e273a6b4da6'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:22.707061 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-dbf0ad4f-ac62-4dbf-803c-f255e01fb86f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd354aa11df01429d9ea39e273a6b4da6'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:22.713874 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-dbf0ad4f-ac62-4dbf-803c-f255e01fb86f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd354aa11df01429d9ea39e273a6b4da6'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:22.721471 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-dbf0ad4f-ac62-4dbf-803c-f255e01fb86f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd354aa11df01429d9ea39e273a6b4da6'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:22.727173 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1211/2433] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:35:22 2022] DELETE /identity/v3/users/d354aa11df01429d9ea39e273a6b4da6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:35:22.732412 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11250d-8a64-47c3-a16e-247a3c2d8935 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:22.732881 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11250d-8a64-47c3-a16e-247a3c2d8935 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:22.732994 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11250d-8a64-47c3-a16e-247a3c2d8935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:22.749824 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-da11250d-8a64-47c3-a16e-247a3c2d8935 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:35:22.751018 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-da11250d-8a64-47c3-a16e-247a3c2d8935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:22.808295 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1223/2434] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:35:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:35:22.818510 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0ad4f-ac62-4dbf-803c-f255e01fb86f admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:22.819933 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-dbf0ad4f-ac62-4dbf-803c-f255e01fb86f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:22.877095 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0ad4f-ac62-4dbf-803c-f255e01fb86f admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:22.880768 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086293d-8239-4073-aea0-f1ac22313118 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:22.881399 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086293d-8239-4073-aea0-f1ac22313118 service neutron] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:22.881694 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086293d-8239-4073-aea0-f1ac22313118 service neutron] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:22.881950 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086293d-8239-4073-aea0-f1ac22313118 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:22.892029 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f086293d-8239-4073-aea0-f1ac22313118 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:22.893444 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f086293d-8239-4073-aea0-f1ac22313118 service neutron] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:22.903108 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1212/2435] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:35:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:35:23.163657 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11250d-8a64-47c3-a16e-247a3c2d8935 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:23.165091 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-da11250d-8a64-47c3-a16e-247a3c2d8935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:23.182357 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11250d-8a64-47c3-a16e-247a3c2d8935 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:23.188229 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb0dd67-c0f1-4ba0-8a40-4b7567444a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:23.189192 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0dd67-c0f1-4ba0-8a40-4b7567444a41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:23.189514 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0dd67-c0f1-4ba0-8a40-4b7567444a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:23.189738 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0dd67-c0f1-4ba0-8a40-4b7567444a41 admin admin] PATH_INFO: `/v3/projects/a16fff96391a41009f2965b670a6c631` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:23.191180 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb0dd67-c0f1-4ba0-8a40-4b7567444a41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a16fff96391a41009f2965b670a6c631)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:23.193064 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb0dd67-c0f1-4ba0-8a40-4b7567444a41 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:23.239339 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-1eb0dd67-c0f1-4ba0-8a40-4b7567444a41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a16fff96391a41009f2965b670a6c631', 'request_id': 'req-1eb0dd67-c0f1-4ba0-8a40-4b7567444a41'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:23.245027 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-1eb0dd67-c0f1-4ba0-8a40-4b7567444a41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a16fff96391a41009f2965b670a6c631', 'request_id': 'req-1eb0dd67-c0f1-4ba0-8a40-4b7567444a41'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:23.252208 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-1eb0dd67-c0f1-4ba0-8a40-4b7567444a41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a16fff96391a41009f2965b670a6c631', 'request_id': 'req-1eb0dd67-c0f1-4ba0-8a40-4b7567444a41'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:23.264896 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-1eb0dd67-c0f1-4ba0-8a40-4b7567444a41 admin admin] The token cache is being invalidate because project a16fff96391a41009f2965b670a6c631 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:35:23.265187 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-1eb0dd67-c0f1-4ba0-8a40-4b7567444a41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:23.265799 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-1eb0dd67-c0f1-4ba0-8a40-4b7567444a41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:23.267342 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1224/2436] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:35:23 2022] DELETE /identity/v3/projects/a16fff96391a41009f2965b670a6c631 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:35:23.271353 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086293d-8239-4073-aea0-f1ac22313118 service neutron] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:23.281129 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086293d-8239-4073-aea0-f1ac22313118 service neutron] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:23.352480 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017e9e3-027b-4b18-b89c-3dddbec70e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:23.353339 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017e9e3-027b-4b18-b89c-3dddbec70e2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:23.353616 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017e9e3-027b-4b18-b89c-3dddbec70e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:23.353886 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017e9e3-027b-4b18-b89c-3dddbec70e2c admin admin] PATH_INFO: `/v3/users/8956c9aca88f4e89969f0890f3d77535` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:23.355326 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3017e9e3-027b-4b18-b89c-3dddbec70e2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8956c9aca88f4e89969f0890f3d77535)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:23.357220 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3017e9e3-027b-4b18-b89c-3dddbec70e2c admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:23.404411 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-3017e9e3-027b-4b18-b89c-3dddbec70e2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8956c9aca88f4e89969f0890f3d77535'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:23.405174 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-3017e9e3-027b-4b18-b89c-3dddbec70e2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8956c9aca88f4e89969f0890f3d77535'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:23.418786 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-3017e9e3-027b-4b18-b89c-3dddbec70e2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8956c9aca88f4e89969f0890f3d77535'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:23.426849 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-3017e9e3-027b-4b18-b89c-3dddbec70e2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8956c9aca88f4e89969f0890f3d77535'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:23.434440 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-3017e9e3-027b-4b18-b89c-3dddbec70e2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8956c9aca88f4e89969f0890f3d77535'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:23.440770 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1213/2437] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:35:23 2022] DELETE /identity/v3/users/8956c9aca88f4e89969f0890f3d77535 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:35:23.783958 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb0dd67-c0f1-4ba0-8a40-4b7567444a41 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:23.785515 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-1eb0dd67-c0f1-4ba0-8a40-4b7567444a41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:23.803529 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb0dd67-c0f1-4ba0-8a40-4b7567444a41 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:23.860692 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeabaf0-94c8-43dc-a434-25aeb2586cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:23.861547 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeabaf0-94c8-43dc-a434-25aeb2586cb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:23.861858 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeabaf0-94c8-43dc-a434-25aeb2586cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:23.862134 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeabaf0-94c8-43dc-a434-25aeb2586cb7 admin admin] PATH_INFO: `/v3/projects/b12ebf0103c64140b476eb036dd6971c` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:23.863367 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeabaf0-94c8-43dc-a434-25aeb2586cb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b12ebf0103c64140b476eb036dd6971c)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:23.865245 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeabaf0-94c8-43dc-a434-25aeb2586cb7 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:23.910278 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-7eeabaf0-94c8-43dc-a434-25aeb2586cb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b12ebf0103c64140b476eb036dd6971c', 'request_id': 'req-7eeabaf0-94c8-43dc-a434-25aeb2586cb7'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:23.915604 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-7eeabaf0-94c8-43dc-a434-25aeb2586cb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b12ebf0103c64140b476eb036dd6971c', 'request_id': 'req-7eeabaf0-94c8-43dc-a434-25aeb2586cb7'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:23.922073 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-7eeabaf0-94c8-43dc-a434-25aeb2586cb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b12ebf0103c64140b476eb036dd6971c', 'request_id': 'req-7eeabaf0-94c8-43dc-a434-25aeb2586cb7'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:23.934570 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-7eeabaf0-94c8-43dc-a434-25aeb2586cb7 admin admin] The token cache is being invalidate because project b12ebf0103c64140b476eb036dd6971c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:35:23.934883 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-7eeabaf0-94c8-43dc-a434-25aeb2586cb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:23.935515 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-7eeabaf0-94c8-43dc-a434-25aeb2586cb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:23.937034 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1225/2438] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:35:23 2022] DELETE /identity/v3/projects/b12ebf0103c64140b476eb036dd6971c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:35:23.941884 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed5fe0-def8-4f89-97ec-ae89a1a22884 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:23.942527 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed5fe0-def8-4f89-97ec-ae89a1a22884 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:23.942527 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed5fe0-def8-4f89-97ec-ae89a1a22884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:23.959723 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-d7ed5fe0-def8-4f89-97ec-ae89a1a22884 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:35:23.960908 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-d7ed5fe0-def8-4f89-97ec-ae89a1a22884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:24.019176 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1214/2439] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:35:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:35:24.027164 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b942cf2-3ff5-4eef-85e1-e858e53ee1b8 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:24.027489 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b942cf2-3ff5-4eef-85e1-e858e53ee1b8 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:24.027762 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b942cf2-3ff5-4eef-85e1-e858e53ee1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:24.047035 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-9b942cf2-3ff5-4eef-85e1-e858e53ee1b8 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:35:24.048358 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-9b942cf2-3ff5-4eef-85e1-e858e53ee1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:24.056397 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1226/2440] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:35:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:35:24.062043 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed5fe0-def8-4f89-97ec-ae89a1a22884 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:24.071666 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed5fe0-def8-4f89-97ec-ae89a1a22884 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:24.076455 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d14476-d7ec-4bcd-8a9a-cc342befa603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:24.077095 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d14476-d7ec-4bcd-8a9a-cc342befa603 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:24.077381 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d14476-d7ec-4bcd-8a9a-cc342befa603 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:24.077655 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d14476-d7ec-4bcd-8a9a-cc342befa603 admin admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:24.078432 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d14476-d7ec-4bcd-8a9a-cc342befa603 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:35:24.078725 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d14476-d7ec-4bcd-8a9a-cc342befa603 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:24.080310 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d14476-d7ec-4bcd-8a9a-cc342befa603 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:24.092377 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1215/2441] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:35:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:35:24.096532 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b942cf2-3ff5-4eef-85e1-e858e53ee1b8 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:24.105404 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b942cf2-3ff5-4eef-85e1-e858e53ee1b8 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:24.111104 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c81a1b-fec3-4d7e-829a-cc9d4e7d0a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:24.111740 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c81a1b-fec3-4d7e-829a-cc9d4e7d0a53 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:24.112012 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c81a1b-fec3-4d7e-829a-cc9d4e7d0a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:24.112291 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c81a1b-fec3-4d7e-829a-cc9d4e7d0a53 admin admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:24.112973 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c81a1b-fec3-4d7e-829a-cc9d4e7d0a53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:24.114852 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c81a1b-fec3-4d7e-829a-cc9d4e7d0a53 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:24.140529 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1227/2442] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:35:24 2022] POST /identity/v3/projects => generated 363 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:35:24.144605 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d14476-d7ec-4bcd-8a9a-cc342befa603 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:24.154874 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d14476-d7ec-4bcd-8a9a-cc342befa603 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:24.208990 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766cb2ea-b958-46ea-82d1-993835a5b10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:24.209563 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cb2ea-b958-46ea-82d1-993835a5b10f admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:24.209837 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cb2ea-b958-46ea-82d1-993835a5b10f admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:24.210106 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cb2ea-b958-46ea-82d1-993835a5b10f admin admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:24.210800 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766cb2ea-b958-46ea-82d1-993835a5b10f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:24.212676 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766cb2ea-b958-46ea-82d1-993835a5b10f admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:24.233486 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1216/2443] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:35:24 2022] POST /identity/v3/users => generated 282 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:35:24.237488 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c81a1b-fec3-4d7e-829a-cc9d4e7d0a53 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:24.247982 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c81a1b-fec3-4d7e-829a-cc9d4e7d0a53 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:24.252635 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751fb48-6298-47ba-9d53-f92ac20835e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:24.253279 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751fb48-6298-47ba-9d53-f92ac20835e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:24.253581 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751fb48-6298-47ba-9d53-f92ac20835e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:24.253861 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751fb48-6298-47ba-9d53-f92ac20835e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:24.254523 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751fb48-6298-47ba-9d53-f92ac20835e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:24.256117 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751fb48-6298-47ba-9d53-f92ac20835e1 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:24.267485 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1228/2444] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:35:24.270826 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766cb2ea-b958-46ea-82d1-993835a5b10f admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:24.281581 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766cb2ea-b958-46ea-82d1-993835a5b10f admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:24.286427 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab8e07-eb55-4e1c-9b11-f8c938c1ff6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:24.287124 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab8e07-eb55-4e1c-9b11-f8c938c1ff6d admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:24.287400 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab8e07-eb55-4e1c-9b11-f8c938c1ff6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:24.287676 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab8e07-eb55-4e1c-9b11-f8c938c1ff6d admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:24.288409 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab8e07-eb55-4e1c-9b11-f8c938c1ff6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:24.290027 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab8e07-eb55-4e1c-9b11-f8c938c1ff6d admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:24.301424 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1217/2445] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:35:24.305571 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751fb48-6298-47ba-9d53-f92ac20835e1 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:24.315909 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751fb48-6298-47ba-9d53-f92ac20835e1 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:24.320769 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82814d7e-ac98-43fe-be3e-e2b2802d483a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:24.321637 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82814d7e-ac98-43fe-be3e-e2b2802d483a admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:24.322020 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82814d7e-ac98-43fe-be3e-e2b2802d483a admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:24.322207 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82814d7e-ac98-43fe-be3e-e2b2802d483a admin admin] PATH_INFO: `/v3/projects/e334f142ba0e41a4a9c76b04cc6f07cd/users/48e7e9397f284306a845757b99e5da91/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:24.336784 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82814d7e-ac98-43fe-be3e-e2b2802d483a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e334f142ba0e41a4a9c76b04cc6f07cd, user_id=48e7e9397f284306a845757b99e5da91, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:24.339447 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82814d7e-ac98-43fe-be3e-e2b2802d483a admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:24.356824 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1229/2446] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:35:24 2022] PUT /identity/v3/projects/e334f142ba0e41a4a9c76b04cc6f07cd/users/48e7e9397f284306a845757b99e5da91/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:35:24.366960 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e04061-73ba-4db5-91d3-957d2ab62812 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:24.367250 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e04061-73ba-4db5-91d3-957d2ab62812 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:24.367527 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e04061-73ba-4db5-91d3-957d2ab62812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:24.394882 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-77e04061-73ba-4db5-91d3-957d2ab62812 None None] MFA Rules not processed for user `48e7e9397f284306a845757b99e5da91`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:35:24.396082 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-77e04061-73ba-4db5-91d3-957d2ab62812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:24.460487 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1218/2447] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:35:24 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:35:24.465702 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82814d7e-ac98-43fe-be3e-e2b2802d483a admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:24.529338 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82814d7e-ac98-43fe-be3e-e2b2802d483a admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:24.534385 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97edee57-c4ea-469e-ab27-329f2e1545a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:24.535071 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97edee57-c4ea-469e-ab27-329f2e1545a3 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:24.535388 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97edee57-c4ea-469e-ab27-329f2e1545a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:24.535665 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97edee57-c4ea-469e-ab27-329f2e1545a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:24.536349 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97edee57-c4ea-469e-ab27-329f2e1545a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:24.538233 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97edee57-c4ea-469e-ab27-329f2e1545a3 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:24.568624 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1230/2448] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:35:24 2022] POST /identity/v3/projects => generated 363 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:35:24.572929 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e04061-73ba-4db5-91d3-957d2ab62812 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:24.584353 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e04061-73ba-4db5-91d3-957d2ab62812 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:24.607460 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97edee57-c4ea-469e-ab27-329f2e1545a3 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:24.609331 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-97edee57-c4ea-469e-ab27-329f2e1545a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:24.640582 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3553436-fe60-4d37-ba9f-1ce029f26b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:24.641351 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3553436-fe60-4d37-ba9f-1ce029f26b3b admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:24.641640 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3553436-fe60-4d37-ba9f-1ce029f26b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:24.642006 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3553436-fe60-4d37-ba9f-1ce029f26b3b admin admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:24.642727 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3553436-fe60-4d37-ba9f-1ce029f26b3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:24.644640 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3553436-fe60-4d37-ba9f-1ce029f26b3b admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:24.667189 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1219/2449] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:35:24 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:35:24.671928 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97edee57-c4ea-469e-ab27-329f2e1545a3 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:24.672175 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3553436-fe60-4d37-ba9f-1ce029f26b3b admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:24.675611 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a9909-c17d-45cb-8933-768ab3148125 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:24.676299 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a9909-c17d-45cb-8933-768ab3148125 service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:24.676574 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a9909-c17d-45cb-8933-768ab3148125 service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:24.676843 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a9909-c17d-45cb-8933-768ab3148125 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:24.678666 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-774a9909-c17d-45cb-8933-768ab3148125 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:24.681483 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3553436-fe60-4d37-ba9f-1ce029f26b3b admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:24.687193 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71a930-f3a1-475b-b105-7a417de62da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:24.687841 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71a930-f3a1-475b-b105-7a417de62da1 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:24.688114 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71a930-f3a1-475b-b105-7a417de62da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:24.688394 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71a930-f3a1-475b-b105-7a417de62da1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:24.689124 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71a930-f3a1-475b-b105-7a417de62da1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:24.690752 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71a930-f3a1-475b-b105-7a417de62da1 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:24.702030 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1220/2450] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:35:24.706144 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71a930-f3a1-475b-b105-7a417de62da1 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:24.717971 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71a930-f3a1-475b-b105-7a417de62da1 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:24.722974 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8236ce-8a2f-4866-9a33-6b16a9ef9e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:24.723859 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8236ce-8a2f-4866-9a33-6b16a9ef9e15 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:24.724140 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8236ce-8a2f-4866-9a33-6b16a9ef9e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:24.724420 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8236ce-8a2f-4866-9a33-6b16a9ef9e15 admin admin] PATH_INFO: `/v3/projects/3d532940945b49c4bbf7386cf10bdf68/users/4af09384a0ca4df4958ffdde909b3917/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:24.739389 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8236ce-8a2f-4866-9a33-6b16a9ef9e15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d532940945b49c4bbf7386cf10bdf68, user_id=4af09384a0ca4df4958ffdde909b3917, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:24.742024 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8236ce-8a2f-4866-9a33-6b16a9ef9e15 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:24.754463 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a9909-c17d-45cb-8933-768ab3148125 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:24.755951 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a9909-c17d-45cb-8933-768ab3148125 service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:24.758300 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1221/2451] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:35:24 2022] PUT /identity/v3/projects/3d532940945b49c4bbf7386cf10bdf68/users/4af09384a0ca4df4958ffdde909b3917/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:35:24.762687 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8236ce-8a2f-4866-9a33-6b16a9ef9e15 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:24.772984 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1231/2452] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:35:24 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:35:24.833342 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8236ce-8a2f-4866-9a33-6b16a9ef9e15 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:24.839274 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07594c-f7a1-4d12-ac9d-72109582a44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:24.841320 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07594c-f7a1-4d12-ac9d-72109582a44f admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:24.841608 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07594c-f7a1-4d12-ac9d-72109582a44f admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:24.842369 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07594c-f7a1-4d12-ac9d-72109582a44f admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:24.842628 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07594c-f7a1-4d12-ac9d-72109582a44f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:24.844910 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07594c-f7a1-4d12-ac9d-72109582a44f admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:24.863434 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1222/2453] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:35:24.867642 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a9909-c17d-45cb-8933-768ab3148125 service neutron] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:24.879093 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a9909-c17d-45cb-8933-768ab3148125 service neutron] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:24.883921 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d22851-2eb8-42da-8bcb-3fd72bde5206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:24.884866 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d22851-2eb8-42da-8bcb-3fd72bde5206 admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:24.885160 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d22851-2eb8-42da-8bcb-3fd72bde5206 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:24.885433 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d22851-2eb8-42da-8bcb-3fd72bde5206 admin admin] PATH_INFO: `/v3/projects/3d532940945b49c4bbf7386cf10bdf68/users/4af09384a0ca4df4958ffdde909b3917/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:24.887503 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d22851-2eb8-42da-8bcb-3fd72bde5206 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d532940945b49c4bbf7386cf10bdf68, user_id=4af09384a0ca4df4958ffdde909b3917, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:24.890075 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d22851-2eb8-42da-8bcb-3fd72bde5206 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:24.900605 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1232/2454] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:35:24 2022] PUT /identity/v3/projects/3d532940945b49c4bbf7386cf10bdf68/users/4af09384a0ca4df4958ffdde909b3917/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:35:24.912330 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e056aa5-e0ce-4fc3-8f62-afb97fa0ce99 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:24.912623 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e056aa5-e0ce-4fc3-8f62-afb97fa0ce99 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:24.912900 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e056aa5-e0ce-4fc3-8f62-afb97fa0ce99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:24.940263 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-5e056aa5-e0ce-4fc3-8f62-afb97fa0ce99 None None] MFA Rules not processed for user `4af09384a0ca4df4958ffdde909b3917`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:35:24.941476 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-5e056aa5-e0ce-4fc3-8f62-afb97fa0ce99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:25.011471 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1223/2455] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:35:24 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:35:25.023014 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d22851-2eb8-42da-8bcb-3fd72bde5206 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:25.024685 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-09d22851-2eb8-42da-8bcb-3fd72bde5206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:25.082484 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d22851-2eb8-42da-8bcb-3fd72bde5206 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:25.086154 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9ce44-a3fd-4c35-8e1d-3d4d9f709e7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:25.086835 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9ce44-a3fd-4c35-8e1d-3d4d9f709e7d service cinder] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:25.087098 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9ce44-a3fd-4c35-8e1d-3d4d9f709e7d service cinder] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:25.087377 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9ce44-a3fd-4c35-8e1d-3d4d9f709e7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:25.097864 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee9ce44-a3fd-4c35-8e1d-3d4d9f709e7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:25.099306 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee9ce44-a3fd-4c35-8e1d-3d4d9f709e7d service cinder] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:25.109591 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1233/2456] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:35:25 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:35:25.183712 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e056aa5-e0ce-4fc3-8f62-afb97fa0ce99 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:25.193386 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e056aa5-e0ce-4fc3-8f62-afb97fa0ce99 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:25.197137 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1004e38-db10-43f9-9090-5680e879e8f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:25.197880 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1004e38-db10-43f9-9090-5680e879e8f5 service cinder] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:25.198259 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1004e38-db10-43f9-9090-5680e879e8f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:25.198534 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1004e38-db10-43f9-9090-5680e879e8f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:25.256908 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1004e38-db10-43f9-9090-5680e879e8f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:25.258371 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1004e38-db10-43f9-9090-5680e879e8f5 service cinder] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:25.269322 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1224/2457] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:35:25 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:35:28.140177 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9ce44-a3fd-4c35-8e1d-3d4d9f709e7d service cinder] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:28.243496 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9ce44-a3fd-4c35-8e1d-3d4d9f709e7d service cinder] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:28.249808 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8ad1e-0794-458d-b09f-66f8bfbc947b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:28.250960 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8ad1e-0794-458d-b09f-66f8bfbc947b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:28.251444 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8ad1e-0794-458d-b09f-66f8bfbc947b admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:28.251871 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8ad1e-0794-458d-b09f-66f8bfbc947b admin admin] PATH_INFO: `/v3/users/48e7e9397f284306a845757b99e5da91` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:28.253592 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8ad1e-0794-458d-b09f-66f8bfbc947b admin admin] RBAC: Authorizing `identity:delete_user(user_id=48e7e9397f284306a845757b99e5da91)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:28.256099 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8ad1e-0794-458d-b09f-66f8bfbc947b admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:28.320821 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-b8f8ad1e-0794-458d-b09f-66f8bfbc947b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48e7e9397f284306a845757b99e5da91'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:28.332091 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-b8f8ad1e-0794-458d-b09f-66f8bfbc947b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48e7e9397f284306a845757b99e5da91'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:28.332901 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-b8f8ad1e-0794-458d-b09f-66f8bfbc947b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48e7e9397f284306a845757b99e5da91'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:28.349037 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-b8f8ad1e-0794-458d-b09f-66f8bfbc947b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48e7e9397f284306a845757b99e5da91'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:28.357138 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-b8f8ad1e-0794-458d-b09f-66f8bfbc947b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48e7e9397f284306a845757b99e5da91'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:28.368545 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1234/2458] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:35:28 2022] DELETE /identity/v3/users/48e7e9397f284306a845757b99e5da91 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:35:28.373083 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa1cee-0c11-4b14-a83b-7399b2926d66 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:28.373929 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa1cee-0c11-4b14-a83b-7399b2926d66 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:28.374313 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa1cee-0c11-4b14-a83b-7399b2926d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:28.398126 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-defa1cee-0c11-4b14-a83b-7399b2926d66 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:35:28.400043 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-defa1cee-0c11-4b14-a83b-7399b2926d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:28.486696 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1225/2459] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:35:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:35:28.502274 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8ad1e-0794-458d-b09f-66f8bfbc947b admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:28.503789 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-b8f8ad1e-0794-458d-b09f-66f8bfbc947b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:28.567816 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8ad1e-0794-458d-b09f-66f8bfbc947b admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:28.571676 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92862e-a8e5-49ed-9c65-eb43a7a75ae8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:28.572907 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92862e-a8e5-49ed-9c65-eb43a7a75ae8 service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:28.573188 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92862e-a8e5-49ed-9c65-eb43a7a75ae8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:28.573462 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92862e-a8e5-49ed-9c65-eb43a7a75ae8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:28.586134 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd92862e-a8e5-49ed-9c65-eb43a7a75ae8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:28.587648 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd92862e-a8e5-49ed-9c65-eb43a7a75ae8 service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:28.601425 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1235/2460] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:35:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:35:29.141521 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa1cee-0c11-4b14-a83b-7399b2926d66 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:29.143052 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-defa1cee-0c11-4b14-a83b-7399b2926d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:29.174221 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa1cee-0c11-4b14-a83b-7399b2926d66 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:29.179501 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f09cb-2aab-4e96-91c9-064246d55723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:29.180352 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f09cb-2aab-4e96-91c9-064246d55723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:29.180637 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f09cb-2aab-4e96-91c9-064246d55723 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:29.180914 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f09cb-2aab-4e96-91c9-064246d55723 admin admin] PATH_INFO: `/v3/projects/e334f142ba0e41a4a9c76b04cc6f07cd` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:29.182106 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f09cb-2aab-4e96-91c9-064246d55723 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e334f142ba0e41a4a9c76b04cc6f07cd)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:29.184401 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f09cb-2aab-4e96-91c9-064246d55723 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:29.232372 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-8c2f09cb-2aab-4e96-91c9-064246d55723 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e334f142ba0e41a4a9c76b04cc6f07cd', 'request_id': 'req-8c2f09cb-2aab-4e96-91c9-064246d55723'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:29.239380 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-8c2f09cb-2aab-4e96-91c9-064246d55723 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e334f142ba0e41a4a9c76b04cc6f07cd', 'request_id': 'req-8c2f09cb-2aab-4e96-91c9-064246d55723'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:29.246991 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-8c2f09cb-2aab-4e96-91c9-064246d55723 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e334f142ba0e41a4a9c76b04cc6f07cd', 'request_id': 'req-8c2f09cb-2aab-4e96-91c9-064246d55723'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:29.260774 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-8c2f09cb-2aab-4e96-91c9-064246d55723 admin admin] The token cache is being invalidate because project e334f142ba0e41a4a9c76b04cc6f07cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:35:29.261178 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-8c2f09cb-2aab-4e96-91c9-064246d55723 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:29.262328 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-8c2f09cb-2aab-4e96-91c9-064246d55723 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:29.264410 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1226/2461] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:35:29 2022] DELETE /identity/v3/projects/e334f142ba0e41a4a9c76b04cc6f07cd => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:35:29.268308 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92862e-a8e5-49ed-9c65-eb43a7a75ae8 service neutron] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:29.278962 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92862e-a8e5-49ed-9c65-eb43a7a75ae8 service neutron] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:29.334025 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ae7ec-3f14-4f4a-bcef-51632ff559db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:29.335086 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ae7ec-3f14-4f4a-bcef-51632ff559db admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:29.335367 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ae7ec-3f14-4f4a-bcef-51632ff559db admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:29.335642 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ae7ec-3f14-4f4a-bcef-51632ff559db admin admin] PATH_INFO: `/v3/users/4af09384a0ca4df4958ffdde909b3917` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:29.336826 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ae7ec-3f14-4f4a-bcef-51632ff559db admin admin] RBAC: Authorizing `identity:delete_user(user_id=4af09384a0ca4df4958ffdde909b3917)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:29.338758 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ae7ec-3f14-4f4a-bcef-51632ff559db admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:29.385024 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-718ae7ec-3f14-4f4a-bcef-51632ff559db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4af09384a0ca4df4958ffdde909b3917'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:29.392587 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-718ae7ec-3f14-4f4a-bcef-51632ff559db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4af09384a0ca4df4958ffdde909b3917'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:29.393356 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-718ae7ec-3f14-4f4a-bcef-51632ff559db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4af09384a0ca4df4958ffdde909b3917'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:29.405818 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-718ae7ec-3f14-4f4a-bcef-51632ff559db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4af09384a0ca4df4958ffdde909b3917'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:29.412340 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-718ae7ec-3f14-4f4a-bcef-51632ff559db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4af09384a0ca4df4958ffdde909b3917'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:29.418277 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1236/2462] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:35:29 2022] DELETE /identity/v3/users/4af09384a0ca4df4958ffdde909b3917 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:35:29.722194 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f09cb-2aab-4e96-91c9-064246d55723 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:29.723666 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-8c2f09cb-2aab-4e96-91c9-064246d55723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:29.738921 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f09cb-2aab-4e96-91c9-064246d55723 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:29.795883 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f3136-3265-49f5-9cdc-3f7d4e4d0db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:29.796729 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f3136-3265-49f5-9cdc-3f7d4e4d0db2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:29.797011 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f3136-3265-49f5-9cdc-3f7d4e4d0db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:29.797285 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f3136-3265-49f5-9cdc-3f7d4e4d0db2 admin admin] PATH_INFO: `/v3/projects/3d532940945b49c4bbf7386cf10bdf68` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:29.798538 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f3136-3265-49f5-9cdc-3f7d4e4d0db2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d532940945b49c4bbf7386cf10bdf68)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:29.800534 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f3136-3265-49f5-9cdc-3f7d4e4d0db2 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:29.847295 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-c55f3136-3265-49f5-9cdc-3f7d4e4d0db2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d532940945b49c4bbf7386cf10bdf68', 'request_id': 'req-c55f3136-3265-49f5-9cdc-3f7d4e4d0db2'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:29.852636 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-c55f3136-3265-49f5-9cdc-3f7d4e4d0db2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d532940945b49c4bbf7386cf10bdf68', 'request_id': 'req-c55f3136-3265-49f5-9cdc-3f7d4e4d0db2'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:29.859419 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-c55f3136-3265-49f5-9cdc-3f7d4e4d0db2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d532940945b49c4bbf7386cf10bdf68', 'request_id': 'req-c55f3136-3265-49f5-9cdc-3f7d4e4d0db2'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:29.872202 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-c55f3136-3265-49f5-9cdc-3f7d4e4d0db2 admin admin] The token cache is being invalidate because project 3d532940945b49c4bbf7386cf10bdf68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:35:29.872488 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-c55f3136-3265-49f5-9cdc-3f7d4e4d0db2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:29.873195 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-c55f3136-3265-49f5-9cdc-3f7d4e4d0db2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:29.875045 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1227/2463] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:35:29 2022] DELETE /identity/v3/projects/3d532940945b49c4bbf7386cf10bdf68 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:35:29.879935 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2994c1-36a0-4beb-97f3-8f5fd2cd709b None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:29.880227 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2994c1-36a0-4beb-97f3-8f5fd2cd709b None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:29.880505 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2994c1-36a0-4beb-97f3-8f5fd2cd709b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:29.898582 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-bf2994c1-36a0-4beb-97f3-8f5fd2cd709b None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:35:29.899766 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-bf2994c1-36a0-4beb-97f3-8f5fd2cd709b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:29.956438 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1237/2464] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:35:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:35:29.964074 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72801b-6cad-44b1-99ba-e52b63b400f2 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:29.964358 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72801b-6cad-44b1-99ba-e52b63b400f2 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:29.964634 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72801b-6cad-44b1-99ba-e52b63b400f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:29.985450 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-bd72801b-6cad-44b1-99ba-e52b63b400f2 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:35:29.986684 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-bd72801b-6cad-44b1-99ba-e52b63b400f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:29.994507 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1228/2465] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:35:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:35:29.999340 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2994c1-36a0-4beb-97f3-8f5fd2cd709b None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:30.009069 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2994c1-36a0-4beb-97f3-8f5fd2cd709b None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:30.014520 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be2a9f-ec14-4da0-8e7f-98d5e79428d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:30.015221 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be2a9f-ec14-4da0-8e7f-98d5e79428d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:30.015503 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be2a9f-ec14-4da0-8e7f-98d5e79428d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:30.015780 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be2a9f-ec14-4da0-8e7f-98d5e79428d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:30.016661 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be2a9f-ec14-4da0-8e7f-98d5e79428d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:35:30.016966 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be2a9f-ec14-4da0-8e7f-98d5e79428d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:30.018670 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be2a9f-ec14-4da0-8e7f-98d5e79428d6 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:30.031017 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1238/2466] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:35:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:35:30.037370 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd72801b-6cad-44b1-99ba-e52b63b400f2 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:30.048081 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd72801b-6cad-44b1-99ba-e52b63b400f2 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:30.052957 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae0f74-894a-4dd8-b1d2-42dbf9abe83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:30.053798 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae0f74-894a-4dd8-b1d2-42dbf9abe83a admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:30.054228 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae0f74-894a-4dd8-b1d2-42dbf9abe83a admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:30.054505 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae0f74-894a-4dd8-b1d2-42dbf9abe83a admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:30.055230 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae0f74-894a-4dd8-b1d2-42dbf9abe83a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:30.057111 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae0f74-894a-4dd8-b1d2-42dbf9abe83a admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:30.084711 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1229/2467] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:35:30 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:35:30.088581 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be2a9f-ec14-4da0-8e7f-98d5e79428d6 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:30.099022 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be2a9f-ec14-4da0-8e7f-98d5e79428d6 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:30.173663 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640cad33-e372-4827-8b08-b7360a273cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:30.174467 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640cad33-e372-4827-8b08-b7360a273cbd admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:30.174897 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640cad33-e372-4827-8b08-b7360a273cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:30.175351 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640cad33-e372-4827-8b08-b7360a273cbd admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:30.176130 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640cad33-e372-4827-8b08-b7360a273cbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:30.178220 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640cad33-e372-4827-8b08-b7360a273cbd admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:30.207290 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1239/2468] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:35:30 2022] POST /identity/v3/users => generated 285 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:35:30.211388 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae0f74-894a-4dd8-b1d2-42dbf9abe83a admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:30.223862 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae0f74-894a-4dd8-b1d2-42dbf9abe83a admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:30.228743 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c7ef6-8b77-436b-8c92-cfc0eb17ede1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:30.229429 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c7ef6-8b77-436b-8c92-cfc0eb17ede1 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:30.229699 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c7ef6-8b77-436b-8c92-cfc0eb17ede1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:30.229968 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c7ef6-8b77-436b-8c92-cfc0eb17ede1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:30.231367 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c7ef6-8b77-436b-8c92-cfc0eb17ede1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:30.233404 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c7ef6-8b77-436b-8c92-cfc0eb17ede1 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:30.243728 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1230/2469] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:35:30.248032 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640cad33-e372-4827-8b08-b7360a273cbd admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:30.258037 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640cad33-e372-4827-8b08-b7360a273cbd admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:30.262940 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee2c785-7324-49b9-9555-3cca1a73d786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:30.263621 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2c785-7324-49b9-9555-3cca1a73d786 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:30.263930 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2c785-7324-49b9-9555-3cca1a73d786 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:30.264214 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2c785-7324-49b9-9555-3cca1a73d786 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:30.264924 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee2c785-7324-49b9-9555-3cca1a73d786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:30.266508 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee2c785-7324-49b9-9555-3cca1a73d786 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:30.278877 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1240/2470] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:35:30.282990 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c7ef6-8b77-436b-8c92-cfc0eb17ede1 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:30.292896 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c7ef6-8b77-436b-8c92-cfc0eb17ede1 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:30.298659 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b11a3fb-1f9c-4308-bdac-db06e9f193ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:30.299681 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b11a3fb-1f9c-4308-bdac-db06e9f193ea admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:30.300057 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b11a3fb-1f9c-4308-bdac-db06e9f193ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:30.300507 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b11a3fb-1f9c-4308-bdac-db06e9f193ea admin admin] PATH_INFO: `/v3/projects/a28e0978052b416eb3a2bcb2e7fb68ee/users/77b5d03d09a7425f90680ad83be56d36/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:30.317281 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b11a3fb-1f9c-4308-bdac-db06e9f193ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=a28e0978052b416eb3a2bcb2e7fb68ee, user_id=77b5d03d09a7425f90680ad83be56d36, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:30.320886 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b11a3fb-1f9c-4308-bdac-db06e9f193ea admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:30.334998 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1231/2471] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:35:30 2022] PUT /identity/v3/projects/a28e0978052b416eb3a2bcb2e7fb68ee/users/77b5d03d09a7425f90680ad83be56d36/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:35:30.346649 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bb3cf-b2c0-43ec-b91d-11ef735774cb None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:30.346942 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bb3cf-b2c0-43ec-b91d-11ef735774cb None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:30.347220 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bb3cf-b2c0-43ec-b91d-11ef735774cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:30.373702 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-5c5bb3cf-b2c0-43ec-b91d-11ef735774cb None None] MFA Rules not processed for user `77b5d03d09a7425f90680ad83be56d36`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:35:30.374940 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-5c5bb3cf-b2c0-43ec-b91d-11ef735774cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:30.436657 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1241/2472] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:35:30 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:35:30.441379 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b11a3fb-1f9c-4308-bdac-db06e9f193ea admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:30.500895 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b11a3fb-1f9c-4308-bdac-db06e9f193ea admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:30.505512 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed08c44-d70d-42ef-8b90-a77128c1e3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:30.506156 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed08c44-d70d-42ef-8b90-a77128c1e3e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:30.506434 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed08c44-d70d-42ef-8b90-a77128c1e3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:30.506740 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed08c44-d70d-42ef-8b90-a77128c1e3e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:30.507426 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed08c44-d70d-42ef-8b90-a77128c1e3e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:30.509299 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed08c44-d70d-42ef-8b90-a77128c1e3e1 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:30.534128 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1232/2473] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:35:30 2022] POST /identity/v3/projects => generated 369 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:35:30.538226 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5bb3cf-b2c0-43ec-b91d-11ef735774cb None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:30.549374 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5bb3cf-b2c0-43ec-b91d-11ef735774cb None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:30.604143 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e19ce5-ba63-45a2-9ce3-ebb52e5561ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:30.604796 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e19ce5-ba63-45a2-9ce3-ebb52e5561ed admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:30.605074 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e19ce5-ba63-45a2-9ce3-ebb52e5561ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:30.605345 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e19ce5-ba63-45a2-9ce3-ebb52e5561ed admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:30.606194 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e19ce5-ba63-45a2-9ce3-ebb52e5561ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:30.608157 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e19ce5-ba63-45a2-9ce3-ebb52e5561ed admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:30.627437 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1242/2474] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:35:30 2022] POST /identity/v3/users => generated 291 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:35:30.631387 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed08c44-d70d-42ef-8b90-a77128c1e3e1 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:30.642410 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed08c44-d70d-42ef-8b90-a77128c1e3e1 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:30.647023 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9211a-34f6-476c-ba80-4272ac0a7164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:30.647667 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9211a-34f6-476c-ba80-4272ac0a7164 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:30.647947 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9211a-34f6-476c-ba80-4272ac0a7164 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:30.648219 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9211a-34f6-476c-ba80-4272ac0a7164 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:30.648962 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db9211a-34f6-476c-ba80-4272ac0a7164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:30.650544 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db9211a-34f6-476c-ba80-4272ac0a7164 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:30.664224 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1233/2475] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:35:30.669110 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e19ce5-ba63-45a2-9ce3-ebb52e5561ed admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:30.678822 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e19ce5-ba63-45a2-9ce3-ebb52e5561ed admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:30.683378 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab8f32-2113-46a8-bb9a-b000cf030113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:30.684796 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab8f32-2113-46a8-bb9a-b000cf030113 admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:30.685076 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab8f32-2113-46a8-bb9a-b000cf030113 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:30.685349 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab8f32-2113-46a8-bb9a-b000cf030113 admin admin] PATH_INFO: `/v3/projects/88a6855c74cc4acca881ca911aa1ac74/users/1ca23072c3884bef932c8e49bc2ae74b/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:30.700464 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab8f32-2113-46a8-bb9a-b000cf030113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88a6855c74cc4acca881ca911aa1ac74, user_id=1ca23072c3884bef932c8e49bc2ae74b, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:30.703113 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab8f32-2113-46a8-bb9a-b000cf030113 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:30.716859 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1243/2476] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:35:30 2022] PUT /identity/v3/projects/88a6855c74cc4acca881ca911aa1ac74/users/1ca23072c3884bef932c8e49bc2ae74b/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:35:30.720897 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9211a-34f6-476c-ba80-4272ac0a7164 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:30.731084 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9211a-34f6-476c-ba80-4272ac0a7164 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:30.785321 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33702df8-e766-432c-8bc4-a60724935bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:30.785977 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33702df8-e766-432c-8bc4-a60724935bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:30.786258 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33702df8-e766-432c-8bc4-a60724935bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:30.786529 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33702df8-e766-432c-8bc4-a60724935bb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:30.787268 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33702df8-e766-432c-8bc4-a60724935bb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:30.788977 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33702df8-e766-432c-8bc4-a60724935bb7 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:30.798851 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1234/2477] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:35:30.803616 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab8f32-2113-46a8-bb9a-b000cf030113 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:30.813871 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab8f32-2113-46a8-bb9a-b000cf030113 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:30.818527 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677eedb-76ad-45f7-96a9-95f9720acc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:30.819419 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677eedb-76ad-45f7-96a9-95f9720acc91 admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:30.819697 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677eedb-76ad-45f7-96a9-95f9720acc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:30.819968 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677eedb-76ad-45f7-96a9-95f9720acc91 admin admin] PATH_INFO: `/v3/projects/88a6855c74cc4acca881ca911aa1ac74/users/1ca23072c3884bef932c8e49bc2ae74b/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:30.821962 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677eedb-76ad-45f7-96a9-95f9720acc91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88a6855c74cc4acca881ca911aa1ac74, user_id=1ca23072c3884bef932c8e49bc2ae74b, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:30.825219 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677eedb-76ad-45f7-96a9-95f9720acc91 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:30.835364 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1244/2478] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:35:30 2022] PUT /identity/v3/projects/88a6855c74cc4acca881ca911aa1ac74/users/1ca23072c3884bef932c8e49bc2ae74b/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:35:30.849065 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce3436-e35e-409a-9438-a4e665fea7f7 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:30.849760 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce3436-e35e-409a-9438-a4e665fea7f7 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:30.850232 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce3436-e35e-409a-9438-a4e665fea7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:30.876730 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-21ce3436-e35e-409a-9438-a4e665fea7f7 None None] MFA Rules not processed for user `1ca23072c3884bef932c8e49bc2ae74b`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:35:30.877916 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-21ce3436-e35e-409a-9438-a4e665fea7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:30.944122 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1235/2479] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:35:30 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:35:30.955953 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677eedb-76ad-45f7-96a9-95f9720acc91 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:30.957650 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-9677eedb-76ad-45f7-96a9-95f9720acc91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:31.013466 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677eedb-76ad-45f7-96a9-95f9720acc91 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:31.017345 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b726f8-cdaa-479e-b6d5-20761b939513 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:31.018001 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b726f8-cdaa-479e-b6d5-20761b939513 service cinder] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:31.018280 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b726f8-cdaa-479e-b6d5-20761b939513 service cinder] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:31.018550 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b726f8-cdaa-479e-b6d5-20761b939513 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:31.027366 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b726f8-cdaa-479e-b6d5-20761b939513 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:31.028878 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b726f8-cdaa-479e-b6d5-20761b939513 service cinder] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:31.038027 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1245/2480] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:35:30 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:35:32.358760 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce3436-e35e-409a-9438-a4e665fea7f7 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:32.418572 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce3436-e35e-409a-9438-a4e665fea7f7 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:32.423315 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89134e1-d1d3-4e50-84a6-8617d93e87e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:32.424163 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89134e1-d1d3-4e50-84a6-8617d93e87e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:32.424437 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89134e1-d1d3-4e50-84a6-8617d93e87e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:32.424703 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89134e1-d1d3-4e50-84a6-8617d93e87e6 admin admin] PATH_INFO: `/v3/users/77b5d03d09a7425f90680ad83be56d36` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:32.425863 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89134e1-d1d3-4e50-84a6-8617d93e87e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77b5d03d09a7425f90680ad83be56d36)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:32.427794 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89134e1-d1d3-4e50-84a6-8617d93e87e6 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:32.472862 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-c89134e1-d1d3-4e50-84a6-8617d93e87e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77b5d03d09a7425f90680ad83be56d36'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:32.473434 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-c89134e1-d1d3-4e50-84a6-8617d93e87e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77b5d03d09a7425f90680ad83be56d36'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:32.485232 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-c89134e1-d1d3-4e50-84a6-8617d93e87e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77b5d03d09a7425f90680ad83be56d36'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:32.493009 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-c89134e1-d1d3-4e50-84a6-8617d93e87e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77b5d03d09a7425f90680ad83be56d36'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:32.500511 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-c89134e1-d1d3-4e50-84a6-8617d93e87e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77b5d03d09a7425f90680ad83be56d36'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:32.506294 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1236/2481] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:35:32 2022] DELETE /identity/v3/users/77b5d03d09a7425f90680ad83be56d36 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:35:32.510961 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348f45c-32ca-4205-8853-9cdb9ac9ab65 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:32.511436 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348f45c-32ca-4205-8853-9cdb9ac9ab65 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:32.511541 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348f45c-32ca-4205-8853-9cdb9ac9ab65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:32.529297 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-2348f45c-32ca-4205-8853-9cdb9ac9ab65 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:35:32.530490 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-2348f45c-32ca-4205-8853-9cdb9ac9ab65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:32.586159 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1246/2482] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:35:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:35:32.596176 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89134e1-d1d3-4e50-84a6-8617d93e87e6 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:32.597583 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-c89134e1-d1d3-4e50-84a6-8617d93e87e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:32.652799 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89134e1-d1d3-4e50-84a6-8617d93e87e6 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:32.656440 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354e721-3b52-4d11-9ee9-9962b680b3ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:32.657072 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354e721-3b52-4d11-9ee9-9962b680b3ca service neutron] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:32.657352 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354e721-3b52-4d11-9ee9-9962b680b3ca service neutron] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:32.657623 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354e721-3b52-4d11-9ee9-9962b680b3ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:32.667053 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0354e721-3b52-4d11-9ee9-9962b680b3ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:32.668561 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0354e721-3b52-4d11-9ee9-9962b680b3ca service neutron] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:32.678018 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1237/2483] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:35:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:35:32.947976 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348f45c-32ca-4205-8853-9cdb9ac9ab65 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:32.949949 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-2348f45c-32ca-4205-8853-9cdb9ac9ab65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:32.961915 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348f45c-32ca-4205-8853-9cdb9ac9ab65 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:32.966922 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9959a4-63a9-496b-b7f9-6ec02b0388d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:32.967773 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9959a4-63a9-496b-b7f9-6ec02b0388d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:32.968051 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9959a4-63a9-496b-b7f9-6ec02b0388d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:32.968323 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9959a4-63a9-496b-b7f9-6ec02b0388d5 admin admin] PATH_INFO: `/v3/projects/a28e0978052b416eb3a2bcb2e7fb68ee` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:32.969784 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9959a4-63a9-496b-b7f9-6ec02b0388d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a28e0978052b416eb3a2bcb2e7fb68ee)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:32.971707 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9959a4-63a9-496b-b7f9-6ec02b0388d5 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:33.017285 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-4a9959a4-63a9-496b-b7f9-6ec02b0388d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a28e0978052b416eb3a2bcb2e7fb68ee', 'request_id': 'req-4a9959a4-63a9-496b-b7f9-6ec02b0388d5'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:33.022311 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-4a9959a4-63a9-496b-b7f9-6ec02b0388d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a28e0978052b416eb3a2bcb2e7fb68ee', 'request_id': 'req-4a9959a4-63a9-496b-b7f9-6ec02b0388d5'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:33.028189 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-4a9959a4-63a9-496b-b7f9-6ec02b0388d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a28e0978052b416eb3a2bcb2e7fb68ee', 'request_id': 'req-4a9959a4-63a9-496b-b7f9-6ec02b0388d5'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:33.040337 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-4a9959a4-63a9-496b-b7f9-6ec02b0388d5 admin admin] The token cache is being invalidate because project a28e0978052b416eb3a2bcb2e7fb68ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:35:33.040648 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-4a9959a4-63a9-496b-b7f9-6ec02b0388d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:33.041254 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-4a9959a4-63a9-496b-b7f9-6ec02b0388d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:33.042817 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1247/2484] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:35:32 2022] DELETE /identity/v3/projects/a28e0978052b416eb3a2bcb2e7fb68ee => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:35:33.047337 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354e721-3b52-4d11-9ee9-9962b680b3ca service neutron] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:33.056545 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354e721-3b52-4d11-9ee9-9962b680b3ca service neutron] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:33.110377 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754abb2-1407-4b65-9bd2-525180f1888b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:33.111263 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754abb2-1407-4b65-9bd2-525180f1888b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:33.111547 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754abb2-1407-4b65-9bd2-525180f1888b admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:33.111816 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754abb2-1407-4b65-9bd2-525180f1888b admin admin] PATH_INFO: `/v3/users/1ca23072c3884bef932c8e49bc2ae74b` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:33.112992 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2754abb2-1407-4b65-9bd2-525180f1888b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ca23072c3884bef932c8e49bc2ae74b)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:33.114925 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2754abb2-1407-4b65-9bd2-525180f1888b admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:33.158310 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-2754abb2-1407-4b65-9bd2-525180f1888b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ca23072c3884bef932c8e49bc2ae74b'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:33.158953 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-2754abb2-1407-4b65-9bd2-525180f1888b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ca23072c3884bef932c8e49bc2ae74b'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:33.170766 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-2754abb2-1407-4b65-9bd2-525180f1888b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ca23072c3884bef932c8e49bc2ae74b'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:33.178198 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-2754abb2-1407-4b65-9bd2-525180f1888b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ca23072c3884bef932c8e49bc2ae74b'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:33.185476 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-2754abb2-1407-4b65-9bd2-525180f1888b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ca23072c3884bef932c8e49bc2ae74b'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:33.191117 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1238/2485] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:35:33 2022] DELETE /identity/v3/users/1ca23072c3884bef932c8e49bc2ae74b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:35:33.450767 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9959a4-63a9-496b-b7f9-6ec02b0388d5 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:33.452252 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-4a9959a4-63a9-496b-b7f9-6ec02b0388d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:33.466537 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9959a4-63a9-496b-b7f9-6ec02b0388d5 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:33.524363 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b910416-e817-4e35-a627-c12fac9442cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:33.525204 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b910416-e817-4e35-a627-c12fac9442cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:33.525479 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b910416-e817-4e35-a627-c12fac9442cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:33.525745 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b910416-e817-4e35-a627-c12fac9442cb admin admin] PATH_INFO: `/v3/projects/88a6855c74cc4acca881ca911aa1ac74` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:33.526939 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b910416-e817-4e35-a627-c12fac9442cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=88a6855c74cc4acca881ca911aa1ac74)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:33.528869 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b910416-e817-4e35-a627-c12fac9442cb admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:33.572353 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-1b910416-e817-4e35-a627-c12fac9442cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88a6855c74cc4acca881ca911aa1ac74', 'request_id': 'req-1b910416-e817-4e35-a627-c12fac9442cb'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:33.578222 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-1b910416-e817-4e35-a627-c12fac9442cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88a6855c74cc4acca881ca911aa1ac74', 'request_id': 'req-1b910416-e817-4e35-a627-c12fac9442cb'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:33.584218 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-1b910416-e817-4e35-a627-c12fac9442cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88a6855c74cc4acca881ca911aa1ac74', 'request_id': 'req-1b910416-e817-4e35-a627-c12fac9442cb'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:33.596371 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-1b910416-e817-4e35-a627-c12fac9442cb admin admin] The token cache is being invalidate because project 88a6855c74cc4acca881ca911aa1ac74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:35:33.596727 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-1b910416-e817-4e35-a627-c12fac9442cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:33.597332 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-1b910416-e817-4e35-a627-c12fac9442cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:35:33.598887 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1248/2486] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:35:33 2022] DELETE /identity/v3/projects/88a6855c74cc4acca881ca911aa1ac74 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:35:33.603728 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5035bef-e00b-48b7-83fb-8a3f571b5984 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:33.604222 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5035bef-e00b-48b7-83fb-8a3f571b5984 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:33.604335 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5035bef-e00b-48b7-83fb-8a3f571b5984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:33.622569 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-f5035bef-e00b-48b7-83fb-8a3f571b5984 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:35:33.623781 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-f5035bef-e00b-48b7-83fb-8a3f571b5984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:33.679733 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1239/2487] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:35:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:35:33.688342 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24f6fc-aff5-4bae-8c14-b4b6cef275a0 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:33.688597 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24f6fc-aff5-4bae-8c14-b4b6cef275a0 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:33.688876 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24f6fc-aff5-4bae-8c14-b4b6cef275a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:33.706651 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-ed24f6fc-aff5-4bae-8c14-b4b6cef275a0 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:35:33.707832 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-ed24f6fc-aff5-4bae-8c14-b4b6cef275a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:33.715840 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1249/2488] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:35:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:35:33.719967 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5035bef-e00b-48b7-83fb-8a3f571b5984 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:33.729503 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5035bef-e00b-48b7-83fb-8a3f571b5984 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:33.734681 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ec3cb-61cc-478b-a800-c9b76d3af0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:33.735324 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ec3cb-61cc-478b-a800-c9b76d3af0eb admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:33.735605 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ec3cb-61cc-478b-a800-c9b76d3af0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:33.735874 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ec3cb-61cc-478b-a800-c9b76d3af0eb admin admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:33.736578 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092ec3cb-61cc-478b-a800-c9b76d3af0eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:35:33.736879 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092ec3cb-61cc-478b-a800-c9b76d3af0eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:33.738454 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092ec3cb-61cc-478b-a800-c9b76d3af0eb admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:33.750313 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1240/2489] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:35:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:35:33.754489 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24f6fc-aff5-4bae-8c14-b4b6cef275a0 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:33.763568 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24f6fc-aff5-4bae-8c14-b4b6cef275a0 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:33.768167 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a3a27-60c2-4edf-a254-0ae9fdb0cae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:33.768796 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a3a27-60c2-4edf-a254-0ae9fdb0cae9 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:33.769073 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a3a27-60c2-4edf-a254-0ae9fdb0cae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:33.769347 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a3a27-60c2-4edf-a254-0ae9fdb0cae9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:33.770017 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a3a27-60c2-4edf-a254-0ae9fdb0cae9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:33.771907 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a3a27-60c2-4edf-a254-0ae9fdb0cae9 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:33.796446 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1250/2490] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:35:33 2022] POST /identity/v3/projects => generated 375 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:35:33.800429 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ec3cb-61cc-478b-a800-c9b76d3af0eb admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:33.810858 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ec3cb-61cc-478b-a800-c9b76d3af0eb admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:33.866533 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ad6ef-fe3c-48cb-8a3f-37ba9a6c5072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:33.867220 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ad6ef-fe3c-48cb-8a3f-37ba9a6c5072 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:33.867498 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ad6ef-fe3c-48cb-8a3f-37ba9a6c5072 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:33.867764 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ad6ef-fe3c-48cb-8a3f-37ba9a6c5072 admin admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:33.868437 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ad6ef-fe3c-48cb-8a3f-37ba9a6c5072 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:33.870314 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ad6ef-fe3c-48cb-8a3f-37ba9a6c5072 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:33.890537 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1241/2491] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:35:33 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:35:33.894739 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a3a27-60c2-4edf-a254-0ae9fdb0cae9 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:33.904816 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a3a27-60c2-4edf-a254-0ae9fdb0cae9 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:33.909423 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d5b46-11dd-453e-b806-c44c658f8464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:33.910065 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d5b46-11dd-453e-b806-c44c658f8464 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:33.910346 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d5b46-11dd-453e-b806-c44c658f8464 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:33.910642 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d5b46-11dd-453e-b806-c44c658f8464 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:33.911356 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394d5b46-11dd-453e-b806-c44c658f8464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:33.912921 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394d5b46-11dd-453e-b806-c44c658f8464 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:33.924433 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1251/2492] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:35:33.928252 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ad6ef-fe3c-48cb-8a3f-37ba9a6c5072 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:33.938946 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ad6ef-fe3c-48cb-8a3f-37ba9a6c5072 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:33.943465 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b27b8a-a5df-4260-99a8-962ba4b6a1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:33.944099 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b27b8a-a5df-4260-99a8-962ba4b6a1a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:33.944376 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b27b8a-a5df-4260-99a8-962ba4b6a1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:33.944644 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b27b8a-a5df-4260-99a8-962ba4b6a1a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:33.945347 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b27b8a-a5df-4260-99a8-962ba4b6a1a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:33.946968 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b27b8a-a5df-4260-99a8-962ba4b6a1a3 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:33.957072 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1242/2493] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:35:33.961175 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d5b46-11dd-453e-b806-c44c658f8464 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:33.971699 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d5b46-11dd-453e-b806-c44c658f8464 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:33.976262 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c94ca-d686-458a-aa69-d8d6684d520a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:33.977101 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c94ca-d686-458a-aa69-d8d6684d520a admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:33.977378 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c94ca-d686-458a-aa69-d8d6684d520a admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:33.977646 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c94ca-d686-458a-aa69-d8d6684d520a admin admin] PATH_INFO: `/v3/projects/b5a5680449bd43c988acda3993c5b860/users/f8eb48539524425999d9e4890dc7d4f6/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:33.992073 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c94ca-d686-458a-aa69-d8d6684d520a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5a5680449bd43c988acda3993c5b860, user_id=f8eb48539524425999d9e4890dc7d4f6, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:33.994833 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c94ca-d686-458a-aa69-d8d6684d520a admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:34.007134 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1252/2494] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:35:33 2022] PUT /identity/v3/projects/b5a5680449bd43c988acda3993c5b860/users/f8eb48539524425999d9e4890dc7d4f6/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:35:34.018405 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866f931-6e66-4b8f-b651-929f038190fa None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:34.018752 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866f931-6e66-4b8f-b651-929f038190fa None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:34.019024 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866f931-6e66-4b8f-b651-929f038190fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:34.047449 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-5866f931-6e66-4b8f-b651-929f038190fa None None] MFA Rules not processed for user `f8eb48539524425999d9e4890dc7d4f6`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:35:34.048633 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-5866f931-6e66-4b8f-b651-929f038190fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:34.111622 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1243/2495] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:35:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:35:34.115908 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c94ca-d686-458a-aa69-d8d6684d520a admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:34.175453 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c94ca-d686-458a-aa69-d8d6684d520a admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:34.180073 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54121c15-fe67-45bf-9dc5-ef2ec5b8dbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:34.180715 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54121c15-fe67-45bf-9dc5-ef2ec5b8dbfb admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:34.180989 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54121c15-fe67-45bf-9dc5-ef2ec5b8dbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:34.181256 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54121c15-fe67-45bf-9dc5-ef2ec5b8dbfb admin admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:34.181924 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54121c15-fe67-45bf-9dc5-ef2ec5b8dbfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:34.183847 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54121c15-fe67-45bf-9dc5-ef2ec5b8dbfb admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:34.210492 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1253/2496] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:35:34 2022] POST /identity/v3/projects => generated 375 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:35:34.211900 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866f931-6e66-4b8f-b651-929f038190fa None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:34.224118 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866f931-6e66-4b8f-b651-929f038190fa None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:34.278918 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa47f7-4b62-493c-855c-47d66c79f36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:34.279574 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa47f7-4b62-493c-855c-47d66c79f36c admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:34.279910 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa47f7-4b62-493c-855c-47d66c79f36c admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:34.280185 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa47f7-4b62-493c-855c-47d66c79f36c admin admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:34.280867 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa47f7-4b62-493c-855c-47d66c79f36c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:34.282805 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa47f7-4b62-493c-855c-47d66c79f36c admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:34.302432 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1244/2497] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:35:34 2022] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:35:34.306418 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54121c15-fe67-45bf-9dc5-ef2ec5b8dbfb admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:34.316475 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54121c15-fe67-45bf-9dc5-ef2ec5b8dbfb admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:34.321021 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6a70e-9eaa-4257-ae05-45bfd969e621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:34.321666 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6a70e-9eaa-4257-ae05-45bfd969e621 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:34.321947 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6a70e-9eaa-4257-ae05-45bfd969e621 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:34.322219 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6a70e-9eaa-4257-ae05-45bfd969e621 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:34.322966 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff6a70e-9eaa-4257-ae05-45bfd969e621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:34.325041 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff6a70e-9eaa-4257-ae05-45bfd969e621 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:34.335192 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1254/2498] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:35:34.339155 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa47f7-4b62-493c-855c-47d66c79f36c admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:34.349965 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa47f7-4b62-493c-855c-47d66c79f36c admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:34.354579 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca582443-c4e7-4e11-8602-0831d36978da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:34.355479 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca582443-c4e7-4e11-8602-0831d36978da admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:34.356078 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca582443-c4e7-4e11-8602-0831d36978da admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:34.356213 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca582443-c4e7-4e11-8602-0831d36978da admin admin] PATH_INFO: `/v3/projects/101bf42f3903438f84c3f4dfcc48784a/users/8768ec15c5dc4ccea9d2199367a16293/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:34.370200 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca582443-c4e7-4e11-8602-0831d36978da admin admin] RBAC: Authorizing `identity:create_grant(project_id=101bf42f3903438f84c3f4dfcc48784a, user_id=8768ec15c5dc4ccea9d2199367a16293, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:34.373119 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca582443-c4e7-4e11-8602-0831d36978da admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:34.385098 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1245/2499] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:35:34 2022] PUT /identity/v3/projects/101bf42f3903438f84c3f4dfcc48784a/users/8768ec15c5dc4ccea9d2199367a16293/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:35:34.389606 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6a70e-9eaa-4257-ae05-45bfd969e621 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:34.399577 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6a70e-9eaa-4257-ae05-45bfd969e621 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:34.453764 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d39e83-5f90-4c51-a8aa-85a40a67676f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:34.454417 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d39e83-5f90-4c51-a8aa-85a40a67676f admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:34.454723 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d39e83-5f90-4c51-a8aa-85a40a67676f admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:34.454996 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d39e83-5f90-4c51-a8aa-85a40a67676f admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:34.455703 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d39e83-5f90-4c51-a8aa-85a40a67676f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:34.457263 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d39e83-5f90-4c51-a8aa-85a40a67676f admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:34.468375 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1255/2500] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:35:34.472948 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca582443-c4e7-4e11-8602-0831d36978da admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:34.484068 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca582443-c4e7-4e11-8602-0831d36978da admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:34.488760 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e26d18-00bc-45c8-80bc-49cfd654eba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:34.489619 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e26d18-00bc-45c8-80bc-49cfd654eba0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:34.489897 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e26d18-00bc-45c8-80bc-49cfd654eba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:34.490165 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e26d18-00bc-45c8-80bc-49cfd654eba0 admin admin] PATH_INFO: `/v3/projects/101bf42f3903438f84c3f4dfcc48784a/users/8768ec15c5dc4ccea9d2199367a16293/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:34.492112 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e26d18-00bc-45c8-80bc-49cfd654eba0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=101bf42f3903438f84c3f4dfcc48784a, user_id=8768ec15c5dc4ccea9d2199367a16293, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:34.494827 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e26d18-00bc-45c8-80bc-49cfd654eba0 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:34.506315 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1246/2501] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:35:34 2022] PUT /identity/v3/projects/101bf42f3903438f84c3f4dfcc48784a/users/8768ec15c5dc4ccea9d2199367a16293/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:35:34.517228 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f696cc-8862-414d-9fc0-7bb9436c1c7c None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:34.517515 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f696cc-8862-414d-9fc0-7bb9436c1c7c None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:34.517789 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f696cc-8862-414d-9fc0-7bb9436c1c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:34.544783 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-02f696cc-8862-414d-9fc0-7bb9436c1c7c None None] MFA Rules not processed for user `8768ec15c5dc4ccea9d2199367a16293`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:35:34.545966 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-02f696cc-8862-414d-9fc0-7bb9436c1c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:34.612939 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1256/2502] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:35:34 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:35:34.624207 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e26d18-00bc-45c8-80bc-49cfd654eba0 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:34.625835 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-17e26d18-00bc-45c8-80bc-49cfd654eba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:34.682621 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e26d18-00bc-45c8-80bc-49cfd654eba0 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:34.687392 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89581a1f-8bec-40b8-973e-be4a0952c79a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:34.688758 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89581a1f-8bec-40b8-973e-be4a0952c79a service cinder] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:34.688758 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89581a1f-8bec-40b8-973e-be4a0952c79a service cinder] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:34.688758 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89581a1f-8bec-40b8-973e-be4a0952c79a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:34.743329 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89581a1f-8bec-40b8-973e-be4a0952c79a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:34.744748 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89581a1f-8bec-40b8-973e-be4a0952c79a service cinder] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:34.754401 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1247/2503] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:35:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:35:40.357656 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f696cc-8862-414d-9fc0-7bb9436c1c7c None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:35:40.359202 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-02f696cc-8862-414d-9fc0-7bb9436c1c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:35:40.370967 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f696cc-8862-414d-9fc0-7bb9436c1c7c None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:35:40.375275 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40855588-c454-4ba3-8a44-92779754b650 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:35:40.375907 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40855588-c454-4ba3-8a44-92779754b650 service cinder] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:35:40.376186 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40855588-c454-4ba3-8a44-92779754b650 service cinder] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:35:40.376460 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40855588-c454-4ba3-8a44-92779754b650 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:35:40.385157 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40855588-c454-4ba3-8a44-92779754b650 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:35:40.386569 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40855588-c454-4ba3-8a44-92779754b650 service cinder] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:35:40.395667 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1257/2504] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:35:40 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:36:04.184557 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89581a1f-8bec-40b8-973e-be4a0952c79a service cinder] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:04.245039 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89581a1f-8bec-40b8-973e-be4a0952c79a service cinder] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:04.249767 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da833fb-c7df-43ec-8022-ef830f1f7c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:04.250643 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da833fb-c7df-43ec-8022-ef830f1f7c88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:04.250929 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da833fb-c7df-43ec-8022-ef830f1f7c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:04.251203 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da833fb-c7df-43ec-8022-ef830f1f7c88 admin admin] PATH_INFO: `/v3/users/f8eb48539524425999d9e4890dc7d4f6` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:04.252388 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da833fb-c7df-43ec-8022-ef830f1f7c88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8eb48539524425999d9e4890dc7d4f6)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:04.254304 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da833fb-c7df-43ec-8022-ef830f1f7c88 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:04.301337 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-8da833fb-c7df-43ec-8022-ef830f1f7c88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8eb48539524425999d9e4890dc7d4f6'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:36:04.301986 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-8da833fb-c7df-43ec-8022-ef830f1f7c88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8eb48539524425999d9e4890dc7d4f6'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:36:04.315205 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-8da833fb-c7df-43ec-8022-ef830f1f7c88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8eb48539524425999d9e4890dc7d4f6'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:36:04.322278 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-8da833fb-c7df-43ec-8022-ef830f1f7c88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8eb48539524425999d9e4890dc7d4f6'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:36:04.329503 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-8da833fb-c7df-43ec-8022-ef830f1f7c88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8eb48539524425999d9e4890dc7d4f6'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:36:04.335454 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1248/2505] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:36:04 2022] DELETE /identity/v3/users/f8eb48539524425999d9e4890dc7d4f6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:36:04.340553 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6f354-dce3-4f7d-a558-e7f1eeb0d0fe None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:04.341518 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6f354-dce3-4f7d-a558-e7f1eeb0d0fe None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:04.341518 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6f354-dce3-4f7d-a558-e7f1eeb0d0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:04.359495 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-d7f6f354-dce3-4f7d-a558-e7f1eeb0d0fe None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:36:04.360681 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-d7f6f354-dce3-4f7d-a558-e7f1eeb0d0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:36:04.419123 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1258/2506] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:36:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:36:04.428569 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da833fb-c7df-43ec-8022-ef830f1f7c88 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:04.429985 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-8da833fb-c7df-43ec-8022-ef830f1f7c88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:36:04.488372 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da833fb-c7df-43ec-8022-ef830f1f7c88 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:04.492059 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce43bdd-dc5a-403f-aefa-7cc9c5d61055 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:04.492702 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce43bdd-dc5a-403f-aefa-7cc9c5d61055 service neutron] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:04.492981 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce43bdd-dc5a-403f-aefa-7cc9c5d61055 service neutron] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:04.493256 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce43bdd-dc5a-403f-aefa-7cc9c5d61055 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:04.502062 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce43bdd-dc5a-403f-aefa-7cc9c5d61055 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:04.503499 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce43bdd-dc5a-403f-aefa-7cc9c5d61055 service neutron] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:04.513007 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1249/2507] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:36:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:36:04.784863 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f6f354-dce3-4f7d-a558-e7f1eeb0d0fe None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:04.786401 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-d7f6f354-dce3-4f7d-a558-e7f1eeb0d0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:36:04.798474 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f6f354-dce3-4f7d-a558-e7f1eeb0d0fe None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:04.804579 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a888aff-8ade-49be-90d1-163a364885ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:04.805573 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a888aff-8ade-49be-90d1-163a364885ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:04.805860 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a888aff-8ade-49be-90d1-163a364885ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:04.806133 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a888aff-8ade-49be-90d1-163a364885ae admin admin] PATH_INFO: `/v3/projects/b5a5680449bd43c988acda3993c5b860` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:04.808530 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a888aff-8ade-49be-90d1-163a364885ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5a5680449bd43c988acda3993c5b860)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:04.810461 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a888aff-8ade-49be-90d1-163a364885ae admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:04.860778 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-7a888aff-8ade-49be-90d1-163a364885ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5a5680449bd43c988acda3993c5b860', 'request_id': 'req-7a888aff-8ade-49be-90d1-163a364885ae'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:36:04.866029 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-7a888aff-8ade-49be-90d1-163a364885ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5a5680449bd43c988acda3993c5b860', 'request_id': 'req-7a888aff-8ade-49be-90d1-163a364885ae'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:36:04.872601 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-7a888aff-8ade-49be-90d1-163a364885ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5a5680449bd43c988acda3993c5b860', 'request_id': 'req-7a888aff-8ade-49be-90d1-163a364885ae'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:36:04.884190 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-7a888aff-8ade-49be-90d1-163a364885ae admin admin] The token cache is being invalidate because project b5a5680449bd43c988acda3993c5b860 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:36:04.884472 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-7a888aff-8ade-49be-90d1-163a364885ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:36:04.885083 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-7a888aff-8ade-49be-90d1-163a364885ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:36:04.887186 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1259/2508] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:36:04 2022] DELETE /identity/v3/projects/b5a5680449bd43c988acda3993c5b860 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:36:04.891501 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce43bdd-dc5a-403f-aefa-7cc9c5d61055 service neutron] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:04.901163 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce43bdd-dc5a-403f-aefa-7cc9c5d61055 service neutron] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:04.956169 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3464d8-7640-4f70-ac1c-47d3c54862df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:04.956973 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3464d8-7640-4f70-ac1c-47d3c54862df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:04.957250 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3464d8-7640-4f70-ac1c-47d3c54862df admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:04.957521 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3464d8-7640-4f70-ac1c-47d3c54862df admin admin] PATH_INFO: `/v3/users/8768ec15c5dc4ccea9d2199367a16293` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:04.958730 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3464d8-7640-4f70-ac1c-47d3c54862df admin admin] RBAC: Authorizing `identity:delete_user(user_id=8768ec15c5dc4ccea9d2199367a16293)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:04.960657 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3464d8-7640-4f70-ac1c-47d3c54862df admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:05.004188 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-dc3464d8-7640-4f70-ac1c-47d3c54862df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8768ec15c5dc4ccea9d2199367a16293'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:36:05.004818 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-dc3464d8-7640-4f70-ac1c-47d3c54862df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8768ec15c5dc4ccea9d2199367a16293'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:36:05.017373 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-dc3464d8-7640-4f70-ac1c-47d3c54862df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8768ec15c5dc4ccea9d2199367a16293'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:36:05.023264 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-dc3464d8-7640-4f70-ac1c-47d3c54862df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8768ec15c5dc4ccea9d2199367a16293'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:36:05.030704 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-dc3464d8-7640-4f70-ac1c-47d3c54862df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8768ec15c5dc4ccea9d2199367a16293'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:36:05.036366 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1250/2509] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:36:04 2022] DELETE /identity/v3/users/8768ec15c5dc4ccea9d2199367a16293 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:36:05.799545 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a888aff-8ade-49be-90d1-163a364885ae admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:05.801005 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-7a888aff-8ade-49be-90d1-163a364885ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:36:05.814463 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a888aff-8ade-49be-90d1-163a364885ae admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:05.873582 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6228d9-5b99-4855-8e16-388e894dfa14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:05.874438 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6228d9-5b99-4855-8e16-388e894dfa14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:05.874831 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6228d9-5b99-4855-8e16-388e894dfa14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:05.875036 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6228d9-5b99-4855-8e16-388e894dfa14 admin admin] PATH_INFO: `/v3/projects/101bf42f3903438f84c3f4dfcc48784a` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:05.876301 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6228d9-5b99-4855-8e16-388e894dfa14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=101bf42f3903438f84c3f4dfcc48784a)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:05.878114 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6228d9-5b99-4855-8e16-388e894dfa14 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:05.925929 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-af6228d9-5b99-4855-8e16-388e894dfa14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '101bf42f3903438f84c3f4dfcc48784a', 'request_id': 'req-af6228d9-5b99-4855-8e16-388e894dfa14'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:36:05.931387 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-af6228d9-5b99-4855-8e16-388e894dfa14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '101bf42f3903438f84c3f4dfcc48784a', 'request_id': 'req-af6228d9-5b99-4855-8e16-388e894dfa14'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:36:05.938176 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-af6228d9-5b99-4855-8e16-388e894dfa14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '101bf42f3903438f84c3f4dfcc48784a', 'request_id': 'req-af6228d9-5b99-4855-8e16-388e894dfa14'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:36:05.951634 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-af6228d9-5b99-4855-8e16-388e894dfa14 admin admin] The token cache is being invalidate because project 101bf42f3903438f84c3f4dfcc48784a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:36:05.951922 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-af6228d9-5b99-4855-8e16-388e894dfa14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:36:05.952563 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-af6228d9-5b99-4855-8e16-388e894dfa14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:36:05.954121 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1260/2510] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:36:05 2022] DELETE /identity/v3/projects/101bf42f3903438f84c3f4dfcc48784a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:36:05.959192 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da534c5-e4dd-4536-8252-697817d8c384 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:05.959699 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da534c5-e4dd-4536-8252-697817d8c384 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:05.960084 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da534c5-e4dd-4536-8252-697817d8c384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:05.978942 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-1da534c5-e4dd-4536-8252-697817d8c384 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:36:05.980138 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-1da534c5-e4dd-4536-8252-697817d8c384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:36:06.039960 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1251/2511] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:36:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:36:06.048173 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc10a7-c8d3-4f3c-93b6-f7820eb81463 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:06.048398 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc10a7-c8d3-4f3c-93b6-f7820eb81463 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:06.048684 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc10a7-c8d3-4f3c-93b6-f7820eb81463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:06.069495 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-c9bc10a7-c8d3-4f3c-93b6-f7820eb81463 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:36:06.070934 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-c9bc10a7-c8d3-4f3c-93b6-f7820eb81463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:36:06.080741 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1261/2512] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:36:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:36:06.084982 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da534c5-e4dd-4536-8252-697817d8c384 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:06.096051 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da534c5-e4dd-4536-8252-697817d8c384 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:06.100884 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb29f3-9a82-42c5-b296-2b27c17ff28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:06.101535 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb29f3-9a82-42c5-b296-2b27c17ff28f admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:06.101812 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb29f3-9a82-42c5-b296-2b27c17ff28f admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:06.102081 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb29f3-9a82-42c5-b296-2b27c17ff28f admin admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:06.102819 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb29f3-9a82-42c5-b296-2b27c17ff28f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:36:06.103118 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb29f3-9a82-42c5-b296-2b27c17ff28f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:06.104707 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb29f3-9a82-42c5-b296-2b27c17ff28f admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:06.117547 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1252/2513] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:36:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:36:06.122830 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc10a7-c8d3-4f3c-93b6-f7820eb81463 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:06.132130 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc10a7-c8d3-4f3c-93b6-f7820eb81463 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:06.138124 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268dac3b-a08c-4c38-93a3-7c7a7d655d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:06.138805 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268dac3b-a08c-4c38-93a3-7c7a7d655d20 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:06.139085 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268dac3b-a08c-4c38-93a3-7c7a7d655d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:06.139351 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268dac3b-a08c-4c38-93a3-7c7a7d655d20 admin admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:06.140023 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268dac3b-a08c-4c38-93a3-7c7a7d655d20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:06.141873 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268dac3b-a08c-4c38-93a3-7c7a7d655d20 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:06.171426 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1262/2514] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:36:06 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:36:06.175772 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb29f3-9a82-42c5-b296-2b27c17ff28f admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:06.186487 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb29f3-9a82-42c5-b296-2b27c17ff28f admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:06.244449 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e383fb5c-066f-4db5-a538-8ff5450258d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:06.245115 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e383fb5c-066f-4db5-a538-8ff5450258d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:06.245393 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e383fb5c-066f-4db5-a538-8ff5450258d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:06.245693 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e383fb5c-066f-4db5-a538-8ff5450258d2 admin admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:06.247018 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e383fb5c-066f-4db5-a538-8ff5450258d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:06.248977 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e383fb5c-066f-4db5-a538-8ff5450258d2 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:06.270529 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1253/2515] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:36:06 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:36:06.274474 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268dac3b-a08c-4c38-93a3-7c7a7d655d20 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:06.285338 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268dac3b-a08c-4c38-93a3-7c7a7d655d20 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:06.290365 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2a03b-412b-4f21-b4aa-fd43248f219f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:06.291100 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2a03b-412b-4f21-b4aa-fd43248f219f admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:06.291385 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2a03b-412b-4f21-b4aa-fd43248f219f admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:06.291660 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2a03b-412b-4f21-b4aa-fd43248f219f admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:06.292436 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d2a03b-412b-4f21-b4aa-fd43248f219f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:06.294719 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d2a03b-412b-4f21-b4aa-fd43248f219f admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:06.437823 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1263/2516] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:36:06.442329 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e383fb5c-066f-4db5-a538-8ff5450258d2 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:06.455569 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e383fb5c-066f-4db5-a538-8ff5450258d2 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:06.461200 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27388fdb-4b9d-4809-ae26-58a23c891d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:06.461871 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27388fdb-4b9d-4809-ae26-58a23c891d19 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:06.462159 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27388fdb-4b9d-4809-ae26-58a23c891d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:06.462441 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27388fdb-4b9d-4809-ae26-58a23c891d19 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:06.463552 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27388fdb-4b9d-4809-ae26-58a23c891d19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:06.466740 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27388fdb-4b9d-4809-ae26-58a23c891d19 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:06.484636 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2a03b-412b-4f21-b4aa-fd43248f219f admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:06.485364 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1254/2517] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:36:06.497830 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2a03b-412b-4f21-b4aa-fd43248f219f admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:06.503552 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096faef4-3a30-4feb-8d15-76922b501430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:06.504711 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096faef4-3a30-4feb-8d15-76922b501430 admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:06.505003 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096faef4-3a30-4feb-8d15-76922b501430 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:06.505381 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096faef4-3a30-4feb-8d15-76922b501430 admin admin] PATH_INFO: `/v3/projects/2d692ad6de4f45098cc79dff7e4a6c0a/users/696a87f570f444cfb851fbf943d5bf6d/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:06.521744 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096faef4-3a30-4feb-8d15-76922b501430 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d692ad6de4f45098cc79dff7e4a6c0a, user_id=696a87f570f444cfb851fbf943d5bf6d, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:06.524563 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096faef4-3a30-4feb-8d15-76922b501430 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:06.540065 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1264/2518] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:36:06 2022] PUT /identity/v3/projects/2d692ad6de4f45098cc79dff7e4a6c0a/users/696a87f570f444cfb851fbf943d5bf6d/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:36:06.548292 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3be010-af0b-4026-89d8-6b4cd2be441b None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:06.548586 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3be010-af0b-4026-89d8-6b4cd2be441b None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:06.548858 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3be010-af0b-4026-89d8-6b4cd2be441b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:06.578237 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-7b3be010-af0b-4026-89d8-6b4cd2be441b None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:36:06.580839 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-7b3be010-af0b-4026-89d8-6b4cd2be441b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:36:06.655262 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1255/2519] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:36:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:36:06.662550 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096faef4-3a30-4feb-8d15-76922b501430 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:06.664398 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-096faef4-3a30-4feb-8d15-76922b501430 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:36:06.727330 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096faef4-3a30-4feb-8d15-76922b501430 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:06.734655 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d2cef-a0b3-46d9-ae06-f1bd19381412 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:06.735080 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d2cef-a0b3-46d9-ae06-f1bd19381412 service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:06.735364 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d2cef-a0b3-46d9-ae06-f1bd19381412 service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:06.735637 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d2cef-a0b3-46d9-ae06-f1bd19381412 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:06.745636 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d2cef-a0b3-46d9-ae06-f1bd19381412 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:06.747291 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d2cef-a0b3-46d9-ae06-f1bd19381412 service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:06.758887 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1265/2520] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:36:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:36:07.443500 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53a615-bbc4-40fb-8778-fe4af0bd151b None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:07.444060 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53a615-bbc4-40fb-8778-fe4af0bd151b None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:07.444060 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53a615-bbc4-40fb-8778-fe4af0bd151b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:07.471749 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-4c53a615-bbc4-40fb-8778-fe4af0bd151b None None] MFA Rules not processed for user `696a87f570f444cfb851fbf943d5bf6d`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:36:07.472953 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-4c53a615-bbc4-40fb-8778-fe4af0bd151b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:36:07.540056 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1256/2521] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:36:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:36:07.545200 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d2cef-a0b3-46d9-ae06-f1bd19381412 service neutron] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:07.554768 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d2cef-a0b3-46d9-ae06-f1bd19381412 service neutron] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:07.560216 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba78437-0e99-4856-af82-3437579f7a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:07.561152 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba78437-0e99-4856-af82-3437579f7a69 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:07.561443 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba78437-0e99-4856-af82-3437579f7a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:07.561715 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba78437-0e99-4856-af82-3437579f7a69 admin admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:07.562591 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba78437-0e99-4856-af82-3437579f7a69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:07.564982 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba78437-0e99-4856-af82-3437579f7a69 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:07.595732 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1266/2522] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:36:07 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:36:07.599792 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53a615-bbc4-40fb-8778-fe4af0bd151b None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:07.618570 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53a615-bbc4-40fb-8778-fe4af0bd151b None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:07.701434 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a71c54-2ab1-420c-a815-0400a24bdecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:07.702315 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a71c54-2ab1-420c-a815-0400a24bdecd admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:07.702801 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a71c54-2ab1-420c-a815-0400a24bdecd admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:07.703150 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a71c54-2ab1-420c-a815-0400a24bdecd admin admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:07.703903 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a71c54-2ab1-420c-a815-0400a24bdecd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:07.706512 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a71c54-2ab1-420c-a815-0400a24bdecd admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:07.730035 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1257/2523] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:36:07 2022] POST /identity/v3/users => generated 293 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:36:07.734020 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba78437-0e99-4856-af82-3437579f7a69 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:07.744744 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba78437-0e99-4856-af82-3437579f7a69 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:07.750284 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372bb32c-ec8b-445d-902b-0eac73916e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:07.751053 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bb32c-ec8b-445d-902b-0eac73916e0d admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:07.751386 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bb32c-ec8b-445d-902b-0eac73916e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:07.751664 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bb32c-ec8b-445d-902b-0eac73916e0d admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:07.752389 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372bb32c-ec8b-445d-902b-0eac73916e0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:07.754153 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372bb32c-ec8b-445d-902b-0eac73916e0d admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:07.765954 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1267/2524] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:36:07.770294 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a71c54-2ab1-420c-a815-0400a24bdecd admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:07.782099 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a71c54-2ab1-420c-a815-0400a24bdecd admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:07.787216 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca7740-2734-4879-89b9-52a75bd1cd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:07.788282 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca7740-2734-4879-89b9-52a75bd1cd85 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:07.788659 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca7740-2734-4879-89b9-52a75bd1cd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:07.789000 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca7740-2734-4879-89b9-52a75bd1cd85 admin admin] PATH_INFO: `/v3/projects/0cd9ff41eac9441881d91564c248685b/users/ffdb777050e344c2b78d97f8a36cf0e9/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:07.808263 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fca7740-2734-4879-89b9-52a75bd1cd85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cd9ff41eac9441881d91564c248685b, user_id=ffdb777050e344c2b78d97f8a36cf0e9, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:07.817194 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fca7740-2734-4879-89b9-52a75bd1cd85 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:07.831902 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1258/2525] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:36:07 2022] PUT /identity/v3/projects/0cd9ff41eac9441881d91564c248685b/users/ffdb777050e344c2b78d97f8a36cf0e9/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:36:07.835726 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372bb32c-ec8b-445d-902b-0eac73916e0d admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:07.847527 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372bb32c-ec8b-445d-902b-0eac73916e0d admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:07.909380 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c1f60-5157-496a-b4ac-54e843a58599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:07.910060 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c1f60-5157-496a-b4ac-54e843a58599 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:07.910339 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c1f60-5157-496a-b4ac-54e843a58599 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:07.910626 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c1f60-5157-496a-b4ac-54e843a58599 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:07.911376 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c1f60-5157-496a-b4ac-54e843a58599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:07.913121 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c1f60-5157-496a-b4ac-54e843a58599 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:07.925523 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1268/2526] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:36:07.929574 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca7740-2734-4879-89b9-52a75bd1cd85 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:07.941481 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca7740-2734-4879-89b9-52a75bd1cd85 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:07.946337 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10d69a-bd20-417f-9a3b-fa69ea428119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:07.947254 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10d69a-bd20-417f-9a3b-fa69ea428119 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:07.947536 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10d69a-bd20-417f-9a3b-fa69ea428119 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:07.947808 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10d69a-bd20-417f-9a3b-fa69ea428119 admin admin] PATH_INFO: `/v3/projects/0cd9ff41eac9441881d91564c248685b/users/ffdb777050e344c2b78d97f8a36cf0e9/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:07.950677 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10d69a-bd20-417f-9a3b-fa69ea428119 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cd9ff41eac9441881d91564c248685b, user_id=ffdb777050e344c2b78d97f8a36cf0e9, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:07.953332 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10d69a-bd20-417f-9a3b-fa69ea428119 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:07.964388 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1259/2527] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:36:07 2022] PUT /identity/v3/projects/0cd9ff41eac9441881d91564c248685b/users/ffdb777050e344c2b78d97f8a36cf0e9/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:36:08.707791 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214e9b9-9ac5-49eb-9d17-e311f28ee162 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:08.708356 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214e9b9-9ac5-49eb-9d17-e311f28ee162 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:08.708568 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214e9b9-9ac5-49eb-9d17-e311f28ee162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:08.755097 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-7214e9b9-9ac5-49eb-9d17-e311f28ee162 None None] MFA Rules not processed for user `ffdb777050e344c2b78d97f8a36cf0e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:36:08.758799 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-7214e9b9-9ac5-49eb-9d17-e311f28ee162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:36:08.878658 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1269/2528] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:36:08 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:36:08.892525 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10d69a-bd20-417f-9a3b-fa69ea428119 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:08.895597 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-ba10d69a-bd20-417f-9a3b-fa69ea428119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:36:08.977134 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10d69a-bd20-417f-9a3b-fa69ea428119 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:08.981354 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5be579-4eaa-445c-93ca-dbcffae6b052 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:08.982032 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5be579-4eaa-445c-93ca-dbcffae6b052 service cinder] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:08.982318 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5be579-4eaa-445c-93ca-dbcffae6b052 service cinder] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:08.982590 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5be579-4eaa-445c-93ca-dbcffae6b052 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:09.043395 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5be579-4eaa-445c-93ca-dbcffae6b052 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:09.044702 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5be579-4eaa-445c-93ca-dbcffae6b052 service cinder] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:09.054452 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1260/2529] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:36:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:36:10.450491 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214e9b9-9ac5-49eb-9d17-e311f28ee162 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:10.452688 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-7214e9b9-9ac5-49eb-9d17-e311f28ee162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:36:10.466586 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214e9b9-9ac5-49eb-9d17-e311f28ee162 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:10.471068 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c524665-310b-479c-bbff-90dcc7784b8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:10.472261 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c524665-310b-479c-bbff-90dcc7784b8b service cinder] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:10.472754 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c524665-310b-479c-bbff-90dcc7784b8b service cinder] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:10.473247 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c524665-310b-479c-bbff-90dcc7784b8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:10.485637 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c524665-310b-479c-bbff-90dcc7784b8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:10.487400 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c524665-310b-479c-bbff-90dcc7784b8b service cinder] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:10.500187 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1270/2530] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:36:10 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:36:11.070727 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236eadbf-f79b-4a91-bd7f-919cda23c65c None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:11.071213 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236eadbf-f79b-4a91-bd7f-919cda23c65c None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:11.071328 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236eadbf-f79b-4a91-bd7f-919cda23c65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:11.088279 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-236eadbf-f79b-4a91-bd7f-919cda23c65c None None] MFA Rules not processed for user `da9524bba20140f694ac7cd6e8f37038`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:36:11.089464 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-236eadbf-f79b-4a91-bd7f-919cda23c65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:36:11.143691 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1261/2531] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:36:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:36:21.408182 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32cf21f-850c-4f7f-93d1-9a4ae073960b None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:21.408800 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32cf21f-850c-4f7f-93d1-9a4ae073960b None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:21.409023 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32cf21f-850c-4f7f-93d1-9a4ae073960b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:21.427087 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-c32cf21f-850c-4f7f-93d1-9a4ae073960b None None] MFA Rules not processed for user `9f32c16ee62d441d9e5fde2b1ce0afaf`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:36:21.428434 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-c32cf21f-850c-4f7f-93d1-9a4ae073960b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:36:21.483600 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1271/2532] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:36:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:36:23.770373 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236eadbf-f79b-4a91-bd7f-919cda23c65c None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:23.882755 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236eadbf-f79b-4a91-bd7f-919cda23c65c None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:23.889020 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba19df17-ba12-4cc3-a61a-f0457b18c0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:23.890371 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19df17-ba12-4cc3-a61a-f0457b18c0f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:23.890833 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19df17-ba12-4cc3-a61a-f0457b18c0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:23.891334 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19df17-ba12-4cc3-a61a-f0457b18c0f4 admin admin] PATH_INFO: `/v3/users/696a87f570f444cfb851fbf943d5bf6d` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:23.893115 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba19df17-ba12-4cc3-a61a-f0457b18c0f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=696a87f570f444cfb851fbf943d5bf6d)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:23.895236 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba19df17-ba12-4cc3-a61a-f0457b18c0f4 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:23.953814 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-ba19df17-ba12-4cc3-a61a-f0457b18c0f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '696a87f570f444cfb851fbf943d5bf6d'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:36:23.955436 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-ba19df17-ba12-4cc3-a61a-f0457b18c0f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '696a87f570f444cfb851fbf943d5bf6d'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:36:23.969818 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-ba19df17-ba12-4cc3-a61a-f0457b18c0f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '696a87f570f444cfb851fbf943d5bf6d'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:36:23.983226 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-ba19df17-ba12-4cc3-a61a-f0457b18c0f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '696a87f570f444cfb851fbf943d5bf6d'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:36:23.993109 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-ba19df17-ba12-4cc3-a61a-f0457b18c0f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '696a87f570f444cfb851fbf943d5bf6d'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:36:24.007383 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1262/2533] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:36:23 2022] DELETE /identity/v3/users/696a87f570f444cfb851fbf943d5bf6d => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:36:24.446586 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32cf21f-850c-4f7f-93d1-9a4ae073960b None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:24.460961 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32cf21f-850c-4f7f-93d1-9a4ae073960b None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:24.545624 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a997ac-8d92-48fb-8c52-5a271b7d0aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:24.546805 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a997ac-8d92-48fb-8c52-5a271b7d0aed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:24.547085 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a997ac-8d92-48fb-8c52-5a271b7d0aed admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:24.547359 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a997ac-8d92-48fb-8c52-5a271b7d0aed admin admin] PATH_INFO: `/v3/projects/2d692ad6de4f45098cc79dff7e4a6c0a` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:24.548558 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a997ac-8d92-48fb-8c52-5a271b7d0aed admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d692ad6de4f45098cc79dff7e4a6c0a)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:24.550441 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a997ac-8d92-48fb-8c52-5a271b7d0aed admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:24.602306 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-c7a997ac-8d92-48fb-8c52-5a271b7d0aed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d692ad6de4f45098cc79dff7e4a6c0a', 'request_id': 'req-c7a997ac-8d92-48fb-8c52-5a271b7d0aed'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:36:24.609015 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-c7a997ac-8d92-48fb-8c52-5a271b7d0aed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d692ad6de4f45098cc79dff7e4a6c0a', 'request_id': 'req-c7a997ac-8d92-48fb-8c52-5a271b7d0aed'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:36:24.615449 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-c7a997ac-8d92-48fb-8c52-5a271b7d0aed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d692ad6de4f45098cc79dff7e4a6c0a', 'request_id': 'req-c7a997ac-8d92-48fb-8c52-5a271b7d0aed'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:36:24.630521 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-c7a997ac-8d92-48fb-8c52-5a271b7d0aed admin admin] The token cache is being invalidate because project 2d692ad6de4f45098cc79dff7e4a6c0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:36:24.630841 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-c7a997ac-8d92-48fb-8c52-5a271b7d0aed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:36:24.631471 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-c7a997ac-8d92-48fb-8c52-5a271b7d0aed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:36:24.633286 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1272/2534] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:36:24 2022] DELETE /identity/v3/projects/2d692ad6de4f45098cc79dff7e4a6c0a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:36:24.637464 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba19df17-ba12-4cc3-a61a-f0457b18c0f4 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:24.638688 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-ba19df17-ba12-4cc3-a61a-f0457b18c0f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:36:24.654033 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba19df17-ba12-4cc3-a61a-f0457b18c0f4 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:24.723617 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04eed1-874e-4fc4-b31a-bb21fd23331b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:24.724515 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04eed1-874e-4fc4-b31a-bb21fd23331b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:24.724795 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04eed1-874e-4fc4-b31a-bb21fd23331b admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:24.725064 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04eed1-874e-4fc4-b31a-bb21fd23331b admin admin] PATH_INFO: `/v3/users/ffdb777050e344c2b78d97f8a36cf0e9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:24.726447 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04eed1-874e-4fc4-b31a-bb21fd23331b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffdb777050e344c2b78d97f8a36cf0e9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:24.728621 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04eed1-874e-4fc4-b31a-bb21fd23331b admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:24.777901 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-ba04eed1-874e-4fc4-b31a-bb21fd23331b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffdb777050e344c2b78d97f8a36cf0e9'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:36:24.778533 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-ba04eed1-874e-4fc4-b31a-bb21fd23331b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffdb777050e344c2b78d97f8a36cf0e9'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:36:24.790488 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-ba04eed1-874e-4fc4-b31a-bb21fd23331b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffdb777050e344c2b78d97f8a36cf0e9'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:36:24.798647 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-ba04eed1-874e-4fc4-b31a-bb21fd23331b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffdb777050e344c2b78d97f8a36cf0e9'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:36:24.805530 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-ba04eed1-874e-4fc4-b31a-bb21fd23331b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffdb777050e344c2b78d97f8a36cf0e9'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:36:24.812468 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1263/2535] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:36:24 2022] DELETE /identity/v3/users/ffdb777050e344c2b78d97f8a36cf0e9 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:36:25.029148 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a997ac-8d92-48fb-8c52-5a271b7d0aed admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:25.031023 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-c7a997ac-8d92-48fb-8c52-5a271b7d0aed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:36:25.045895 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a997ac-8d92-48fb-8c52-5a271b7d0aed admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:25.118761 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dba00e-5993-4f8c-8faf-aa0fec71ab82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:25.119609 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dba00e-5993-4f8c-8faf-aa0fec71ab82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:25.119892 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dba00e-5993-4f8c-8faf-aa0fec71ab82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:25.120161 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dba00e-5993-4f8c-8faf-aa0fec71ab82 admin admin] PATH_INFO: `/v3/projects/0cd9ff41eac9441881d91564c248685b` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:25.121390 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dba00e-5993-4f8c-8faf-aa0fec71ab82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cd9ff41eac9441881d91564c248685b)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:25.124554 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dba00e-5993-4f8c-8faf-aa0fec71ab82 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:25.190970 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-c3dba00e-5993-4f8c-8faf-aa0fec71ab82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cd9ff41eac9441881d91564c248685b', 'request_id': 'req-c3dba00e-5993-4f8c-8faf-aa0fec71ab82'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:36:25.198751 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-c3dba00e-5993-4f8c-8faf-aa0fec71ab82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cd9ff41eac9441881d91564c248685b', 'request_id': 'req-c3dba00e-5993-4f8c-8faf-aa0fec71ab82'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:36:25.209092 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-c3dba00e-5993-4f8c-8faf-aa0fec71ab82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cd9ff41eac9441881d91564c248685b', 'request_id': 'req-c3dba00e-5993-4f8c-8faf-aa0fec71ab82'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:36:25.232055 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-c3dba00e-5993-4f8c-8faf-aa0fec71ab82 admin admin] The token cache is being invalidate because project 0cd9ff41eac9441881d91564c248685b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:36:25.232508 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-c3dba00e-5993-4f8c-8faf-aa0fec71ab82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:36:25.233396 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-c3dba00e-5993-4f8c-8faf-aa0fec71ab82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:36:25.235392 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1273/2536] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:36:25 2022] DELETE /identity/v3/projects/0cd9ff41eac9441881d91564c248685b => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:36:25.240115 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5004cc7-2fb7-4cab-8e65-42ab235d5132 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:25.240644 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5004cc7-2fb7-4cab-8e65-42ab235d5132 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:25.240996 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5004cc7-2fb7-4cab-8e65-42ab235d5132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:25.260464 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-c5004cc7-2fb7-4cab-8e65-42ab235d5132 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:36:25.262108 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-c5004cc7-2fb7-4cab-8e65-42ab235d5132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:36:25.329023 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1264/2537] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:36:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:36:25.338126 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f85dd4-1927-49dc-9e6c-38cb8375a76d None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:25.338407 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f85dd4-1927-49dc-9e6c-38cb8375a76d None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:25.338855 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f85dd4-1927-49dc-9e6c-38cb8375a76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:25.360377 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-b2f85dd4-1927-49dc-9e6c-38cb8375a76d None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:36:25.361817 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-b2f85dd4-1927-49dc-9e6c-38cb8375a76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:36:25.369961 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1274/2538] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:36:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:36:25.374815 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5004cc7-2fb7-4cab-8e65-42ab235d5132 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:25.385216 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5004cc7-2fb7-4cab-8e65-42ab235d5132 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:25.390465 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52aeab-54b9-4b8a-8d9d-ced0f30ed61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:25.391191 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52aeab-54b9-4b8a-8d9d-ced0f30ed61d admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:25.391688 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52aeab-54b9-4b8a-8d9d-ced0f30ed61d admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:25.392126 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52aeab-54b9-4b8a-8d9d-ced0f30ed61d admin admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:25.392855 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a52aeab-54b9-4b8a-8d9d-ced0f30ed61d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:36:25.393258 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a52aeab-54b9-4b8a-8d9d-ced0f30ed61d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:25.394915 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a52aeab-54b9-4b8a-8d9d-ced0f30ed61d admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:25.409458 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1265/2539] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:36:25.414152 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f85dd4-1927-49dc-9e6c-38cb8375a76d None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:25.424802 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f85dd4-1927-49dc-9e6c-38cb8375a76d None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:25.432176 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6f962-3f0d-4610-8551-122869c2d522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:25.435293 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6f962-3f0d-4610-8551-122869c2d522 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:25.435484 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6f962-3f0d-4610-8551-122869c2d522 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:25.435766 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6f962-3f0d-4610-8551-122869c2d522 admin admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:25.436479 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b6f962-3f0d-4610-8551-122869c2d522 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:25.439627 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b6f962-3f0d-4610-8551-122869c2d522 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:25.480573 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1275/2540] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:36:25 2022] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:36:25.485873 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52aeab-54b9-4b8a-8d9d-ced0f30ed61d admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:25.498144 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52aeab-54b9-4b8a-8d9d-ced0f30ed61d admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:25.572952 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa4aad-ea9a-4184-8bf2-960a12a54eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:25.575328 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa4aad-ea9a-4184-8bf2-960a12a54eb1 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:25.575763 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa4aad-ea9a-4184-8bf2-960a12a54eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:25.576185 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa4aad-ea9a-4184-8bf2-960a12a54eb1 admin admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:25.577128 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa4aad-ea9a-4184-8bf2-960a12a54eb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:25.579522 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa4aad-ea9a-4184-8bf2-960a12a54eb1 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:25.615259 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1266/2541] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:36:25 2022] POST /identity/v3/users => generated 289 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:36:25.616540 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6f962-3f0d-4610-8551-122869c2d522 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:25.633058 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6f962-3f0d-4610-8551-122869c2d522 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:25.644791 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b501ea8-ed53-4da7-aac2-a3b52be3d74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:25.646255 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b501ea8-ed53-4da7-aac2-a3b52be3d74a admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:25.647782 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b501ea8-ed53-4da7-aac2-a3b52be3d74a admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:25.648562 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b501ea8-ed53-4da7-aac2-a3b52be3d74a admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:25.650354 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b501ea8-ed53-4da7-aac2-a3b52be3d74a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:25.653677 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b501ea8-ed53-4da7-aac2-a3b52be3d74a admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:25.680086 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1276/2542] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:36:25.685656 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa4aad-ea9a-4184-8bf2-960a12a54eb1 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:25.699616 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa4aad-ea9a-4184-8bf2-960a12a54eb1 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:25.707854 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372a145-cf30-4fe9-8d2c-1ebaad135a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:25.708777 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372a145-cf30-4fe9-8d2c-1ebaad135a2b admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:25.709292 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372a145-cf30-4fe9-8d2c-1ebaad135a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:25.709824 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372a145-cf30-4fe9-8d2c-1ebaad135a2b admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:25.710772 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372a145-cf30-4fe9-8d2c-1ebaad135a2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:25.712922 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372a145-cf30-4fe9-8d2c-1ebaad135a2b admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:25.733774 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1267/2543] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:36:25.737868 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b501ea8-ed53-4da7-aac2-a3b52be3d74a admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:25.751098 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b501ea8-ed53-4da7-aac2-a3b52be3d74a admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:25.756472 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfafcd2-18db-40f8-877f-007a167fce67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:25.764693 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfafcd2-18db-40f8-877f-007a167fce67 admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:25.765264 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfafcd2-18db-40f8-877f-007a167fce67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:25.766348 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfafcd2-18db-40f8-877f-007a167fce67 admin admin] PATH_INFO: `/v3/projects/d180a54c26294bdcbc32c440c401df76/users/85806747eee440ae8d73b4981837fb22/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:25.789487 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfafcd2-18db-40f8-877f-007a167fce67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d180a54c26294bdcbc32c440c401df76, user_id=85806747eee440ae8d73b4981837fb22, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:25.792361 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfafcd2-18db-40f8-877f-007a167fce67 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:25.812246 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1277/2544] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:36:25 2022] PUT /identity/v3/projects/d180a54c26294bdcbc32c440c401df76/users/85806747eee440ae8d73b4981837fb22/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:36:25.823404 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21471c9-1f2d-4294-a772-0ac27b9050ea None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:25.824477 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21471c9-1f2d-4294-a772-0ac27b9050ea None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:25.824477 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21471c9-1f2d-4294-a772-0ac27b9050ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:25.865283 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-b21471c9-1f2d-4294-a772-0ac27b9050ea None None] MFA Rules not processed for user `85806747eee440ae8d73b4981837fb22`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:36:25.866685 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-b21471c9-1f2d-4294-a772-0ac27b9050ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:36:25.934807 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1268/2545] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:36:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:36:25.945791 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfafcd2-18db-40f8-877f-007a167fce67 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:25.947514 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-fdfafcd2-18db-40f8-877f-007a167fce67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:36:26.029184 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfafcd2-18db-40f8-877f-007a167fce67 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:26.033512 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae06268-508f-48f5-a1b3-5f9bd90126e4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99b63b9b6e44219921569db1bf2e0dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:26.034050 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae06268-508f-48f5-a1b3-5f9bd90126e4 service glance] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:26.034331 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae06268-508f-48f5-a1b3-5f9bd90126e4 service glance] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:26.034621 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae06268-508f-48f5-a1b3-5f9bd90126e4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:26.043638 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae06268-508f-48f5-a1b3-5f9bd90126e4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:26.045052 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae06268-508f-48f5-a1b3-5f9bd90126e4 service glance] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:26.053801 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1278/2546] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:36:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:36:35.404258 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21471c9-1f2d-4294-a772-0ac27b9050ea None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:35.405623 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-b21471c9-1f2d-4294-a772-0ac27b9050ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:36:35.460845 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21471c9-1f2d-4294-a772-0ac27b9050ea None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:35.464378 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4fa66a-a723-492b-aca7-7f13988ff02e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:35.465124 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fa66a-a723-492b-aca7-7f13988ff02e service cinder] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:35.465405 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fa66a-a723-492b-aca7-7f13988ff02e service cinder] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:35.465679 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fa66a-a723-492b-aca7-7f13988ff02e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:35.467685 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-3c4fa66a-a723-492b-aca7-7f13988ff02e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:36:35.537060 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4fa66a-a723-492b-aca7-7f13988ff02e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:35.538469 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4fa66a-a723-492b-aca7-7f13988ff02e service cinder] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:35.553412 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1269/2547] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:36:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:36:43.630285 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae06268-508f-48f5-a1b3-5f9bd90126e4 service glance] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:43.696277 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae06268-508f-48f5-a1b3-5f9bd90126e4 service glance] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:43.701822 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0331e32-495d-4a43-a0e5-fe43f3708bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:43.702746 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0331e32-495d-4a43-a0e5-fe43f3708bf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:43.703025 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0331e32-495d-4a43-a0e5-fe43f3708bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:43.703299 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0331e32-495d-4a43-a0e5-fe43f3708bf7 admin admin] PATH_INFO: `/v3/users/85806747eee440ae8d73b4981837fb22` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:43.704515 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0331e32-495d-4a43-a0e5-fe43f3708bf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85806747eee440ae8d73b4981837fb22)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:43.706406 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0331e32-495d-4a43-a0e5-fe43f3708bf7 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:43.752821 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-b0331e32-495d-4a43-a0e5-fe43f3708bf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85806747eee440ae8d73b4981837fb22'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:36:43.759889 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-b0331e32-495d-4a43-a0e5-fe43f3708bf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85806747eee440ae8d73b4981837fb22'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:36:43.760497 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-b0331e32-495d-4a43-a0e5-fe43f3708bf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85806747eee440ae8d73b4981837fb22'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:36:43.772200 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-b0331e32-495d-4a43-a0e5-fe43f3708bf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85806747eee440ae8d73b4981837fb22'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:36:43.779088 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-b0331e32-495d-4a43-a0e5-fe43f3708bf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85806747eee440ae8d73b4981837fb22'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:36:43.784771 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1279/2548] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:36:43 2022] DELETE /identity/v3/users/85806747eee440ae8d73b4981837fb22 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:36:43.789378 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142a221-b794-476e-8daf-376697af8567 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:43.789880 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142a221-b794-476e-8daf-376697af8567 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:43.789983 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142a221-b794-476e-8daf-376697af8567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:43.807054 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-3142a221-b794-476e-8daf-376697af8567 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:36:43.808879 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-3142a221-b794-476e-8daf-376697af8567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:36:43.865713 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1270/2549] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:36:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:36:43.875858 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0331e32-495d-4a43-a0e5-fe43f3708bf7 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:43.877317 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-b0331e32-495d-4a43-a0e5-fe43f3708bf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:36:43.932223 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0331e32-495d-4a43-a0e5-fe43f3708bf7 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:43.936457 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b0647-817c-402d-8eff-3c05058fde48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:43.937092 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b0647-817c-402d-8eff-3c05058fde48 service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:43.937375 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b0647-817c-402d-8eff-3c05058fde48 service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:43.937654 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b0647-817c-402d-8eff-3c05058fde48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:43.946520 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0b0647-817c-402d-8eff-3c05058fde48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:43.947955 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0b0647-817c-402d-8eff-3c05058fde48 service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:43.957363 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1280/2550] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:36:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:36:44.220408 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142a221-b794-476e-8daf-376697af8567 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:44.221902 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-3142a221-b794-476e-8daf-376697af8567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:36:44.234803 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142a221-b794-476e-8daf-376697af8567 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:44.239476 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567cbae-b071-40cb-ba44-fe64fe7feca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:44.240414 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567cbae-b071-40cb-ba44-fe64fe7feca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:44.241274 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567cbae-b071-40cb-ba44-fe64fe7feca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:44.241613 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567cbae-b071-40cb-ba44-fe64fe7feca5 admin admin] PATH_INFO: `/v3/projects/d180a54c26294bdcbc32c440c401df76` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:44.242956 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567cbae-b071-40cb-ba44-fe64fe7feca5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d180a54c26294bdcbc32c440c401df76)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:44.244948 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567cbae-b071-40cb-ba44-fe64fe7feca5 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:44.294554 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-7567cbae-b071-40cb-ba44-fe64fe7feca5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd180a54c26294bdcbc32c440c401df76', 'request_id': 'req-7567cbae-b071-40cb-ba44-fe64fe7feca5'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:36:44.299919 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-7567cbae-b071-40cb-ba44-fe64fe7feca5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd180a54c26294bdcbc32c440c401df76', 'request_id': 'req-7567cbae-b071-40cb-ba44-fe64fe7feca5'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:36:44.305804 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-7567cbae-b071-40cb-ba44-fe64fe7feca5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd180a54c26294bdcbc32c440c401df76', 'request_id': 'req-7567cbae-b071-40cb-ba44-fe64fe7feca5'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:36:44.321511 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-7567cbae-b071-40cb-ba44-fe64fe7feca5 admin admin] The token cache is being invalidate because project d180a54c26294bdcbc32c440c401df76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:36:44.321792 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-7567cbae-b071-40cb-ba44-fe64fe7feca5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:36:44.322400 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-7567cbae-b071-40cb-ba44-fe64fe7feca5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:36:44.324512 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1271/2551] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:36:44 2022] DELETE /identity/v3/projects/d180a54c26294bdcbc32c440c401df76 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:36:44.331028 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05256524-cb76-4cf8-af9c-d838832d32d4 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:44.331323 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05256524-cb76-4cf8-af9c-d838832d32d4 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:44.331599 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05256524-cb76-4cf8-af9c-d838832d32d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:44.349365 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-05256524-cb76-4cf8-af9c-d838832d32d4 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:36:44.350559 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-05256524-cb76-4cf8-af9c-d838832d32d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:36:44.407518 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1281/2552] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:36:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:36:44.415673 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d9602-86b0-4d75-8b75-5ead9ef2a198 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:44.415957 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d9602-86b0-4d75-8b75-5ead9ef2a198 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:44.416230 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d9602-86b0-4d75-8b75-5ead9ef2a198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:44.439961 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-868d9602-86b0-4d75-8b75-5ead9ef2a198 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:36:44.441139 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-868d9602-86b0-4d75-8b75-5ead9ef2a198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:36:44.449649 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1272/2553] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:36:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:36:44.453816 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05256524-cb76-4cf8-af9c-d838832d32d4 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:44.463413 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05256524-cb76-4cf8-af9c-d838832d32d4 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:44.468791 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096eee7-ea2f-4ba6-a16f-fe756c7a5f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:44.469427 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096eee7-ea2f-4ba6-a16f-fe756c7a5f30 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:44.469729 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096eee7-ea2f-4ba6-a16f-fe756c7a5f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:44.470002 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096eee7-ea2f-4ba6-a16f-fe756c7a5f30 admin admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:44.470750 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9096eee7-ea2f-4ba6-a16f-fe756c7a5f30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:36:44.471053 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9096eee7-ea2f-4ba6-a16f-fe756c7a5f30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:44.472625 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9096eee7-ea2f-4ba6-a16f-fe756c7a5f30 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:44.483660 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1282/2554] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:36:44.487652 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d9602-86b0-4d75-8b75-5ead9ef2a198 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:44.496889 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d9602-86b0-4d75-8b75-5ead9ef2a198 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:44.501683 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a223c852-22ff-42e9-95de-7b7139b69a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:44.502318 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223c852-22ff-42e9-95de-7b7139b69a43 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:44.502652 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223c852-22ff-42e9-95de-7b7139b69a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:44.502926 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223c852-22ff-42e9-95de-7b7139b69a43 admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:44.503596 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a223c852-22ff-42e9-95de-7b7139b69a43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:44.505452 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a223c852-22ff-42e9-95de-7b7139b69a43 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:44.531037 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1273/2555] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:36:44 2022] POST /identity/v3/projects => generated 379 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:36:44.535194 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096eee7-ea2f-4ba6-a16f-fe756c7a5f30 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:44.546127 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096eee7-ea2f-4ba6-a16f-fe756c7a5f30 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:44.601905 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326d72a-f264-499f-a112-eb7e9d42aa82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:44.602561 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326d72a-f264-499f-a112-eb7e9d42aa82 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:44.602869 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326d72a-f264-499f-a112-eb7e9d42aa82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:44.603144 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326d72a-f264-499f-a112-eb7e9d42aa82 admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:44.603844 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3326d72a-f264-499f-a112-eb7e9d42aa82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:44.606290 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3326d72a-f264-499f-a112-eb7e9d42aa82 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:44.632478 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1283/2556] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:36:44 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:36:44.633647 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a223c852-22ff-42e9-95de-7b7139b69a43 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:44.643799 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a223c852-22ff-42e9-95de-7b7139b69a43 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:44.648497 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5876f-d716-44ee-822b-237540984c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:44.649046 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5876f-d716-44ee-822b-237540984c97 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:44.649330 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5876f-d716-44ee-822b-237540984c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:44.649710 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5876f-d716-44ee-822b-237540984c97 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:44.650437 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd5876f-d716-44ee-822b-237540984c97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:44.652124 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd5876f-d716-44ee-822b-237540984c97 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:44.663084 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1274/2557] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:36:44.667356 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326d72a-f264-499f-a112-eb7e9d42aa82 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:44.678301 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326d72a-f264-499f-a112-eb7e9d42aa82 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:44.682936 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17312376-c0ce-40d5-acc0-c55e780e0b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:44.684137 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17312376-c0ce-40d5-acc0-c55e780e0b46 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:44.684418 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17312376-c0ce-40d5-acc0-c55e780e0b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:44.684693 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17312376-c0ce-40d5-acc0-c55e780e0b46 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:44.685434 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17312376-c0ce-40d5-acc0-c55e780e0b46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:44.687032 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17312376-c0ce-40d5-acc0-c55e780e0b46 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:44.697661 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1284/2558] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:36:44.702118 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5876f-d716-44ee-822b-237540984c97 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:44.710585 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17312376-c0ce-40d5-acc0-c55e780e0b46 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:44.712284 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-17312376-c0ce-40d5-acc0-c55e780e0b46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:36:44.712601 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5876f-d716-44ee-822b-237540984c97 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:44.717954 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d02db-d350-4a4d-9b88-ae6d31715b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:44.719193 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d02db-d350-4a4d-9b88-ae6d31715b37 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:44.719193 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d02db-d350-4a4d-9b88-ae6d31715b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:44.719535 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d02db-d350-4a4d-9b88-ae6d31715b37 admin admin] PATH_INFO: `/v3/projects/340c3f500cc14200bce6eb3ae5d77f21/users/bcd74c3c272a427ba2e362c19cdbad8a/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:44.734260 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d02db-d350-4a4d-9b88-ae6d31715b37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=340c3f500cc14200bce6eb3ae5d77f21, user_id=bcd74c3c272a427ba2e362c19cdbad8a, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:44.736933 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d02db-d350-4a4d-9b88-ae6d31715b37 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:44.750847 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1275/2559] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:36:44 2022] PUT /identity/v3/projects/340c3f500cc14200bce6eb3ae5d77f21/users/bcd74c3c272a427ba2e362c19cdbad8a/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:36:44.755868 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72166c9-d06f-425e-b6f2-4ccc9d2ab2fa None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:44.756154 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72166c9-d06f-425e-b6f2-4ccc9d2ab2fa None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:44.756466 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72166c9-d06f-425e-b6f2-4ccc9d2ab2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:44.769951 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17312376-c0ce-40d5-acc0-c55e780e0b46 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:44.773030 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-e72166c9-d06f-425e-b6f2-4ccc9d2ab2fa None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:36:44.774213 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-e72166c9-d06f-425e-b6f2-4ccc9d2ab2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:36:44.817852 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b563f-d56b-4e85-b529-b2f41db31720 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:44.818496 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b563f-d56b-4e85-b529-b2f41db31720 service cinder] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:44.818831 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b563f-d56b-4e85-b529-b2f41db31720 service cinder] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:44.819108 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b563f-d56b-4e85-b529-b2f41db31720 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:44.820905 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-5b9b563f-d56b-4e85-b529-b2f41db31720 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:36:44.832362 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1276/2560] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:36:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:36:44.843143 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72166c9-d06f-425e-b6f2-4ccc9d2ab2fa None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:44.844549 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-e72166c9-d06f-425e-b6f2-4ccc9d2ab2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:36:44.896231 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b563f-d56b-4e85-b529-b2f41db31720 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:44.897678 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b563f-d56b-4e85-b529-b2f41db31720 service cinder] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:44.911152 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1285/2561] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:36:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:36:45.036887 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72166c9-d06f-425e-b6f2-4ccc9d2ab2fa None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:45.040737 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d337e-b654-45bd-b969-158f16aced80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:45.041407 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d337e-b654-45bd-b969-158f16aced80 service neutron] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:45.041687 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d337e-b654-45bd-b969-158f16aced80 service neutron] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:45.041980 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d337e-b654-45bd-b969-158f16aced80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:45.052160 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9d337e-b654-45bd-b969-158f16aced80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:45.053579 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9d337e-b654-45bd-b969-158f16aced80 service neutron] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:45.064497 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1277/2562] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:36:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:36:49.370101 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64d5bc-73ec-46a3-a816-521118ab2844 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:49.370630 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64d5bc-73ec-46a3-a816-521118ab2844 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:49.371316 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64d5bc-73ec-46a3-a816-521118ab2844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:49.403400 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-6f64d5bc-73ec-46a3-a816-521118ab2844 None None] MFA Rules not processed for user `bcd74c3c272a427ba2e362c19cdbad8a`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:36:49.404626 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-6f64d5bc-73ec-46a3-a816-521118ab2844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:36:49.474037 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1286/2563] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:36:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:36:49.478080 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d337e-b654-45bd-b969-158f16aced80 service neutron] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:49.488200 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d337e-b654-45bd-b969-158f16aced80 service neutron] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:49.492901 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e543e8-a69f-4fc4-aa56-b06bdeb0ecfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:49.493703 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e543e8-a69f-4fc4-aa56-b06bdeb0ecfc admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:49.493984 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e543e8-a69f-4fc4-aa56-b06bdeb0ecfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:49.494259 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e543e8-a69f-4fc4-aa56-b06bdeb0ecfc admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:49.494996 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e543e8-a69f-4fc4-aa56-b06bdeb0ecfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:49.497586 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e543e8-a69f-4fc4-aa56-b06bdeb0ecfc admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:49.525055 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1278/2564] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:36:49 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:36:49.529393 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64d5bc-73ec-46a3-a816-521118ab2844 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:49.540412 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64d5bc-73ec-46a3-a816-521118ab2844 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:49.599299 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb3de2-561a-4b73-b0b5-d07dcbf30f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:49.600032 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb3de2-561a-4b73-b0b5-d07dcbf30f63 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:49.600309 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb3de2-561a-4b73-b0b5-d07dcbf30f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:49.600579 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb3de2-561a-4b73-b0b5-d07dcbf30f63 admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:49.601264 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb3de2-561a-4b73-b0b5-d07dcbf30f63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:49.603225 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb3de2-561a-4b73-b0b5-d07dcbf30f63 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:49.625720 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1287/2565] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:36:49 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:36:49.629819 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e543e8-a69f-4fc4-aa56-b06bdeb0ecfc admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:49.641496 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e543e8-a69f-4fc4-aa56-b06bdeb0ecfc admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:49.646457 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae5a61-c220-496b-9a05-670a70d736f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:49.647270 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae5a61-c220-496b-9a05-670a70d736f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:49.647550 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae5a61-c220-496b-9a05-670a70d736f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:49.647819 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae5a61-c220-496b-9a05-670a70d736f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:49.648544 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae5a61-c220-496b-9a05-670a70d736f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:49.650155 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae5a61-c220-496b-9a05-670a70d736f6 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:49.665907 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1279/2566] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:36:49.670167 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb3de2-561a-4b73-b0b5-d07dcbf30f63 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:49.680619 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb3de2-561a-4b73-b0b5-d07dcbf30f63 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:49.686344 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b368401e-202d-498c-93e3-cc15f0f528f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:49.687345 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368401e-202d-498c-93e3-cc15f0f528f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:49.687697 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368401e-202d-498c-93e3-cc15f0f528f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:49.688043 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368401e-202d-498c-93e3-cc15f0f528f3 admin admin] PATH_INFO: `/v3/projects/d467e14abb3d4405a46a4500f82450fb/users/5b4cb1ab41ef459e94acf5d4187e54fb/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:49.705582 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b368401e-202d-498c-93e3-cc15f0f528f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d467e14abb3d4405a46a4500f82450fb, user_id=5b4cb1ab41ef459e94acf5d4187e54fb, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:49.708281 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b368401e-202d-498c-93e3-cc15f0f528f3 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:49.722322 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1288/2567] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:36:49 2022] PUT /identity/v3/projects/d467e14abb3d4405a46a4500f82450fb/users/5b4cb1ab41ef459e94acf5d4187e54fb/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:36:49.726538 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae5a61-c220-496b-9a05-670a70d736f6 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:49.737139 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae5a61-c220-496b-9a05-670a70d736f6 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:49.794396 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db4c5f6-d3cc-468f-941e-e37b5692812a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:49.795203 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4c5f6-d3cc-468f-941e-e37b5692812a admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:49.795556 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4c5f6-d3cc-468f-941e-e37b5692812a admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:49.795853 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4c5f6-d3cc-468f-941e-e37b5692812a admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:49.796587 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db4c5f6-d3cc-468f-941e-e37b5692812a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:49.798179 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db4c5f6-d3cc-468f-941e-e37b5692812a admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:49.809114 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1280/2568] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:36:49.813791 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b368401e-202d-498c-93e3-cc15f0f528f3 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:49.824419 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b368401e-202d-498c-93e3-cc15f0f528f3 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:49.829417 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a81de-e409-498b-9e4f-047799b4243c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:49.830304 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a81de-e409-498b-9e4f-047799b4243c admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:49.830584 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a81de-e409-498b-9e4f-047799b4243c admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:49.830899 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a81de-e409-498b-9e4f-047799b4243c admin admin] PATH_INFO: `/v3/projects/d467e14abb3d4405a46a4500f82450fb/users/5b4cb1ab41ef459e94acf5d4187e54fb/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:49.832886 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669a81de-e409-498b-9e4f-047799b4243c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d467e14abb3d4405a46a4500f82450fb, user_id=5b4cb1ab41ef459e94acf5d4187e54fb, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:49.835556 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669a81de-e409-498b-9e4f-047799b4243c admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:49.850671 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1289/2569] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:36:49 2022] PUT /identity/v3/projects/d467e14abb3d4405a46a4500f82450fb/users/5b4cb1ab41ef459e94acf5d4187e54fb/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:36:54.607349 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7927d2c-c3ea-453d-a44e-e6bf94bb71c6 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:54.607849 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7927d2c-c3ea-453d-a44e-e6bf94bb71c6 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:54.607963 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7927d2c-c3ea-453d-a44e-e6bf94bb71c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:54.641985 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-b7927d2c-c3ea-453d-a44e-e6bf94bb71c6 None None] MFA Rules not processed for user `5b4cb1ab41ef459e94acf5d4187e54fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:36:54.643199 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-b7927d2c-c3ea-453d-a44e-e6bf94bb71c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:36:54.734280 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1281/2570] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:36:54 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:36:54.745265 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a81de-e409-498b-9e4f-047799b4243c admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:36:54.747954 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-669a81de-e409-498b-9e4f-047799b4243c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:36:54.825052 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a81de-e409-498b-9e4f-047799b4243c admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:36:54.831343 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71f6be-6da3-47d3-9f43-3ff66c496e5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec202a34db8e47f4a6c18285245e3f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:36:54.832147 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71f6be-6da3-47d3-9f43-3ff66c496e5d service nova] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:36:54.832530 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71f6be-6da3-47d3-9f43-3ff66c496e5d service nova] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:36:54.832920 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71f6be-6da3-47d3-9f43-3ff66c496e5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:36:54.907960 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71f6be-6da3-47d3-9f43-3ff66c496e5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:36:54.909646 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71f6be-6da3-47d3-9f43-3ff66c496e5d service nova] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:36:54.919558 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1290/2571] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:36:54 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:37:09.493200 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7927d2c-c3ea-453d-a44e-e6bf94bb71c6 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:09.494643 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-b7927d2c-c3ea-453d-a44e-e6bf94bb71c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:09.510468 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7927d2c-c3ea-453d-a44e-e6bf94bb71c6 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:09.516334 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab472c4-d4c8-4eff-bbbe-6b4c88c4667e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec202a34db8e47f4a6c18285245e3f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:09.516974 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab472c4-d4c8-4eff-bbbe-6b4c88c4667e service nova] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:09.517249 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab472c4-d4c8-4eff-bbbe-6b4c88c4667e service nova] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:09.517516 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab472c4-d4c8-4eff-bbbe-6b4c88c4667e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:09.519241 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-fab472c4-d4c8-4eff-bbbe-6b4c88c4667e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:09.580153 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab472c4-d4c8-4eff-bbbe-6b4c88c4667e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:09.581720 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab472c4-d4c8-4eff-bbbe-6b4c88c4667e service nova] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:09.591100 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1282/2572] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:37:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:37:13.604930 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68c822-ba16-4a36-a59a-2e3da969600f None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:13.605548 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68c822-ba16-4a36-a59a-2e3da969600f None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:13.606186 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68c822-ba16-4a36-a59a-2e3da969600f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:13.627042 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-2f68c822-ba16-4a36-a59a-2e3da969600f None None] MFA Rules not processed for user `bcd74c3c272a427ba2e362c19cdbad8a`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:37:13.628576 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-2f68c822-ba16-4a36-a59a-2e3da969600f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:13.638474 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1291/2573] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:37:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:37:13.951979 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab472c4-d4c8-4eff-bbbe-6b4c88c4667e service nova] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:13.953358 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-fab472c4-d4c8-4eff-bbbe-6b4c88c4667e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:14.006468 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab472c4-d4c8-4eff-bbbe-6b4c88c4667e service nova] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:14.010025 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2c440-ddb8-4a9a-aa94-9e99fc298af2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:14.010681 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2c440-ddb8-4a9a-aa94-9e99fc298af2 service neutron] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:14.010966 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2c440-ddb8-4a9a-aa94-9e99fc298af2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:14.011259 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2c440-ddb8-4a9a-aa94-9e99fc298af2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:14.013038 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-19e2c440-ddb8-4a9a-aa94-9e99fc298af2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:14.022012 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e2c440-ddb8-4a9a-aa94-9e99fc298af2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:14.023452 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e2c440-ddb8-4a9a-aa94-9e99fc298af2 service neutron] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:14.031058 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1283/2574] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:37:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:37:14.452948 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f68c822-ba16-4a36-a59a-2e3da969600f None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:14.454362 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-2f68c822-ba16-4a36-a59a-2e3da969600f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:14.524358 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f68c822-ba16-4a36-a59a-2e3da969600f None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:14.529556 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a25a22-ce78-43e8-a113-0baeafeec94d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b2346e4de5d45a79d4bb2abb01d4827', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:14.530191 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a25a22-ce78-43e8-a113-0baeafeec94d service placement] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:14.530499 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a25a22-ce78-43e8-a113-0baeafeec94d service placement] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:14.530803 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a25a22-ce78-43e8-a113-0baeafeec94d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:14.532526 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-80a25a22-ce78-43e8-a113-0baeafeec94d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:14.543985 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a25a22-ce78-43e8-a113-0baeafeec94d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:14.545527 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a25a22-ce78-43e8-a113-0baeafeec94d service placement] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:14.555154 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1292/2575] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:37:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:37:15.429043 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2c440-ddb8-4a9a-aa94-9e99fc298af2 service neutron] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:15.441710 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2c440-ddb8-4a9a-aa94-9e99fc298af2 service neutron] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:15.447083 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b480a6f-6eba-4f5a-b4cc-6887ce0f6f6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec202a34db8e47f4a6c18285245e3f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:15.447736 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b480a6f-6eba-4f5a-b4cc-6887ce0f6f6c service nova] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:15.448013 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b480a6f-6eba-4f5a-b4cc-6887ce0f6f6c service nova] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:15.448285 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b480a6f-6eba-4f5a-b4cc-6887ce0f6f6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:15.450542 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-8b480a6f-6eba-4f5a-b4cc-6887ce0f6f6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:15.512343 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b480a6f-6eba-4f5a-b4cc-6887ce0f6f6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:15.513908 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b480a6f-6eba-4f5a-b4cc-6887ce0f6f6c service nova] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:15.523532 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1284/2576] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:37:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:37:16.460498 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a25a22-ce78-43e8-a113-0baeafeec94d service placement] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:16.471159 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a25a22-ce78-43e8-a113-0baeafeec94d service placement] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:16.475007 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fd8650-5847-4bf8-97f8-5fe95e0e5ad5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:16.475902 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd8650-5847-4bf8-97f8-5fe95e0e5ad5 service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:16.476242 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd8650-5847-4bf8-97f8-5fe95e0e5ad5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:16.476583 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd8650-5847-4bf8-97f8-5fe95e0e5ad5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:16.478534 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-78fd8650-5847-4bf8-97f8-5fe95e0e5ad5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:16.492160 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fd8650-5847-4bf8-97f8-5fe95e0e5ad5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:16.493926 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fd8650-5847-4bf8-97f8-5fe95e0e5ad5 service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:16.503616 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1293/2577] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:37:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:37:17.399194 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b480a6f-6eba-4f5a-b4cc-6887ce0f6f6c service nova] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:17.415872 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b480a6f-6eba-4f5a-b4cc-6887ce0f6f6c service nova] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:17.423599 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a182c-c2ee-4d1f-b1ac-d7f1363c81ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec202a34db8e47f4a6c18285245e3f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:17.424258 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a182c-c2ee-4d1f-b1ac-d7f1363c81ba service nova] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:17.424638 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a182c-c2ee-4d1f-b1ac-d7f1363c81ba service nova] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:17.424946 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a182c-c2ee-4d1f-b1ac-d7f1363c81ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:17.427064 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-2e4a182c-c2ee-4d1f-b1ac-d7f1363c81ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:17.456842 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a182c-c2ee-4d1f-b1ac-d7f1363c81ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:17.459279 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a182c-c2ee-4d1f-b1ac-d7f1363c81ba service nova] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:17.471766 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1285/2578] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:37:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:37:23.236637 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cc2ba-df75-441e-bf4b-cd5bb4b60f05 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:23.237487 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cc2ba-df75-441e-bf4b-cd5bb4b60f05 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:23.237860 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cc2ba-df75-441e-bf4b-cd5bb4b60f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:23.262093 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-e30cc2ba-df75-441e-bf4b-cd5bb4b60f05 None None] MFA Rules not processed for user `1c1284bfe6cc43848731ed2b3d9e914b`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:37:23.264252 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-e30cc2ba-df75-441e-bf4b-cd5bb4b60f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:23.345734 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1294/2579] 10.222.0.21 () {58 vars in 1009 bytes} [Mon Feb 28 10:37:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:37:23.397421 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a182c-c2ee-4d1f-b1ac-d7f1363c81ba service nova] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:23.398992 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-2e4a182c-c2ee-4d1f-b1ac-d7f1363c81ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:23.469050 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a182c-c2ee-4d1f-b1ac-d7f1363c81ba service nova] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:23.474833 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d76d9f-e6c2-4e6b-b29d-a2349aae3c39 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8696fe8a37aa4d73a62bdc2efd35a23d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:23.475485 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d76d9f-e6c2-4e6b-b29d-a2349aae3c39 service swift] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:23.475762 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d76d9f-e6c2-4e6b-b29d-a2349aae3c39 service swift] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:23.476033 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d76d9f-e6c2-4e6b-b29d-a2349aae3c39 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:23.485269 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d76d9f-e6c2-4e6b-b29d-a2349aae3c39 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:23.486906 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d76d9f-e6c2-4e6b-b29d-a2349aae3c39 service swift] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:23.495448 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1286/2580] 10.222.0.21 () {60 vars in 1384 bytes} [Mon Feb 28 10:37:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 10:37:25.124285 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30cc2ba-df75-441e-bf4b-cd5bb4b60f05 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:25.150183 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30cc2ba-df75-441e-bf4b-cd5bb4b60f05 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:25.174936 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff39ca-f0f0-4606-84bc-ab6e59d288dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec202a34db8e47f4a6c18285245e3f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:25.176162 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff39ca-f0f0-4606-84bc-ab6e59d288dc service nova] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:25.176687 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff39ca-f0f0-4606-84bc-ab6e59d288dc service nova] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:25.177307 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff39ca-f0f0-4606-84bc-ab6e59d288dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:25.182293 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-d3ff39ca-f0f0-4606-84bc-ab6e59d288dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:25.214020 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ff39ca-f0f0-4606-84bc-ab6e59d288dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:25.216478 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ff39ca-f0f0-4606-84bc-ab6e59d288dc service nova] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:25.244263 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1295/2581] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:37:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:37:29.013151 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d76d9f-e6c2-4e6b-b29d-a2349aae3c39 service swift] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:29.027125 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d76d9f-e6c2-4e6b-b29d-a2349aae3c39 service swift] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:29.037873 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f7fa9-6655-4544-bc06-f64bfdcdea74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:29.039045 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f7fa9-6655-4544-bc06-f64bfdcdea74 service neutron] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:29.039593 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f7fa9-6655-4544-bc06-f64bfdcdea74 service neutron] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:29.040287 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f7fa9-6655-4544-bc06-f64bfdcdea74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:29.043292 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-315f7fa9-6655-4544-bc06-f64bfdcdea74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:29.182308 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315f7fa9-6655-4544-bc06-f64bfdcdea74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:29.184465 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315f7fa9-6655-4544-bc06-f64bfdcdea74 service neutron] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:29.207239 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1287/2582] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:37:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:37:31.319488 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff39ca-f0f0-4606-84bc-ab6e59d288dc service nova] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:31.335247 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff39ca-f0f0-4606-84bc-ab6e59d288dc service nova] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:31.354683 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45b27c-798b-4f6e-abba-83deb4249a22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec202a34db8e47f4a6c18285245e3f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:31.358537 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45b27c-798b-4f6e-abba-83deb4249a22 service nova] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:31.359116 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45b27c-798b-4f6e-abba-83deb4249a22 service nova] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:31.359606 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45b27c-798b-4f6e-abba-83deb4249a22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:31.364721 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-4b45b27c-798b-4f6e-abba-83deb4249a22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:31.409098 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45b27c-798b-4f6e-abba-83deb4249a22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:31.415929 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45b27c-798b-4f6e-abba-83deb4249a22 service nova] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:31.447470 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1296/2583] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:37:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:37:32.266042 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f7fa9-6655-4544-bc06-f64bfdcdea74 service neutron] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:32.278413 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f7fa9-6655-4544-bc06-f64bfdcdea74 service neutron] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:32.285504 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b512fa-b20f-475a-b588-d9e376012201 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:32.286361 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b512fa-b20f-475a-b588-d9e376012201 service neutron] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:32.286853 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b512fa-b20f-475a-b588-d9e376012201 service neutron] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:32.287281 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b512fa-b20f-475a-b588-d9e376012201 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:32.315356 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b512fa-b20f-475a-b588-d9e376012201 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:32.317362 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b512fa-b20f-475a-b588-d9e376012201 service neutron] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:32.349048 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1288/2584] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:37:32 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:37:35.691446 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45b27c-798b-4f6e-abba-83deb4249a22 service nova] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:35.694458 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-4b45b27c-798b-4f6e-abba-83deb4249a22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:35.719675 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45b27c-798b-4f6e-abba-83deb4249a22 service nova] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:35.757555 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54435541-eac4-4f14-a114-47ef193825ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:35.758443 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54435541-eac4-4f14-a114-47ef193825ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:35.758756 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54435541-eac4-4f14-a114-47ef193825ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:35.759033 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54435541-eac4-4f14-a114-47ef193825ac admin admin] PATH_INFO: `/v3/users/9f32c16ee62d441d9e5fde2b1ce0afaf` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:35.760328 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54435541-eac4-4f14-a114-47ef193825ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f32c16ee62d441d9e5fde2b1ce0afaf)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:35.762318 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54435541-eac4-4f14-a114-47ef193825ac admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:35.868776 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-54435541-eac4-4f14-a114-47ef193825ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f32c16ee62d441d9e5fde2b1ce0afaf'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:37:35.883230 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-54435541-eac4-4f14-a114-47ef193825ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f32c16ee62d441d9e5fde2b1ce0afaf'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:37:35.883858 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-54435541-eac4-4f14-a114-47ef193825ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f32c16ee62d441d9e5fde2b1ce0afaf'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:37:35.908564 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-54435541-eac4-4f14-a114-47ef193825ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f32c16ee62d441d9e5fde2b1ce0afaf'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:37:35.923092 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-54435541-eac4-4f14-a114-47ef193825ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f32c16ee62d441d9e5fde2b1ce0afaf'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:37:35.929983 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1297/2585] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:37:35 2022] DELETE /identity/v3/users/9f32c16ee62d441d9e5fde2b1ce0afaf => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:37:36.545184 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b512fa-b20f-475a-b588-d9e376012201 service neutron] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:36.563064 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b512fa-b20f-475a-b588-d9e376012201 service neutron] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:36.694658 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08f54f-3658-47a5-992d-83a9db05ab1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:36.695560 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08f54f-3658-47a5-992d-83a9db05ab1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:36.695800 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08f54f-3658-47a5-992d-83a9db05ab1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:36.696070 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08f54f-3658-47a5-992d-83a9db05ab1f admin admin] PATH_INFO: `/v3/projects/17631b0e5f9d499f9b830044f7acffa5` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:36.697291 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d08f54f-3658-47a5-992d-83a9db05ab1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=17631b0e5f9d499f9b830044f7acffa5)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:36.700910 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d08f54f-3658-47a5-992d-83a9db05ab1f admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:36.776134 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-2d08f54f-3658-47a5-992d-83a9db05ab1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17631b0e5f9d499f9b830044f7acffa5', 'request_id': 'req-2d08f54f-3658-47a5-992d-83a9db05ab1f'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:37:36.784456 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-2d08f54f-3658-47a5-992d-83a9db05ab1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17631b0e5f9d499f9b830044f7acffa5', 'request_id': 'req-2d08f54f-3658-47a5-992d-83a9db05ab1f'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:37:36.793855 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-2d08f54f-3658-47a5-992d-83a9db05ab1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17631b0e5f9d499f9b830044f7acffa5', 'request_id': 'req-2d08f54f-3658-47a5-992d-83a9db05ab1f'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:37:36.814829 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-2d08f54f-3658-47a5-992d-83a9db05ab1f admin admin] The token cache is being invalidate because project 17631b0e5f9d499f9b830044f7acffa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:37:36.815123 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-2d08f54f-3658-47a5-992d-83a9db05ab1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:37:36.816920 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-2d08f54f-3658-47a5-992d-83a9db05ab1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:37:36.818776 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1289/2586] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:37:36 2022] DELETE /identity/v3/projects/17631b0e5f9d499f9b830044f7acffa5 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:37:36.824040 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ead46-9a95-40ba-b3a4-217299856e49 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:36.825680 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ead46-9a95-40ba-b3a4-217299856e49 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:36.826133 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ead46-9a95-40ba-b3a4-217299856e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:36.865409 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-b53ead46-9a95-40ba-b3a4-217299856e49 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:37:36.867167 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-b53ead46-9a95-40ba-b3a4-217299856e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:36.952483 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1298/2587] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:37:36.953759 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c571236-a70e-466d-9ba6-f0188c7c2161 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:36.954054 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c571236-a70e-466d-9ba6-f0188c7c2161 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:36.954313 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c571236-a70e-466d-9ba6-f0188c7c2161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:36.981075 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-5c571236-a70e-466d-9ba6-f0188c7c2161 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:37:36.983504 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-5c571236-a70e-466d-9ba6-f0188c7c2161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:36.994843 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1290/2588] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:37:36.999774 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ead46-9a95-40ba-b3a4-217299856e49 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:37.010443 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ead46-9a95-40ba-b3a4-217299856e49 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:37.026366 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2730ee8-4f48-4412-aec4-cb8ef44f849a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:37.027440 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2730ee8-4f48-4412-aec4-cb8ef44f849a admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:37.027721 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2730ee8-4f48-4412-aec4-cb8ef44f849a admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:37.028126 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2730ee8-4f48-4412-aec4-cb8ef44f849a admin admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:37.028890 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2730ee8-4f48-4412-aec4-cb8ef44f849a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:37:37.029194 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2730ee8-4f48-4412-aec4-cb8ef44f849a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:37.031163 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2730ee8-4f48-4412-aec4-cb8ef44f849a admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:37.044481 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1299/2589] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:37:37.048486 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c571236-a70e-466d-9ba6-f0188c7c2161 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:37.057967 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c571236-a70e-466d-9ba6-f0188c7c2161 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:37.063903 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c0940-ba65-48e1-bb38-e51b616fa7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:37.064568 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c0940-ba65-48e1-bb38-e51b616fa7b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:37.064848 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c0940-ba65-48e1-bb38-e51b616fa7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:37.065117 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c0940-ba65-48e1-bb38-e51b616fa7b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:37.065807 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6c0940-ba65-48e1-bb38-e51b616fa7b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:37.067734 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6c0940-ba65-48e1-bb38-e51b616fa7b4 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:37.095502 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1291/2590] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:37:37 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:37:37.099597 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2730ee8-4f48-4412-aec4-cb8ef44f849a admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:37.110064 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2730ee8-4f48-4412-aec4-cb8ef44f849a admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:37.169180 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57d58f-a959-4e4f-bbb5-320b944cf809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:37.169853 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57d58f-a959-4e4f-bbb5-320b944cf809 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:37.170139 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57d58f-a959-4e4f-bbb5-320b944cf809 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:37.170420 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57d58f-a959-4e4f-bbb5-320b944cf809 admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:37.171150 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57d58f-a959-4e4f-bbb5-320b944cf809 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:37.173039 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57d58f-a959-4e4f-bbb5-320b944cf809 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:37.194550 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1300/2591] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:37:37 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:37:37.198280 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c0940-ba65-48e1-bb38-e51b616fa7b4 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:37.210878 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c0940-ba65-48e1-bb38-e51b616fa7b4 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:37.221056 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c064ef-0d03-4687-bed4-670052d91bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:37.221056 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c064ef-0d03-4687-bed4-670052d91bfd admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:37.221056 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c064ef-0d03-4687-bed4-670052d91bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:37.221056 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c064ef-0d03-4687-bed4-670052d91bfd admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:37.221634 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c064ef-0d03-4687-bed4-670052d91bfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:37.221634 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c064ef-0d03-4687-bed4-670052d91bfd admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:37.232389 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1292/2592] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:37:37.236626 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57d58f-a959-4e4f-bbb5-320b944cf809 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:37.249164 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57d58f-a959-4e4f-bbb5-320b944cf809 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:37.255266 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46204e-d923-44a6-8013-7452920fde37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:37.256443 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46204e-d923-44a6-8013-7452920fde37 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:37.256443 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46204e-d923-44a6-8013-7452920fde37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:37.256643 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46204e-d923-44a6-8013-7452920fde37 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:37.257236 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46204e-d923-44a6-8013-7452920fde37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:37.259220 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46204e-d923-44a6-8013-7452920fde37 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:37.270776 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1301/2593] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:37:37.274777 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c064ef-0d03-4687-bed4-670052d91bfd admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:37.285410 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c064ef-0d03-4687-bed4-670052d91bfd admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:37.290412 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa24dc-7ce8-47a9-904e-4d61df60671c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:37.291451 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa24dc-7ce8-47a9-904e-4d61df60671c admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:37.291830 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa24dc-7ce8-47a9-904e-4d61df60671c admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:37.292202 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa24dc-7ce8-47a9-904e-4d61df60671c admin admin] PATH_INFO: `/v3/projects/5c79b1decd974ef2bb73bf55edc02f8c/users/3cdcba6d332b492196494db46ced8b9f/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:37.307206 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa24dc-7ce8-47a9-904e-4d61df60671c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c79b1decd974ef2bb73bf55edc02f8c, user_id=3cdcba6d332b492196494db46ced8b9f, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:37.310819 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa24dc-7ce8-47a9-904e-4d61df60671c admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:37.326899 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1293/2594] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:37:37 2022] PUT /identity/v3/projects/5c79b1decd974ef2bb73bf55edc02f8c/users/3cdcba6d332b492196494db46ced8b9f/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:37:37.331877 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436384e4-4059-4b11-9e58-bad39c84b558 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:37.332702 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436384e4-4059-4b11-9e58-bad39c84b558 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:37.332702 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436384e4-4059-4b11-9e58-bad39c84b558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:37.350818 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-436384e4-4059-4b11-9e58-bad39c84b558 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:37:37.352020 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-436384e4-4059-4b11-9e58-bad39c84b558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:37.432246 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1302/2595] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:37:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:37:37.442773 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa24dc-7ce8-47a9-904e-4d61df60671c admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:37.444712 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-62fa24dc-7ce8-47a9-904e-4d61df60671c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:37.503748 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa24dc-7ce8-47a9-904e-4d61df60671c admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:37.507452 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db517da1-cbd7-499a-bd9b-ff832640c792 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:37.508084 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db517da1-cbd7-499a-bd9b-ff832640c792 service neutron] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:37.508357 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db517da1-cbd7-499a-bd9b-ff832640c792 service neutron] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:37.508623 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db517da1-cbd7-499a-bd9b-ff832640c792 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:37.519363 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db517da1-cbd7-499a-bd9b-ff832640c792 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:37.520756 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db517da1-cbd7-499a-bd9b-ff832640c792 service neutron] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:37.532053 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1294/2596] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:37:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:37:38.255221 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c93409-4b7d-4cf3-9f9f-e05d2f59a543 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:38.255717 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c93409-4b7d-4cf3-9f9f-e05d2f59a543 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:38.255806 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c93409-4b7d-4cf3-9f9f-e05d2f59a543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:38.282714 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-80c93409-4b7d-4cf3-9f9f-e05d2f59a543 None None] MFA Rules not processed for user `3cdcba6d332b492196494db46ced8b9f`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:37:38.283918 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-80c93409-4b7d-4cf3-9f9f-e05d2f59a543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:38.348925 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1303/2597] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:37:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:37:38.360390 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc100066-fb0c-4dcc-8849-579008d900e0 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:38.360941 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc100066-fb0c-4dcc-8849-579008d900e0 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:38.360941 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc100066-fb0c-4dcc-8849-579008d900e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:38.377670 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-dc100066-fb0c-4dcc-8849-579008d900e0 None None] MFA Rules not processed for user `3cdcba6d332b492196494db46ced8b9f`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:37:38.378895 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-dc100066-fb0c-4dcc-8849-579008d900e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:38.385680 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1295/2598] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:37:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:37:38.397466 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c93409-4b7d-4cf3-9f9f-e05d2f59a543 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:38.398887 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-80c93409-4b7d-4cf3-9f9f-e05d2f59a543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:38.483331 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c93409-4b7d-4cf3-9f9f-e05d2f59a543 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:38.491245 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd96d8a-31e6-4858-845c-9142382a7a69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec202a34db8e47f4a6c18285245e3f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:38.491901 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd96d8a-31e6-4858-845c-9142382a7a69 service nova] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:38.492182 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd96d8a-31e6-4858-845c-9142382a7a69 service nova] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:38.492462 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd96d8a-31e6-4858-845c-9142382a7a69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:38.503422 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd96d8a-31e6-4858-845c-9142382a7a69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:38.505201 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd96d8a-31e6-4858-845c-9142382a7a69 service nova] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:38.515163 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1304/2599] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:37:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:37:38.825489 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc100066-fb0c-4dcc-8849-579008d900e0 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:38.826916 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-dc100066-fb0c-4dcc-8849-579008d900e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:38.838509 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc100066-fb0c-4dcc-8849-579008d900e0 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:38.851658 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00f2e3-7a7e-421e-98fc-217cbc771fe1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:38.852326 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00f2e3-7a7e-421e-98fc-217cbc771fe1 service neutron] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:38.852611 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00f2e3-7a7e-421e-98fc-217cbc771fe1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:38.852918 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00f2e3-7a7e-421e-98fc-217cbc771fe1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:38.855003 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-1d00f2e3-7a7e-421e-98fc-217cbc771fe1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:38.865769 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00f2e3-7a7e-421e-98fc-217cbc771fe1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:38.867306 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00f2e3-7a7e-421e-98fc-217cbc771fe1 service neutron] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:38.875372 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1296/2600] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:37:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:37:40.116267 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727b5b4-1174-4973-b8b7-12799822e747 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:40.116808 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727b5b4-1174-4973-b8b7-12799822e747 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:40.116914 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727b5b4-1174-4973-b8b7-12799822e747 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:40.118699 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1305/2601] 10.222.0.21 () {54 vars in 921 bytes} [Mon Feb 28 10:37:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:37:40.125566 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a3022-cfcb-4c38-aff2-4e714f2c445e None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:40.126056 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a3022-cfcb-4c38-aff2-4e714f2c445e None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:40.126150 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a3022-cfcb-4c38-aff2-4e714f2c445e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:40.144996 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-733a3022-cfcb-4c38-aff2-4e714f2c445e None None] MFA Rules not processed for user `ec202a34db8e47f4a6c18285245e3f5b`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:37:40.146273 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-733a3022-cfcb-4c38-aff2-4e714f2c445e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:40.156776 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1297/2602] 10.222.0.21 () {58 vars in 1018 bytes} [Mon Feb 28 10:37:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:37:40.169251 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727b5b4-1174-4973-b8b7-12799822e747 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:40.171157 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-d727b5b4-1174-4973-b8b7-12799822e747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:40.233090 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727b5b4-1174-4973-b8b7-12799822e747 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:40.237077 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc34e4-6973-42c3-8381-20271649db7d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99b63b9b6e44219921569db1bf2e0dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:40.237988 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc34e4-6973-42c3-8381-20271649db7d service glance] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:40.238405 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc34e4-6973-42c3-8381-20271649db7d service glance] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:40.238834 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc34e4-6973-42c3-8381-20271649db7d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:40.251610 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc34e4-6973-42c3-8381-20271649db7d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:40.253172 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc34e4-6973-42c3-8381-20271649db7d service glance] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:40.268106 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1306/2603] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:37:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:37:40.340516 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fced3-ecbf-4cb0-84e0-555320ec0e22 None None] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:40.340800 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fced3-ecbf-4cb0-84e0-555320ec0e22 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:40.341071 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fced3-ecbf-4cb0-84e0-555320ec0e22 None None] PATH_INFO: `/` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:40.342929 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1298/2604] 10.222.0.21 () {54 vars in 921 bytes} [Mon Feb 28 10:37:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:37:40.348626 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6abc10-cb71-466b-8ef0-852a91b16cf9 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:40.349168 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6abc10-cb71-466b-8ef0-852a91b16cf9 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:40.349517 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6abc10-cb71-466b-8ef0-852a91b16cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:40.373781 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-4b6abc10-cb71-466b-8ef0-852a91b16cf9 None None] MFA Rules not processed for user `abaa12b94c834676bb17bf997dace5d1`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:37:40.375022 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-4b6abc10-cb71-466b-8ef0-852a91b16cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:40.381525 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1307/2605] 10.222.0.21 () {58 vars in 1018 bytes} [Mon Feb 28 10:37:40 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:37:40.397690 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4fced3-ecbf-4cb0-84e0-555320ec0e22 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:40.416994 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4fced3-ecbf-4cb0-84e0-555320ec0e22 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:40.421442 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f5c125-a9bd-4aba-8c2f-2d4c8dc69556 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:40.422278 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5c125-a9bd-4aba-8c2f-2d4c8dc69556 service neutron] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:40.422648 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5c125-a9bd-4aba-8c2f-2d4c8dc69556 service neutron] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:40.423145 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5c125-a9bd-4aba-8c2f-2d4c8dc69556 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:40.432889 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f5c125-a9bd-4aba-8c2f-2d4c8dc69556 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:40.434931 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f5c125-a9bd-4aba-8c2f-2d4c8dc69556 service neutron] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:40.444652 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1299/2606] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:37:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:37:40.541286 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3947d25-5f88-4d23-805b-901c8f5c2173 None None] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:40.541626 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3947d25-5f88-4d23-805b-901c8f5c2173 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:40.541850 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3947d25-5f88-4d23-805b-901c8f5c2173 None None] PATH_INFO: `/` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:40.544896 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1308/2607] 10.222.0.21 () {54 vars in 921 bytes} [Mon Feb 28 10:37:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 10:37:40.550971 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e7975-1a17-41d1-b6e0-c21824100e99 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:40.551261 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e7975-1a17-41d1-b6e0-c21824100e99 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:40.551555 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e7975-1a17-41d1-b6e0-c21824100e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:40.569877 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-463e7975-1a17-41d1-b6e0-c21824100e99 None None] MFA Rules not processed for user `ec202a34db8e47f4a6c18285245e3f5b`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:37:40.571120 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-463e7975-1a17-41d1-b6e0-c21824100e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:40.582035 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1300/2608] 10.222.0.21 () {58 vars in 1018 bytes} [Mon Feb 28 10:37:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:37:40.596666 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3947d25-5f88-4d23-805b-901c8f5c2173 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:40.611541 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3947d25-5f88-4d23-805b-901c8f5c2173 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:40.615557 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2457a4e-9940-4dd5-8daa-6c2c86b659ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:40.616510 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2457a4e-9940-4dd5-8daa-6c2c86b659ce service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:40.616621 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2457a4e-9940-4dd5-8daa-6c2c86b659ce service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:40.616884 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2457a4e-9940-4dd5-8daa-6c2c86b659ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:40.628366 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2457a4e-9940-4dd5-8daa-6c2c86b659ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:40.629855 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2457a4e-9940-4dd5-8daa-6c2c86b659ce service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:40.643554 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1309/2609] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:37:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:37:42.446299 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5a07a-6491-431b-81e1-c9982f42508e None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:42.446944 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5a07a-6491-431b-81e1-c9982f42508e None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:42.447064 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5a07a-6491-431b-81e1-c9982f42508e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:42.468770 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-b1d5a07a-6491-431b-81e1-c9982f42508e None None] MFA Rules not processed for user `1c1284bfe6cc43848731ed2b3d9e914b`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:37:42.470626 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-b1d5a07a-6491-431b-81e1-c9982f42508e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:42.533989 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1301/2610] 10.222.0.21 () {58 vars in 967 bytes} [Mon Feb 28 10:37:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:37:42.578875 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2457a4e-9940-4dd5-8daa-6c2c86b659ce service neutron] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:42.580983 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-d2457a4e-9940-4dd5-8daa-6c2c86b659ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:42.666944 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2457a4e-9940-4dd5-8daa-6c2c86b659ce service neutron] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:42.672335 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ea017-b888-4445-8c73-9148ac0b75db service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8696fe8a37aa4d73a62bdc2efd35a23d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:42.673070 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ea017-b888-4445-8c73-9148ac0b75db service swift] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:42.673446 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ea017-b888-4445-8c73-9148ac0b75db service swift] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:42.673817 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ea017-b888-4445-8c73-9148ac0b75db service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:42.689168 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ea017-b888-4445-8c73-9148ac0b75db service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:42.692618 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ea017-b888-4445-8c73-9148ac0b75db service swift] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:42.704610 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1310/2611] 10.222.0.21 () {60 vars in 1384 bytes} [Mon Feb 28 10:37:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 10:37:43.378371 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b40b3f-b035-4baa-848f-a4355609b6b2 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:43.379226 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b40b3f-b035-4baa-848f-a4355609b6b2 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:43.379804 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b40b3f-b035-4baa-848f-a4355609b6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:43.409153 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-50b40b3f-b035-4baa-848f-a4355609b6b2 None None] MFA Rules not processed for user `1c1284bfe6cc43848731ed2b3d9e914b`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:37:43.410642 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-50b40b3f-b035-4baa-848f-a4355609b6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:43.422237 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1302/2612] 10.222.0.21 () {58 vars in 1009 bytes} [Mon Feb 28 10:37:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:37:43.440850 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ea017-b888-4445-8c73-9148ac0b75db service swift] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:43.453930 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ea017-b888-4445-8c73-9148ac0b75db service swift] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:43.462860 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d6da7f-e0e8-4af6-8a5a-1bf01aec4c4f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8696fe8a37aa4d73a62bdc2efd35a23d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:43.464171 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6da7f-e0e8-4af6-8a5a-1bf01aec4c4f service swift] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:43.464717 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6da7f-e0e8-4af6-8a5a-1bf01aec4c4f service swift] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:43.465217 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6da7f-e0e8-4af6-8a5a-1bf01aec4c4f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:43.476300 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d6da7f-e0e8-4af6-8a5a-1bf01aec4c4f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:43.479468 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d6da7f-e0e8-4af6-8a5a-1bf01aec4c4f service swift] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:43.489302 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1311/2613] 10.222.0.21 () {60 vars in 1384 bytes} [Mon Feb 28 10:37:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 10:37:52.562004 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b40b3f-b035-4baa-848f-a4355609b6b2 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:52.563530 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-50b40b3f-b035-4baa-848f-a4355609b6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:52.583507 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b40b3f-b035-4baa-848f-a4355609b6b2 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:52.592663 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be60dd61-a684-475f-8d8d-72e1c725910f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:52.593646 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be60dd61-a684-475f-8d8d-72e1c725910f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:52.594133 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be60dd61-a684-475f-8d8d-72e1c725910f admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:52.594891 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be60dd61-a684-475f-8d8d-72e1c725910f admin admin] PATH_INFO: `/v3/users/e840e28ad3194d7ea995ea2d2b57843e` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:52.596308 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be60dd61-a684-475f-8d8d-72e1c725910f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e840e28ad3194d7ea995ea2d2b57843e)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:52.598209 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be60dd61-a684-475f-8d8d-72e1c725910f admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:52.647435 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-be60dd61-a684-475f-8d8d-72e1c725910f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e840e28ad3194d7ea995ea2d2b57843e'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:37:52.648168 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-be60dd61-a684-475f-8d8d-72e1c725910f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e840e28ad3194d7ea995ea2d2b57843e'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:37:52.661606 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-be60dd61-a684-475f-8d8d-72e1c725910f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e840e28ad3194d7ea995ea2d2b57843e'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:37:52.677515 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-be60dd61-a684-475f-8d8d-72e1c725910f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e840e28ad3194d7ea995ea2d2b57843e'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:37:52.688133 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-be60dd61-a684-475f-8d8d-72e1c725910f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e840e28ad3194d7ea995ea2d2b57843e'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:37:52.694538 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1303/2614] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:37:52 2022] DELETE /identity/v3/users/e840e28ad3194d7ea995ea2d2b57843e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:37:52.940662 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d6da7f-e0e8-4af6-8a5a-1bf01aec4c4f service swift] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:52.957397 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d6da7f-e0e8-4af6-8a5a-1bf01aec4c4f service swift] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:53.060290 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb9670-6884-453c-9bbe-bc0e9897c1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:53.061236 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb9670-6884-453c-9bbe-bc0e9897c1e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:53.061517 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb9670-6884-453c-9bbe-bc0e9897c1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:53.061790 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb9670-6884-453c-9bbe-bc0e9897c1e6 admin admin] PATH_INFO: `/v3/projects/b8784f6a53624f7688d9ae0ae0e15169` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:53.064693 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb9670-6884-453c-9bbe-bc0e9897c1e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8784f6a53624f7688d9ae0ae0e15169)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:53.068080 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb9670-6884-453c-9bbe-bc0e9897c1e6 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:53.142635 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-eeeb9670-6884-453c-9bbe-bc0e9897c1e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8784f6a53624f7688d9ae0ae0e15169', 'request_id': 'req-eeeb9670-6884-453c-9bbe-bc0e9897c1e6'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:37:53.149447 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-eeeb9670-6884-453c-9bbe-bc0e9897c1e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8784f6a53624f7688d9ae0ae0e15169', 'request_id': 'req-eeeb9670-6884-453c-9bbe-bc0e9897c1e6'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:37:53.156490 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-eeeb9670-6884-453c-9bbe-bc0e9897c1e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8784f6a53624f7688d9ae0ae0e15169', 'request_id': 'req-eeeb9670-6884-453c-9bbe-bc0e9897c1e6'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:37:53.170374 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-eeeb9670-6884-453c-9bbe-bc0e9897c1e6 admin admin] The token cache is being invalidate because project b8784f6a53624f7688d9ae0ae0e15169 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:37:53.170690 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-eeeb9670-6884-453c-9bbe-bc0e9897c1e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:37:53.171321 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-eeeb9670-6884-453c-9bbe-bc0e9897c1e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:37:53.172873 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1312/2615] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:37:52 2022] DELETE /identity/v3/projects/b8784f6a53624f7688d9ae0ae0e15169 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:37:53.176979 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be60dd61-a684-475f-8d8d-72e1c725910f admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:53.178430 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-be60dd61-a684-475f-8d8d-72e1c725910f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:53.192132 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be60dd61-a684-475f-8d8d-72e1c725910f admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:53.247983 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe42441-1ae9-4bf3-8658-6de5ac95756e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:53.248851 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe42441-1ae9-4bf3-8658-6de5ac95756e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:53.249112 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe42441-1ae9-4bf3-8658-6de5ac95756e admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:53.249383 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe42441-1ae9-4bf3-8658-6de5ac95756e admin admin] PATH_INFO: `/v3/users/8d9dc15798084af1b70e015e8755943e` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:53.250545 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe42441-1ae9-4bf3-8658-6de5ac95756e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d9dc15798084af1b70e015e8755943e)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:53.252447 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe42441-1ae9-4bf3-8658-6de5ac95756e admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:53.296819 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-3fe42441-1ae9-4bf3-8658-6de5ac95756e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d9dc15798084af1b70e015e8755943e'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:37:53.297475 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-3fe42441-1ae9-4bf3-8658-6de5ac95756e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d9dc15798084af1b70e015e8755943e'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:37:53.309390 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-3fe42441-1ae9-4bf3-8658-6de5ac95756e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d9dc15798084af1b70e015e8755943e'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:37:53.316163 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-3fe42441-1ae9-4bf3-8658-6de5ac95756e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d9dc15798084af1b70e015e8755943e'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:37:53.322760 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-3fe42441-1ae9-4bf3-8658-6de5ac95756e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d9dc15798084af1b70e015e8755943e'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:37:53.329364 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1304/2616] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:37:53 2022] DELETE /identity/v3/users/8d9dc15798084af1b70e015e8755943e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:37:53.519378 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb9670-6884-453c-9bbe-bc0e9897c1e6 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:37:53.521033 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-eeeb9670-6884-453c-9bbe-bc0e9897c1e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:37:53.539798 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb9670-6884-453c-9bbe-bc0e9897c1e6 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:37:53.620071 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b91937-2802-4d12-9536-ab245f01d209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:37:53.621648 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b91937-2802-4d12-9536-ab245f01d209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:37:53.621928 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b91937-2802-4d12-9536-ab245f01d209 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:37:53.622207 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b91937-2802-4d12-9536-ab245f01d209 admin admin] PATH_INFO: `/v3/projects/f2cc8158f70a4daa967243f70196b5fc` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:37:53.623457 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b91937-2802-4d12-9536-ab245f01d209 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2cc8158f70a4daa967243f70196b5fc)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:37:53.625350 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b91937-2802-4d12-9536-ab245f01d209 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:37:53.693700 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-b3b91937-2802-4d12-9536-ab245f01d209 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2cc8158f70a4daa967243f70196b5fc', 'request_id': 'req-b3b91937-2802-4d12-9536-ab245f01d209'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:37:53.702308 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-b3b91937-2802-4d12-9536-ab245f01d209 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2cc8158f70a4daa967243f70196b5fc', 'request_id': 'req-b3b91937-2802-4d12-9536-ab245f01d209'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:37:53.709036 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-b3b91937-2802-4d12-9536-ab245f01d209 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2cc8158f70a4daa967243f70196b5fc', 'request_id': 'req-b3b91937-2802-4d12-9536-ab245f01d209'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:37:53.723669 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-b3b91937-2802-4d12-9536-ab245f01d209 admin admin] The token cache is being invalidate because project f2cc8158f70a4daa967243f70196b5fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:37:53.723960 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-b3b91937-2802-4d12-9536-ab245f01d209 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:37:53.724722 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-b3b91937-2802-4d12-9536-ab245f01d209 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:37:53.726444 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1313/2617] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:37:53 2022] DELETE /identity/v3/projects/f2cc8158f70a4daa967243f70196b5fc => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:38:02.664410 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de806a-e404-4e8a-a21a-e13c094fff34 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:02.664897 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de806a-e404-4e8a-a21a-e13c094fff34 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:02.665042 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de806a-e404-4e8a-a21a-e13c094fff34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:02.682981 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-b5de806a-e404-4e8a-a21a-e13c094fff34 None None] MFA Rules not processed for user `1c1284bfe6cc43848731ed2b3d9e914b`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:02.685300 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-b5de806a-e404-4e8a-a21a-e13c094fff34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:02.740594 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1305/2618] 10.222.0.21 () {58 vars in 967 bytes} [Mon Feb 28 10:38:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:02.756111 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b91937-2802-4d12-9536-ab245f01d209 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:02.757564 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-b3b91937-2802-4d12-9536-ab245f01d209 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:02.829606 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b91937-2802-4d12-9536-ab245f01d209 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:02.835323 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9706b4a-fe21-41b8-bdc8-16227337f85f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8696fe8a37aa4d73a62bdc2efd35a23d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:02.835977 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9706b4a-fe21-41b8-bdc8-16227337f85f service swift] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:02.836258 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9706b4a-fe21-41b8-bdc8-16227337f85f service swift] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:02.836569 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9706b4a-fe21-41b8-bdc8-16227337f85f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:02.845904 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9706b4a-fe21-41b8-bdc8-16227337f85f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:02.847527 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9706b4a-fe21-41b8-bdc8-16227337f85f service swift] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:02.856743 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1314/2619] 10.222.0.21 () {60 vars in 1384 bytes} [Mon Feb 28 10:38:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 10:38:05.992906 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafca3bf-0dee-41d8-bb19-a511ead417be None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:05.993433 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafca3bf-0dee-41d8-bb19-a511ead417be None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:05.993534 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafca3bf-0dee-41d8-bb19-a511ead417be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:06.011431 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-cafca3bf-0dee-41d8-bb19-a511ead417be None None] MFA Rules not processed for user `3cdcba6d332b492196494db46ced8b9f`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:06.012601 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-cafca3bf-0dee-41d8-bb19-a511ead417be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:06.068303 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1306/2620] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:38:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:19.807375 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ede7bb-633f-459d-a146-106c6db69f22 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:19.807866 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ede7bb-633f-459d-a146-106c6db69f22 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:19.807963 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ede7bb-633f-459d-a146-106c6db69f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:19.825064 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-b1ede7bb-633f-459d-a146-106c6db69f22 None None] MFA Rules not processed for user `3cdcba6d332b492196494db46ced8b9f`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:19.826375 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-b1ede7bb-633f-459d-a146-106c6db69f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:19.833194 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1315/2621] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:38:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:42.590769 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a9419-5977-443c-9961-a0757b07162f None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:42.591314 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a9419-5977-443c-9961-a0757b07162f None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:42.591314 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a9419-5977-443c-9961-a0757b07162f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:42.609070 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-495a9419-5977-443c-9961-a0757b07162f None None] MFA Rules not processed for user `3cdcba6d332b492196494db46ced8b9f`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:42.610239 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-495a9419-5977-443c-9961-a0757b07162f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:42.617443 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1307/2622] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:38:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:52.488148 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ede7bb-633f-459d-a146-106c6db69f22 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:52.489595 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-b1ede7bb-633f-459d-a146-106c6db69f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:52.543704 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ede7bb-633f-459d-a146-106c6db69f22 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:52.547900 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8379d504-cf3f-4a95-ab60-14bb28d4bc43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:52.548537 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379d504-cf3f-4a95-ab60-14bb28d4bc43 service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:52.548818 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379d504-cf3f-4a95-ab60-14bb28d4bc43 service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:52.549114 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379d504-cf3f-4a95-ab60-14bb28d4bc43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:52.550992 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-8379d504-cf3f-4a95-ab60-14bb28d4bc43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:52.613218 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8379d504-cf3f-4a95-ab60-14bb28d4bc43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:52.614691 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8379d504-cf3f-4a95-ab60-14bb28d4bc43 service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:52.624505 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1316/2623] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:38:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:38:56.066866 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a9419-5977-443c-9961-a0757b07162f None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:56.068362 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-495a9419-5977-443c-9961-a0757b07162f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:56.088069 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a9419-5977-443c-9961-a0757b07162f None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:56.093693 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0015b3-54c4-4c94-8def-c1efc5525027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:56.094621 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0015b3-54c4-4c94-8def-c1efc5525027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:56.094978 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0015b3-54c4-4c94-8def-c1efc5525027 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:56.095254 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0015b3-54c4-4c94-8def-c1efc5525027 admin admin] PATH_INFO: `/v3/users/da9524bba20140f694ac7cd6e8f37038` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:56.096443 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0015b3-54c4-4c94-8def-c1efc5525027 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da9524bba20140f694ac7cd6e8f37038)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:56.098557 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0015b3-54c4-4c94-8def-c1efc5525027 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:56.145319 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-3e0015b3-54c4-4c94-8def-c1efc5525027 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da9524bba20140f694ac7cd6e8f37038'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:56.145984 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-3e0015b3-54c4-4c94-8def-c1efc5525027 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da9524bba20140f694ac7cd6e8f37038'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:56.160180 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-3e0015b3-54c4-4c94-8def-c1efc5525027 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da9524bba20140f694ac7cd6e8f37038'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:56.167216 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-3e0015b3-54c4-4c94-8def-c1efc5525027 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da9524bba20140f694ac7cd6e8f37038'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:56.174804 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-3e0015b3-54c4-4c94-8def-c1efc5525027 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da9524bba20140f694ac7cd6e8f37038'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:56.181529 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1308/2624] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:38:56 2022] DELETE /identity/v3/users/da9524bba20140f694ac7cd6e8f37038 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:38:56.381729 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8379d504-cf3f-4a95-ab60-14bb28d4bc43 service neutron] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:56.393884 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8379d504-cf3f-4a95-ab60-14bb28d4bc43 service neutron] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:56.450388 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e9e4b-804e-4c98-a1a3-09a0a388336c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:56.451477 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e9e4b-804e-4c98-a1a3-09a0a388336c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:56.451753 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e9e4b-804e-4c98-a1a3-09a0a388336c admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:56.452024 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e9e4b-804e-4c98-a1a3-09a0a388336c admin admin] PATH_INFO: `/v3/projects/003233ff59254fa88847f9adc1437df3` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:56.453323 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e9e4b-804e-4c98-a1a3-09a0a388336c admin admin] RBAC: Authorizing `identity:delete_project(project_id=003233ff59254fa88847f9adc1437df3)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:56.455237 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e9e4b-804e-4c98-a1a3-09a0a388336c admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:56.504948 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-6d8e9e4b-804e-4c98-a1a3-09a0a388336c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '003233ff59254fa88847f9adc1437df3', 'request_id': 'req-6d8e9e4b-804e-4c98-a1a3-09a0a388336c'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:56.510000 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-6d8e9e4b-804e-4c98-a1a3-09a0a388336c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '003233ff59254fa88847f9adc1437df3', 'request_id': 'req-6d8e9e4b-804e-4c98-a1a3-09a0a388336c'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:56.516173 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-6d8e9e4b-804e-4c98-a1a3-09a0a388336c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '003233ff59254fa88847f9adc1437df3', 'request_id': 'req-6d8e9e4b-804e-4c98-a1a3-09a0a388336c'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:56.528790 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-6d8e9e4b-804e-4c98-a1a3-09a0a388336c admin admin] The token cache is being invalidate because project 003233ff59254fa88847f9adc1437df3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:38:56.529307 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-6d8e9e4b-804e-4c98-a1a3-09a0a388336c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:56.529999 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-6d8e9e4b-804e-4c98-a1a3-09a0a388336c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:38:56.531654 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1317/2625] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:38:56 2022] DELETE /identity/v3/projects/003233ff59254fa88847f9adc1437df3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:38:56.537102 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0855dff-5545-4311-9054-9700e4af9ab4 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:56.537382 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0855dff-5545-4311-9054-9700e4af9ab4 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:56.537651 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0855dff-5545-4311-9054-9700e4af9ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:56.557854 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-d0855dff-5545-4311-9054-9700e4af9ab4 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:56.559073 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-d0855dff-5545-4311-9054-9700e4af9ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:56.617869 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1309/2626] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:38:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:56.626103 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b36f43-7cac-4717-b65d-0285dfc744f7 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:56.626392 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b36f43-7cac-4717-b65d-0285dfc744f7 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:56.626681 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b36f43-7cac-4717-b65d-0285dfc744f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:56.647744 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-c1b36f43-7cac-4717-b65d-0285dfc744f7 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:56.648941 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-c1b36f43-7cac-4717-b65d-0285dfc744f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:56.658017 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1318/2627] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:38:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:38:56.662102 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0855dff-5545-4311-9054-9700e4af9ab4 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:56.672025 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0855dff-5545-4311-9054-9700e4af9ab4 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:56.678148 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e68816-71e4-45c0-8247-8eec10b3de64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:56.679403 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e68816-71e4-45c0-8247-8eec10b3de64 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:56.679403 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e68816-71e4-45c0-8247-8eec10b3de64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:56.679723 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e68816-71e4-45c0-8247-8eec10b3de64 admin admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:56.680515 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e68816-71e4-45c0-8247-8eec10b3de64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:38:56.680886 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e68816-71e4-45c0-8247-8eec10b3de64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:56.682591 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e68816-71e4-45c0-8247-8eec10b3de64 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:56.695247 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1310/2628] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:38:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:38:56.699538 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b36f43-7cac-4717-b65d-0285dfc744f7 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:56.711478 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b36f43-7cac-4717-b65d-0285dfc744f7 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:56.716051 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e69658-c829-4322-bfe8-77ab677bc1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:56.717317 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e69658-c829-4322-bfe8-77ab677bc1e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:56.717595 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e69658-c829-4322-bfe8-77ab677bc1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:56.717864 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e69658-c829-4322-bfe8-77ab677bc1e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:56.718550 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e69658-c829-4322-bfe8-77ab677bc1e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:56.720458 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e69658-c829-4322-bfe8-77ab677bc1e6 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:56.756143 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1319/2629] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:38:56 2022] POST /identity/v3/projects => generated 381 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:38:56.760225 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e68816-71e4-45c0-8247-8eec10b3de64 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:56.771246 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e68816-71e4-45c0-8247-8eec10b3de64 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:56.823701 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c2d16-9569-494e-bf77-bfe51deb175d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:56.824348 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c2d16-9569-494e-bf77-bfe51deb175d admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:56.824628 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c2d16-9569-494e-bf77-bfe51deb175d admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:56.824901 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c2d16-9569-494e-bf77-bfe51deb175d admin admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:56.825576 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5c2d16-9569-494e-bf77-bfe51deb175d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:56.828102 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5c2d16-9569-494e-bf77-bfe51deb175d admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:56.850863 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1311/2630] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:38:56 2022] POST /identity/v3/users => generated 291 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:38:56.852901 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e69658-c829-4322-bfe8-77ab677bc1e6 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:56.863319 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e69658-c829-4322-bfe8-77ab677bc1e6 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:56.867844 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd991587-a3bc-4fc7-aabf-0d7968d3373d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:56.868486 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd991587-a3bc-4fc7-aabf-0d7968d3373d admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:56.868766 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd991587-a3bc-4fc7-aabf-0d7968d3373d admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:56.869036 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd991587-a3bc-4fc7-aabf-0d7968d3373d admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:56.869749 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd991587-a3bc-4fc7-aabf-0d7968d3373d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:56.871361 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd991587-a3bc-4fc7-aabf-0d7968d3373d admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:56.881522 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1320/2631] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:38:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:38:56.885389 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c2d16-9569-494e-bf77-bfe51deb175d admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:56.895749 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c2d16-9569-494e-bf77-bfe51deb175d admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:56.900315 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27e23a-f566-4be6-9c72-b8163f24a308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:56.900952 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27e23a-f566-4be6-9c72-b8163f24a308 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:56.901231 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27e23a-f566-4be6-9c72-b8163f24a308 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:56.901504 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27e23a-f566-4be6-9c72-b8163f24a308 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:56.902215 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27e23a-f566-4be6-9c72-b8163f24a308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:56.903878 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27e23a-f566-4be6-9c72-b8163f24a308 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:56.914666 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1312/2632] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:38:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:38:56.918803 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd991587-a3bc-4fc7-aabf-0d7968d3373d admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:56.929953 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd991587-a3bc-4fc7-aabf-0d7968d3373d admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:56.934504 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651dffd7-5f3c-42b8-991c-28243fae8c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:56.935917 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651dffd7-5f3c-42b8-991c-28243fae8c9a admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:56.936201 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651dffd7-5f3c-42b8-991c-28243fae8c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:56.936475 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651dffd7-5f3c-42b8-991c-28243fae8c9a admin admin] PATH_INFO: `/v3/projects/914aee0d38084aedb47b3bf0920c9e47/users/e47f28408c6349b79b722859d45ecfd3/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:56.950397 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651dffd7-5f3c-42b8-991c-28243fae8c9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=914aee0d38084aedb47b3bf0920c9e47, user_id=e47f28408c6349b79b722859d45ecfd3, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:56.953488 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651dffd7-5f3c-42b8-991c-28243fae8c9a admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:56.965862 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1321/2633] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:38:56 2022] PUT /identity/v3/projects/914aee0d38084aedb47b3bf0920c9e47/users/e47f28408c6349b79b722859d45ecfd3/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:38:56.976923 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa4ac3-3b89-462c-b63d-89ecbda24307 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:56.977231 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa4ac3-3b89-462c-b63d-89ecbda24307 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:56.977505 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa4ac3-3b89-462c-b63d-89ecbda24307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:57.004195 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-82fa4ac3-3b89-462c-b63d-89ecbda24307 None None] MFA Rules not processed for user `e47f28408c6349b79b722859d45ecfd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:57.005389 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-82fa4ac3-3b89-462c-b63d-89ecbda24307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:57.068402 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1313/2634] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:38:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:57.072840 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651dffd7-5f3c-42b8-991c-28243fae8c9a admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:57.134988 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651dffd7-5f3c-42b8-991c-28243fae8c9a admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:57.140372 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8913611-2b16-4d59-b0be-1b221f3b6989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:57.141017 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8913611-2b16-4d59-b0be-1b221f3b6989 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:57.141356 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8913611-2b16-4d59-b0be-1b221f3b6989 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:57.141657 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8913611-2b16-4d59-b0be-1b221f3b6989 admin admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:57.142545 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8913611-2b16-4d59-b0be-1b221f3b6989 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:57.144496 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8913611-2b16-4d59-b0be-1b221f3b6989 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:57.169601 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1322/2635] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:38:57 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:38:57.173630 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa4ac3-3b89-462c-b63d-89ecbda24307 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:57.184216 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa4ac3-3b89-462c-b63d-89ecbda24307 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:57.238510 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad248772-a30f-4a28-9564-cf04f4b706d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:57.239189 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad248772-a30f-4a28-9564-cf04f4b706d7 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:57.239470 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad248772-a30f-4a28-9564-cf04f4b706d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:57.239961 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad248772-a30f-4a28-9564-cf04f4b706d7 admin admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:57.240712 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad248772-a30f-4a28-9564-cf04f4b706d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:57.242617 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad248772-a30f-4a28-9564-cf04f4b706d7 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:57.262208 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1314/2636] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:38:57 2022] POST /identity/v3/users => generated 297 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:38:57.266226 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8913611-2b16-4d59-b0be-1b221f3b6989 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:57.276263 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8913611-2b16-4d59-b0be-1b221f3b6989 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:57.281149 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be051c-6bb4-4489-9d84-1210890def60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:57.281821 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be051c-6bb4-4489-9d84-1210890def60 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:57.282100 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be051c-6bb4-4489-9d84-1210890def60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:57.282373 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be051c-6bb4-4489-9d84-1210890def60 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:57.283132 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5be051c-6bb4-4489-9d84-1210890def60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:57.284741 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5be051c-6bb4-4489-9d84-1210890def60 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:57.295638 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1323/2637] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:38:57.299575 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad248772-a30f-4a28-9564-cf04f4b706d7 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:57.309164 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad248772-a30f-4a28-9564-cf04f4b706d7 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:57.314396 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd324a3e-d600-49d7-a989-03d0a3333a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:57.315348 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd324a3e-d600-49d7-a989-03d0a3333a97 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:57.315629 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd324a3e-d600-49d7-a989-03d0a3333a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:57.315903 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd324a3e-d600-49d7-a989-03d0a3333a97 admin admin] PATH_INFO: `/v3/projects/719b15de31ca43ce817b2c8b7c77cf01/users/4480fdbca51448149c3bf87e30b059ac/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:57.331308 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd324a3e-d600-49d7-a989-03d0a3333a97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=719b15de31ca43ce817b2c8b7c77cf01, user_id=4480fdbca51448149c3bf87e30b059ac, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:57.334222 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd324a3e-d600-49d7-a989-03d0a3333a97 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:57.347927 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1315/2638] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:38:57 2022] PUT /identity/v3/projects/719b15de31ca43ce817b2c8b7c77cf01/users/4480fdbca51448149c3bf87e30b059ac/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:38:57.351769 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be051c-6bb4-4489-9d84-1210890def60 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:57.361939 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be051c-6bb4-4489-9d84-1210890def60 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:57.415765 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc424bd7-2152-4394-9e9d-d1f7b3824b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:57.416424 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc424bd7-2152-4394-9e9d-d1f7b3824b97 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:57.416703 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc424bd7-2152-4394-9e9d-d1f7b3824b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:57.416975 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc424bd7-2152-4394-9e9d-d1f7b3824b97 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:57.417688 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc424bd7-2152-4394-9e9d-d1f7b3824b97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:57.419288 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc424bd7-2152-4394-9e9d-d1f7b3824b97 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:57.430186 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1324/2639] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:38:57.434079 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd324a3e-d600-49d7-a989-03d0a3333a97 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:57.444607 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd324a3e-d600-49d7-a989-03d0a3333a97 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:57.449209 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07592652-4141-4808-a3f5-b4ff29ff0302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:57.450148 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07592652-4141-4808-a3f5-b4ff29ff0302 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:57.450428 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07592652-4141-4808-a3f5-b4ff29ff0302 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:57.451309 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07592652-4141-4808-a3f5-b4ff29ff0302 admin admin] PATH_INFO: `/v3/projects/719b15de31ca43ce817b2c8b7c77cf01/users/4480fdbca51448149c3bf87e30b059ac/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:57.453532 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07592652-4141-4808-a3f5-b4ff29ff0302 admin admin] RBAC: Authorizing `identity:create_grant(project_id=719b15de31ca43ce817b2c8b7c77cf01, user_id=4480fdbca51448149c3bf87e30b059ac, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:57.456168 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07592652-4141-4808-a3f5-b4ff29ff0302 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:57.466092 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1316/2640] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:38:57 2022] PUT /identity/v3/projects/719b15de31ca43ce817b2c8b7c77cf01/users/4480fdbca51448149c3bf87e30b059ac/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:38:57.478558 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1dfdda-6170-436f-9138-cf611b25c3da None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:57.478880 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1dfdda-6170-436f-9138-cf611b25c3da None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:57.479155 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1dfdda-6170-436f-9138-cf611b25c3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:57.506495 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-af1dfdda-6170-436f-9138-cf611b25c3da None None] MFA Rules not processed for user `4480fdbca51448149c3bf87e30b059ac`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:38:57.507707 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-af1dfdda-6170-436f-9138-cf611b25c3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:57.573440 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1325/2641] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:38:57 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:38:57.584678 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07592652-4141-4808-a3f5-b4ff29ff0302 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:57.586297 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-07592652-4141-4808-a3f5-b4ff29ff0302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:38:57.641989 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07592652-4141-4808-a3f5-b4ff29ff0302 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:57.645552 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc6dcb-292a-434a-9e48-a5451f96d614 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:57.646175 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc6dcb-292a-434a-9e48-a5451f96d614 service cinder] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:57.646450 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc6dcb-292a-434a-9e48-a5451f96d614 service cinder] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:57.646751 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc6dcb-292a-434a-9e48-a5451f96d614 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:57.655451 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc6dcb-292a-434a-9e48-a5451f96d614 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:57.656850 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc6dcb-292a-434a-9e48-a5451f96d614 service cinder] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:57.666205 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1317/2642] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:38:57 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:38:57.768490 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1dfdda-6170-436f-9138-cf611b25c3da None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:38:57.777849 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1dfdda-6170-436f-9138-cf611b25c3da None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:38:57.782354 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f90d9-7e05-49f0-86cc-aa465b106631 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:38:57.783020 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f90d9-7e05-49f0-86cc-aa465b106631 service cinder] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:38:57.783309 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f90d9-7e05-49f0-86cc-aa465b106631 service cinder] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:38:57.783586 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f90d9-7e05-49f0-86cc-aa465b106631 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:38:57.837748 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f90d9-7e05-49f0-86cc-aa465b106631 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:38:57.839128 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f90d9-7e05-49f0-86cc-aa465b106631 service cinder] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:38:57.849299 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1326/2643] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:38:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:39:00.380931 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc6dcb-292a-434a-9e48-a5451f96d614 service cinder] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:00.439656 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc6dcb-292a-434a-9e48-a5451f96d614 service cinder] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:00.444049 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3201d3a5-ba70-4bf7-b834-f07e47164915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:00.444883 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201d3a5-ba70-4bf7-b834-f07e47164915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:00.445158 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201d3a5-ba70-4bf7-b834-f07e47164915 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:00.445424 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201d3a5-ba70-4bf7-b834-f07e47164915 admin admin] PATH_INFO: `/v3/users/e47f28408c6349b79b722859d45ecfd3` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:00.446586 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3201d3a5-ba70-4bf7-b834-f07e47164915 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e47f28408c6349b79b722859d45ecfd3)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:00.448514 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3201d3a5-ba70-4bf7-b834-f07e47164915 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:00.492472 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-3201d3a5-ba70-4bf7-b834-f07e47164915 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e47f28408c6349b79b722859d45ecfd3'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:00.493113 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-3201d3a5-ba70-4bf7-b834-f07e47164915 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e47f28408c6349b79b722859d45ecfd3'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:00.504798 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-3201d3a5-ba70-4bf7-b834-f07e47164915 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e47f28408c6349b79b722859d45ecfd3'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:00.511584 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-3201d3a5-ba70-4bf7-b834-f07e47164915 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e47f28408c6349b79b722859d45ecfd3'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:00.518751 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-3201d3a5-ba70-4bf7-b834-f07e47164915 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e47f28408c6349b79b722859d45ecfd3'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:00.524422 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1318/2644] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:39:00 2022] DELETE /identity/v3/users/e47f28408c6349b79b722859d45ecfd3 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:00.528935 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802fefa-9e4b-4a73-b55f-07f0100be0d4 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:00.529422 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802fefa-9e4b-4a73-b55f-07f0100be0d4 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:00.529522 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802fefa-9e4b-4a73-b55f-07f0100be0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:00.547140 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-e802fefa-9e4b-4a73-b55f-07f0100be0d4 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:00.548323 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-e802fefa-9e4b-4a73-b55f-07f0100be0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:00.605412 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1327/2645] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:39:00.615101 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3201d3a5-ba70-4bf7-b834-f07e47164915 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:00.616561 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-3201d3a5-ba70-4bf7-b834-f07e47164915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:00.675038 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3201d3a5-ba70-4bf7-b834-f07e47164915 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:00.678653 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f6664-973d-48e9-8ed2-5feb5fa78dc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:00.679284 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f6664-973d-48e9-8ed2-5feb5fa78dc9 service neutron] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:00.679563 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f6664-973d-48e9-8ed2-5feb5fa78dc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:00.679833 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f6664-973d-48e9-8ed2-5feb5fa78dc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:00.688499 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f6664-973d-48e9-8ed2-5feb5fa78dc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:00.689909 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f6664-973d-48e9-8ed2-5feb5fa78dc9 service neutron] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:00.699711 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1319/2646] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:39:00.962061 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802fefa-9e4b-4a73-b55f-07f0100be0d4 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:00.963499 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-e802fefa-9e4b-4a73-b55f-07f0100be0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:00.978375 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802fefa-9e4b-4a73-b55f-07f0100be0d4 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:00.984110 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afecd46b-794e-45d8-a2ac-dbf46b1beab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:00.985052 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afecd46b-794e-45d8-a2ac-dbf46b1beab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:00.985442 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afecd46b-794e-45d8-a2ac-dbf46b1beab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:00.985719 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afecd46b-794e-45d8-a2ac-dbf46b1beab9 admin admin] PATH_INFO: `/v3/projects/914aee0d38084aedb47b3bf0920c9e47` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:00.986916 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afecd46b-794e-45d8-a2ac-dbf46b1beab9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=914aee0d38084aedb47b3bf0920c9e47)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:00.988781 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afecd46b-794e-45d8-a2ac-dbf46b1beab9 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:01.032987 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-afecd46b-794e-45d8-a2ac-dbf46b1beab9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '914aee0d38084aedb47b3bf0920c9e47', 'request_id': 'req-afecd46b-794e-45d8-a2ac-dbf46b1beab9'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:01.038019 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-afecd46b-794e-45d8-a2ac-dbf46b1beab9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '914aee0d38084aedb47b3bf0920c9e47', 'request_id': 'req-afecd46b-794e-45d8-a2ac-dbf46b1beab9'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:01.044156 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-afecd46b-794e-45d8-a2ac-dbf46b1beab9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '914aee0d38084aedb47b3bf0920c9e47', 'request_id': 'req-afecd46b-794e-45d8-a2ac-dbf46b1beab9'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:01.055472 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-afecd46b-794e-45d8-a2ac-dbf46b1beab9 admin admin] The token cache is being invalidate because project 914aee0d38084aedb47b3bf0920c9e47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:39:01.055762 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-afecd46b-794e-45d8-a2ac-dbf46b1beab9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:01.056380 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-afecd46b-794e-45d8-a2ac-dbf46b1beab9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:01.057990 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1328/2647] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:39:00 2022] DELETE /identity/v3/projects/914aee0d38084aedb47b3bf0920c9e47 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:01.061906 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f6664-973d-48e9-8ed2-5feb5fa78dc9 service neutron] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:01.071139 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f6664-973d-48e9-8ed2-5feb5fa78dc9 service neutron] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:01.124916 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e38386e-0187-467d-bde1-5df9f125f4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:01.125809 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38386e-0187-467d-bde1-5df9f125f4af admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:01.126039 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38386e-0187-467d-bde1-5df9f125f4af admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:01.126308 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38386e-0187-467d-bde1-5df9f125f4af admin admin] PATH_INFO: `/v3/users/4480fdbca51448149c3bf87e30b059ac` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:01.127518 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e38386e-0187-467d-bde1-5df9f125f4af admin admin] RBAC: Authorizing `identity:delete_user(user_id=4480fdbca51448149c3bf87e30b059ac)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:01.129390 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e38386e-0187-467d-bde1-5df9f125f4af admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:01.173722 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-3e38386e-0187-467d-bde1-5df9f125f4af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4480fdbca51448149c3bf87e30b059ac'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:01.174327 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-3e38386e-0187-467d-bde1-5df9f125f4af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4480fdbca51448149c3bf87e30b059ac'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:01.185606 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-3e38386e-0187-467d-bde1-5df9f125f4af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4480fdbca51448149c3bf87e30b059ac'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:01.193175 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-3e38386e-0187-467d-bde1-5df9f125f4af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4480fdbca51448149c3bf87e30b059ac'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:01.199809 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-3e38386e-0187-467d-bde1-5df9f125f4af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4480fdbca51448149c3bf87e30b059ac'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:01.205989 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1320/2648] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:39:01 2022] DELETE /identity/v3/users/4480fdbca51448149c3bf87e30b059ac => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:39:01.467214 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afecd46b-794e-45d8-a2ac-dbf46b1beab9 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:01.468860 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-afecd46b-794e-45d8-a2ac-dbf46b1beab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:01.484563 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afecd46b-794e-45d8-a2ac-dbf46b1beab9 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:01.539254 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028e829-8075-4198-a9c9-6189a32f98ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:01.540103 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028e829-8075-4198-a9c9-6189a32f98ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:01.540382 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028e829-8075-4198-a9c9-6189a32f98ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:01.540649 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028e829-8075-4198-a9c9-6189a32f98ce admin admin] PATH_INFO: `/v3/projects/719b15de31ca43ce817b2c8b7c77cf01` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:01.541803 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028e829-8075-4198-a9c9-6189a32f98ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=719b15de31ca43ce817b2c8b7c77cf01)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:01.543688 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028e829-8075-4198-a9c9-6189a32f98ce admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:01.587617 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-b028e829-8075-4198-a9c9-6189a32f98ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '719b15de31ca43ce817b2c8b7c77cf01', 'request_id': 'req-b028e829-8075-4198-a9c9-6189a32f98ce'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:01.592723 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-b028e829-8075-4198-a9c9-6189a32f98ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '719b15de31ca43ce817b2c8b7c77cf01', 'request_id': 'req-b028e829-8075-4198-a9c9-6189a32f98ce'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:01.599139 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-b028e829-8075-4198-a9c9-6189a32f98ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '719b15de31ca43ce817b2c8b7c77cf01', 'request_id': 'req-b028e829-8075-4198-a9c9-6189a32f98ce'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:01.612480 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-b028e829-8075-4198-a9c9-6189a32f98ce admin admin] The token cache is being invalidate because project 719b15de31ca43ce817b2c8b7c77cf01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:39:01.612763 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-b028e829-8075-4198-a9c9-6189a32f98ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:01.613517 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-b028e829-8075-4198-a9c9-6189a32f98ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:01.615056 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1329/2649] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:39:01 2022] DELETE /identity/v3/projects/719b15de31ca43ce817b2c8b7c77cf01 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:01.621190 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132665c-38d0-4b21-82bb-33bca813de22 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:01.621648 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132665c-38d0-4b21-82bb-33bca813de22 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:01.621781 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132665c-38d0-4b21-82bb-33bca813de22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:01.640156 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-7132665c-38d0-4b21-82bb-33bca813de22 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:01.641493 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-7132665c-38d0-4b21-82bb-33bca813de22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:01.700453 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1321/2650] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:39:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:01.708780 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0fc65-2a05-4b3d-9c0d-7e16a7dd2906 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:01.709069 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0fc65-2a05-4b3d-9c0d-7e16a7dd2906 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:01.709372 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0fc65-2a05-4b3d-9c0d-7e16a7dd2906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:01.727682 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-d4d0fc65-2a05-4b3d-9c0d-7e16a7dd2906 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:01.728823 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-d4d0fc65-2a05-4b3d-9c0d-7e16a7dd2906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:01.737246 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1330/2651] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:39:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:01.741496 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7132665c-38d0-4b21-82bb-33bca813de22 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:01.751544 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7132665c-38d0-4b21-82bb-33bca813de22 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:01.756104 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb24738-2b0d-4ade-979e-02757ae4dc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:01.756739 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb24738-2b0d-4ade-979e-02757ae4dc8d admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:01.757011 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb24738-2b0d-4ade-979e-02757ae4dc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:01.757287 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb24738-2b0d-4ade-979e-02757ae4dc8d admin admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:01.758021 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb24738-2b0d-4ade-979e-02757ae4dc8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:39:01.758326 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb24738-2b0d-4ade-979e-02757ae4dc8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:01.760036 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb24738-2b0d-4ade-979e-02757ae4dc8d admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:01.771913 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1322/2652] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:39:01.775962 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0fc65-2a05-4b3d-9c0d-7e16a7dd2906 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:01.785292 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0fc65-2a05-4b3d-9c0d-7e16a7dd2906 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:01.789947 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b5361c-dda6-4692-8252-e992003cfcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:01.790585 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5361c-dda6-4692-8252-e992003cfcde admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:01.790895 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5361c-dda6-4692-8252-e992003cfcde admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:01.791167 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5361c-dda6-4692-8252-e992003cfcde admin admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:01.791849 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b5361c-dda6-4692-8252-e992003cfcde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:01.793718 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b5361c-dda6-4692-8252-e992003cfcde admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:01.820171 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1331/2653] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:39:01 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:01.824244 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb24738-2b0d-4ade-979e-02757ae4dc8d admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:01.833949 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb24738-2b0d-4ade-979e-02757ae4dc8d admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:01.889662 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dea8e74-717c-489f-8698-626d3041e8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:01.890735 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea8e74-717c-489f-8698-626d3041e8b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:01.891013 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea8e74-717c-489f-8698-626d3041e8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:01.891281 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea8e74-717c-489f-8698-626d3041e8b7 admin admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:01.891946 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dea8e74-717c-489f-8698-626d3041e8b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:01.894230 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dea8e74-717c-489f-8698-626d3041e8b7 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:01.913569 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1323/2654] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:39:01 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:01.917609 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b5361c-dda6-4692-8252-e992003cfcde admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:01.929034 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b5361c-dda6-4692-8252-e992003cfcde admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:01.933570 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439aada-af7b-4192-8d5e-ded7a139fe26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:01.934210 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439aada-af7b-4192-8d5e-ded7a139fe26 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:01.934489 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439aada-af7b-4192-8d5e-ded7a139fe26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:01.934788 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439aada-af7b-4192-8d5e-ded7a139fe26 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:01.935499 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0439aada-af7b-4192-8d5e-ded7a139fe26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:01.938165 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0439aada-af7b-4192-8d5e-ded7a139fe26 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:01.948430 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1332/2655] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:39:01.952350 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dea8e74-717c-489f-8698-626d3041e8b7 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:01.962425 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dea8e74-717c-489f-8698-626d3041e8b7 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:01.967067 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba84a45-b967-4428-8387-f591895565eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:01.967706 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba84a45-b967-4428-8387-f591895565eb admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:01.968582 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba84a45-b967-4428-8387-f591895565eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:01.968878 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba84a45-b967-4428-8387-f591895565eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:01.969593 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba84a45-b967-4428-8387-f591895565eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:01.971293 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba84a45-b967-4428-8387-f591895565eb admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:01.981491 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1324/2656] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:01.986427 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439aada-af7b-4192-8d5e-ded7a139fe26 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:01.996250 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439aada-af7b-4192-8d5e-ded7a139fe26 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:02.001302 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29700c09-c135-49fb-b518-00c14bbcd752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:02.002160 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29700c09-c135-49fb-b518-00c14bbcd752 admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:02.002443 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29700c09-c135-49fb-b518-00c14bbcd752 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:02.002754 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29700c09-c135-49fb-b518-00c14bbcd752 admin admin] PATH_INFO: `/v3/projects/74d02dbffd66461ab71542e1271e0d81/users/4dbd7e9b9c844be08e54d1caffe75468/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:02.017086 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29700c09-c135-49fb-b518-00c14bbcd752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74d02dbffd66461ab71542e1271e0d81, user_id=4dbd7e9b9c844be08e54d1caffe75468, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:02.019736 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29700c09-c135-49fb-b518-00c14bbcd752 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:02.032698 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1333/2657] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:01 2022] PUT /identity/v3/projects/74d02dbffd66461ab71542e1271e0d81/users/4dbd7e9b9c844be08e54d1caffe75468/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:02.043045 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d7b72-5a80-42b1-8e3d-949db13e9eb0 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:02.043386 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d7b72-5a80-42b1-8e3d-949db13e9eb0 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:02.043644 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d7b72-5a80-42b1-8e3d-949db13e9eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:02.070327 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-266d7b72-5a80-42b1-8e3d-949db13e9eb0 None None] MFA Rules not processed for user `4dbd7e9b9c844be08e54d1caffe75468`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:02.071541 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-266d7b72-5a80-42b1-8e3d-949db13e9eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:02.132863 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1325/2658] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:39:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:02.137284 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29700c09-c135-49fb-b518-00c14bbcd752 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:02.198011 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29700c09-c135-49fb-b518-00c14bbcd752 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:02.203075 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a301f0-abef-4ba7-80c2-526b5554b9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:02.203748 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a301f0-abef-4ba7-80c2-526b5554b9a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:02.204029 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a301f0-abef-4ba7-80c2-526b5554b9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:02.204304 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a301f0-abef-4ba7-80c2-526b5554b9a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:02.204985 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a301f0-abef-4ba7-80c2-526b5554b9a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:02.206888 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a301f0-abef-4ba7-80c2-526b5554b9a1 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:02.232772 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1334/2659] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:39:02 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:02.237240 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d7b72-5a80-42b1-8e3d-949db13e9eb0 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:02.247781 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d7b72-5a80-42b1-8e3d-949db13e9eb0 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:02.307180 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ac4cf-92ad-48b3-ab1e-9131f0d982d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:02.307832 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ac4cf-92ad-48b3-ab1e-9131f0d982d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:02.308109 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ac4cf-92ad-48b3-ab1e-9131f0d982d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:02.308374 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ac4cf-92ad-48b3-ab1e-9131f0d982d9 admin admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:02.309050 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ac4cf-92ad-48b3-ab1e-9131f0d982d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:02.310988 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ac4cf-92ad-48b3-ab1e-9131f0d982d9 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:02.331392 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1326/2660] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:39:02 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:02.335434 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a301f0-abef-4ba7-80c2-526b5554b9a1 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:02.347627 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a301f0-abef-4ba7-80c2-526b5554b9a1 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:02.352214 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b27b0-def0-4dc2-9aa5-0b96aca41a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:02.352899 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b27b0-def0-4dc2-9aa5-0b96aca41a6b admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:02.353182 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b27b0-def0-4dc2-9aa5-0b96aca41a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:02.353472 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b27b0-def0-4dc2-9aa5-0b96aca41a6b admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:02.354326 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b27b0-def0-4dc2-9aa5-0b96aca41a6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:02.355788 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b27b0-def0-4dc2-9aa5-0b96aca41a6b admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:02.367658 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1335/2661] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:02.371827 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ac4cf-92ad-48b3-ab1e-9131f0d982d9 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:02.381595 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ac4cf-92ad-48b3-ab1e-9131f0d982d9 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:02.386187 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c386f-1aee-4565-8da5-5854cbda2ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:02.387086 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c386f-1aee-4565-8da5-5854cbda2ff4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:02.387368 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c386f-1aee-4565-8da5-5854cbda2ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:02.387641 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c386f-1aee-4565-8da5-5854cbda2ff4 admin admin] PATH_INFO: `/v3/projects/00a8d4ff983c4b8e813fbfb4a741446f/users/5baee293b6694d5089c730f38ae77782/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:02.403775 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c386f-1aee-4565-8da5-5854cbda2ff4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00a8d4ff983c4b8e813fbfb4a741446f, user_id=5baee293b6694d5089c730f38ae77782, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:02.407139 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c386f-1aee-4565-8da5-5854cbda2ff4 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:02.419660 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1327/2662] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:02 2022] PUT /identity/v3/projects/00a8d4ff983c4b8e813fbfb4a741446f/users/5baee293b6694d5089c730f38ae77782/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:02.423852 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b27b0-def0-4dc2-9aa5-0b96aca41a6b admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:02.433499 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b27b0-def0-4dc2-9aa5-0b96aca41a6b admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:02.489057 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd693e8-dabc-4a23-ab00-b3f49f4538b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:02.489634 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd693e8-dabc-4a23-ab00-b3f49f4538b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:02.489910 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd693e8-dabc-4a23-ab00-b3f49f4538b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:02.490176 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd693e8-dabc-4a23-ab00-b3f49f4538b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:02.490917 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd693e8-dabc-4a23-ab00-b3f49f4538b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:02.492502 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd693e8-dabc-4a23-ab00-b3f49f4538b3 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:02.502037 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1336/2663] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:39:02.506161 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c386f-1aee-4565-8da5-5854cbda2ff4 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:02.516745 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c386f-1aee-4565-8da5-5854cbda2ff4 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:02.521313 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1959d5-4e63-476f-a9d6-889c43ab45af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:02.522175 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1959d5-4e63-476f-a9d6-889c43ab45af admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:02.522454 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1959d5-4e63-476f-a9d6-889c43ab45af admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:02.522772 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1959d5-4e63-476f-a9d6-889c43ab45af admin admin] PATH_INFO: `/v3/projects/00a8d4ff983c4b8e813fbfb4a741446f/users/5baee293b6694d5089c730f38ae77782/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:02.524730 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1959d5-4e63-476f-a9d6-889c43ab45af admin admin] RBAC: Authorizing `identity:create_grant(project_id=00a8d4ff983c4b8e813fbfb4a741446f, user_id=5baee293b6694d5089c730f38ae77782, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:02.527359 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1959d5-4e63-476f-a9d6-889c43ab45af admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:02.537907 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1328/2664] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:02 2022] PUT /identity/v3/projects/00a8d4ff983c4b8e813fbfb4a741446f/users/5baee293b6694d5089c730f38ae77782/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:02.549102 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfddb9-14bd-474e-954e-69e7e78182c1 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:02.549592 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfddb9-14bd-474e-954e-69e7e78182c1 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:02.549692 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfddb9-14bd-474e-954e-69e7e78182c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:02.575812 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-a7cfddb9-14bd-474e-954e-69e7e78182c1 None None] MFA Rules not processed for user `5baee293b6694d5089c730f38ae77782`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:02.577039 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-a7cfddb9-14bd-474e-954e-69e7e78182c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:02.642795 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1337/2665] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:39:02 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:02.653481 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1959d5-4e63-476f-a9d6-889c43ab45af admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:02.655366 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-6e1959d5-4e63-476f-a9d6-889c43ab45af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:02.719335 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1959d5-4e63-476f-a9d6-889c43ab45af admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:02.724356 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25611e7-c52f-42bf-86a7-ba477c4ea9ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:02.725005 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25611e7-c52f-42bf-86a7-ba477c4ea9ca service cinder] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:02.725287 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25611e7-c52f-42bf-86a7-ba477c4ea9ca service cinder] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:02.725559 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25611e7-c52f-42bf-86a7-ba477c4ea9ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:02.781497 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25611e7-c52f-42bf-86a7-ba477c4ea9ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:02.782863 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25611e7-c52f-42bf-86a7-ba477c4ea9ca service cinder] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:02.791482 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1329/2666] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:39:05.288875 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cfddb9-14bd-474e-954e-69e7e78182c1 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:05.350972 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cfddb9-14bd-474e-954e-69e7e78182c1 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:05.355500 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1514c7-9bc7-4ffe-9198-4197ed93742d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:05.356355 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1514c7-9bc7-4ffe-9198-4197ed93742d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:05.356643 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1514c7-9bc7-4ffe-9198-4197ed93742d admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:05.356917 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1514c7-9bc7-4ffe-9198-4197ed93742d admin admin] PATH_INFO: `/v3/users/4dbd7e9b9c844be08e54d1caffe75468` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:05.358093 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1514c7-9bc7-4ffe-9198-4197ed93742d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dbd7e9b9c844be08e54d1caffe75468)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:05.360610 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1514c7-9bc7-4ffe-9198-4197ed93742d admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:05.403947 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-3c1514c7-9bc7-4ffe-9198-4197ed93742d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dbd7e9b9c844be08e54d1caffe75468'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:05.411252 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-3c1514c7-9bc7-4ffe-9198-4197ed93742d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dbd7e9b9c844be08e54d1caffe75468'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:05.411864 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-3c1514c7-9bc7-4ffe-9198-4197ed93742d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dbd7e9b9c844be08e54d1caffe75468'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:05.423206 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-3c1514c7-9bc7-4ffe-9198-4197ed93742d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dbd7e9b9c844be08e54d1caffe75468'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:05.429686 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-3c1514c7-9bc7-4ffe-9198-4197ed93742d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dbd7e9b9c844be08e54d1caffe75468'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:05.435370 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1338/2667] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:39:05 2022] DELETE /identity/v3/users/4dbd7e9b9c844be08e54d1caffe75468 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:05.439973 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f0b1c-ef7d-45f5-87fe-619d5b3063ab None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:05.440479 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f0b1c-ef7d-45f5-87fe-619d5b3063ab None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:05.440591 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f0b1c-ef7d-45f5-87fe-619d5b3063ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:05.458048 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-964f0b1c-ef7d-45f5-87fe-619d5b3063ab None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:05.459268 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-964f0b1c-ef7d-45f5-87fe-619d5b3063ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:05.515262 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1330/2668] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:39:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:05.525356 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1514c7-9bc7-4ffe-9198-4197ed93742d admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:05.526810 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-3c1514c7-9bc7-4ffe-9198-4197ed93742d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:05.584884 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1514c7-9bc7-4ffe-9198-4197ed93742d admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:05.588789 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5074354e-631c-4275-a546-fa958983f382 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:05.589461 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074354e-631c-4275-a546-fa958983f382 service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:05.589744 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074354e-631c-4275-a546-fa958983f382 service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:05.590018 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074354e-631c-4275-a546-fa958983f382 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:05.600807 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5074354e-631c-4275-a546-fa958983f382 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:05.602221 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5074354e-631c-4275-a546-fa958983f382 service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:05.611994 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1339/2669] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:39:05.869901 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f0b1c-ef7d-45f5-87fe-619d5b3063ab None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:05.871362 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-964f0b1c-ef7d-45f5-87fe-619d5b3063ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:05.884436 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f0b1c-ef7d-45f5-87fe-619d5b3063ab None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:05.889482 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956ae53-ee75-4d1f-b82d-8945544b1d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:05.891194 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956ae53-ee75-4d1f-b82d-8945544b1d4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:05.891473 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956ae53-ee75-4d1f-b82d-8945544b1d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:05.891747 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956ae53-ee75-4d1f-b82d-8945544b1d4b admin admin] PATH_INFO: `/v3/projects/74d02dbffd66461ab71542e1271e0d81` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:05.892955 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7956ae53-ee75-4d1f-b82d-8945544b1d4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=74d02dbffd66461ab71542e1271e0d81)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:05.895043 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7956ae53-ee75-4d1f-b82d-8945544b1d4b admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:05.940055 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-7956ae53-ee75-4d1f-b82d-8945544b1d4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74d02dbffd66461ab71542e1271e0d81', 'request_id': 'req-7956ae53-ee75-4d1f-b82d-8945544b1d4b'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:05.945386 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-7956ae53-ee75-4d1f-b82d-8945544b1d4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74d02dbffd66461ab71542e1271e0d81', 'request_id': 'req-7956ae53-ee75-4d1f-b82d-8945544b1d4b'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:05.951427 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-7956ae53-ee75-4d1f-b82d-8945544b1d4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74d02dbffd66461ab71542e1271e0d81', 'request_id': 'req-7956ae53-ee75-4d1f-b82d-8945544b1d4b'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:05.963799 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-7956ae53-ee75-4d1f-b82d-8945544b1d4b admin admin] The token cache is being invalidate because project 74d02dbffd66461ab71542e1271e0d81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:39:05.964144 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-7956ae53-ee75-4d1f-b82d-8945544b1d4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:05.964752 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-7956ae53-ee75-4d1f-b82d-8945544b1d4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:05.966267 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1331/2670] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:39:05 2022] DELETE /identity/v3/projects/74d02dbffd66461ab71542e1271e0d81 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:05.971040 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5074354e-631c-4275-a546-fa958983f382 service neutron] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:05.980605 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5074354e-631c-4275-a546-fa958983f382 service neutron] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:06.035183 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d778ded7-c2af-4bca-9704-b1aa458af4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:06.036034 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778ded7-c2af-4bca-9704-b1aa458af4b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:06.036324 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778ded7-c2af-4bca-9704-b1aa458af4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:06.036581 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778ded7-c2af-4bca-9704-b1aa458af4b9 admin admin] PATH_INFO: `/v3/users/5baee293b6694d5089c730f38ae77782` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:06.037746 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d778ded7-c2af-4bca-9704-b1aa458af4b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5baee293b6694d5089c730f38ae77782)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:06.039709 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d778ded7-c2af-4bca-9704-b1aa458af4b9 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:06.082965 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-d778ded7-c2af-4bca-9704-b1aa458af4b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5baee293b6694d5089c730f38ae77782'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:06.089959 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-d778ded7-c2af-4bca-9704-b1aa458af4b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5baee293b6694d5089c730f38ae77782'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:06.090582 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-d778ded7-c2af-4bca-9704-b1aa458af4b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5baee293b6694d5089c730f38ae77782'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:06.104166 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-d778ded7-c2af-4bca-9704-b1aa458af4b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5baee293b6694d5089c730f38ae77782'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:06.112255 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-d778ded7-c2af-4bca-9704-b1aa458af4b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5baee293b6694d5089c730f38ae77782'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:06.117968 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1340/2671] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:39:05 2022] DELETE /identity/v3/users/5baee293b6694d5089c730f38ae77782 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:06.384453 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956ae53-ee75-4d1f-b82d-8945544b1d4b admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:06.385875 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-7956ae53-ee75-4d1f-b82d-8945544b1d4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:06.406041 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956ae53-ee75-4d1f-b82d-8945544b1d4b admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:06.469224 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13905ac5-8158-4561-ad05-7783feae8ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:06.470076 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13905ac5-8158-4561-ad05-7783feae8ea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:06.470354 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13905ac5-8158-4561-ad05-7783feae8ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:06.470665 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13905ac5-8158-4561-ad05-7783feae8ea8 admin admin] PATH_INFO: `/v3/projects/00a8d4ff983c4b8e813fbfb4a741446f` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:06.471864 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13905ac5-8158-4561-ad05-7783feae8ea8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00a8d4ff983c4b8e813fbfb4a741446f)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:06.474410 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13905ac5-8158-4561-ad05-7783feae8ea8 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:06.521723 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-13905ac5-8158-4561-ad05-7783feae8ea8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00a8d4ff983c4b8e813fbfb4a741446f', 'request_id': 'req-13905ac5-8158-4561-ad05-7783feae8ea8'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:06.526873 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-13905ac5-8158-4561-ad05-7783feae8ea8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00a8d4ff983c4b8e813fbfb4a741446f', 'request_id': 'req-13905ac5-8158-4561-ad05-7783feae8ea8'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:06.533861 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-13905ac5-8158-4561-ad05-7783feae8ea8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00a8d4ff983c4b8e813fbfb4a741446f', 'request_id': 'req-13905ac5-8158-4561-ad05-7783feae8ea8'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:06.547351 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-13905ac5-8158-4561-ad05-7783feae8ea8 admin admin] The token cache is being invalidate because project 00a8d4ff983c4b8e813fbfb4a741446f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:39:06.547645 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-13905ac5-8158-4561-ad05-7783feae8ea8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:06.548291 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-13905ac5-8158-4561-ad05-7783feae8ea8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:06.549896 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1332/2672] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:39:06 2022] DELETE /identity/v3/projects/00a8d4ff983c4b8e813fbfb4a741446f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:06.554846 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7a034-bea1-4c8c-bf9e-e4b95b8455cd None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:06.555344 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7a034-bea1-4c8c-bf9e-e4b95b8455cd None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:06.555455 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7a034-bea1-4c8c-bf9e-e4b95b8455cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:06.572992 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-fcc7a034-bea1-4c8c-bf9e-e4b95b8455cd None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:06.574248 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-fcc7a034-bea1-4c8c-bf9e-e4b95b8455cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:06.636426 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1341/2673] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:39:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:39:06.644303 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54999f-003d-453c-a112-9cabebeaf169 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:06.644591 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54999f-003d-453c-a112-9cabebeaf169 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:06.644890 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54999f-003d-453c-a112-9cabebeaf169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:06.663562 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-8f54999f-003d-453c-a112-9cabebeaf169 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:06.664770 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-8f54999f-003d-453c-a112-9cabebeaf169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:06.673459 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1333/2674] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:39:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:06.677638 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7a034-bea1-4c8c-bf9e-e4b95b8455cd None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:06.687334 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7a034-bea1-4c8c-bf9e-e4b95b8455cd None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:06.691838 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef916c-cc3e-4d1e-96a6-8775f207cf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:06.692477 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef916c-cc3e-4d1e-96a6-8775f207cf4e admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:06.692742 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef916c-cc3e-4d1e-96a6-8775f207cf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:06.693009 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef916c-cc3e-4d1e-96a6-8775f207cf4e admin admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:06.693709 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef916c-cc3e-4d1e-96a6-8775f207cf4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:39:06.694010 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef916c-cc3e-4d1e-96a6-8775f207cf4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:06.695596 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef916c-cc3e-4d1e-96a6-8775f207cf4e admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:06.707231 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1342/2675] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:39:06.711320 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54999f-003d-453c-a112-9cabebeaf169 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:06.720915 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54999f-003d-453c-a112-9cabebeaf169 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:06.726122 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acbaa50-6a90-42e0-b447-64264f782caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:06.726807 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbaa50-6a90-42e0-b447-64264f782caf admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:06.727112 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbaa50-6a90-42e0-b447-64264f782caf admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:06.727389 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbaa50-6a90-42e0-b447-64264f782caf admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:06.728064 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acbaa50-6a90-42e0-b447-64264f782caf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:06.729989 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acbaa50-6a90-42e0-b447-64264f782caf admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:06.754957 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1334/2676] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:39:06 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:06.759171 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef916c-cc3e-4d1e-96a6-8775f207cf4e admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:06.769153 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef916c-cc3e-4d1e-96a6-8775f207cf4e admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:06.823303 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf90b1-b4a4-4c9e-b35f-09ba04e89b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:06.824023 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf90b1-b4a4-4c9e-b35f-09ba04e89b19 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:06.824312 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf90b1-b4a4-4c9e-b35f-09ba04e89b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:06.824591 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf90b1-b4a4-4c9e-b35f-09ba04e89b19 admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:06.825269 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bf90b1-b4a4-4c9e-b35f-09ba04e89b19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:06.827298 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bf90b1-b4a4-4c9e-b35f-09ba04e89b19 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:06.847556 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1343/2677] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:39:06 2022] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:39:06.851617 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acbaa50-6a90-42e0-b447-64264f782caf admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:06.864781 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acbaa50-6a90-42e0-b447-64264f782caf admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:06.869351 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa46cb-8578-4be1-9987-00535bd594b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:06.869994 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa46cb-8578-4be1-9987-00535bd594b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:06.870275 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa46cb-8578-4be1-9987-00535bd594b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:06.870549 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa46cb-8578-4be1-9987-00535bd594b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:06.871295 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa46cb-8578-4be1-9987-00535bd594b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:06.872873 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa46cb-8578-4be1-9987-00535bd594b6 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:06.883098 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1335/2678] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:06.887086 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf90b1-b4a4-4c9e-b35f-09ba04e89b19 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:06.897375 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf90b1-b4a4-4c9e-b35f-09ba04e89b19 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:06.902213 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08fafe9-f752-423c-a2f3-761eeb7c1a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:06.902888 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fafe9-f752-423c-a2f3-761eeb7c1a77 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:06.903168 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fafe9-f752-423c-a2f3-761eeb7c1a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:06.903438 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fafe9-f752-423c-a2f3-761eeb7c1a77 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:06.904146 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08fafe9-f752-423c-a2f3-761eeb7c1a77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:06.906373 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08fafe9-f752-423c-a2f3-761eeb7c1a77 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:06.916761 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1344/2679] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:39:06.920857 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa46cb-8578-4be1-9987-00535bd594b6 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:06.930923 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa46cb-8578-4be1-9987-00535bd594b6 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:06.935547 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a741f23-8b43-496f-b23c-b1390a3d345c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:06.936407 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a741f23-8b43-496f-b23c-b1390a3d345c admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:06.936737 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a741f23-8b43-496f-b23c-b1390a3d345c admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:06.937012 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a741f23-8b43-496f-b23c-b1390a3d345c admin admin] PATH_INFO: `/v3/projects/eac1f4c38868466fb67ed0ace5487d84/users/ab36d8f7c9c94e0eba452f5f70bcfaa7/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:06.951038 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a741f23-8b43-496f-b23c-b1390a3d345c admin admin] RBAC: Authorizing `identity:create_grant(project_id=eac1f4c38868466fb67ed0ace5487d84, user_id=ab36d8f7c9c94e0eba452f5f70bcfaa7, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:06.954492 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a741f23-8b43-496f-b23c-b1390a3d345c admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:06.966583 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1336/2680] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:06 2022] PUT /identity/v3/projects/eac1f4c38868466fb67ed0ace5487d84/users/ab36d8f7c9c94e0eba452f5f70bcfaa7/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:06.979082 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43085d58-d51e-4be0-a39b-02c0796c4304 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:06.979374 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43085d58-d51e-4be0-a39b-02c0796c4304 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:06.979683 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43085d58-d51e-4be0-a39b-02c0796c4304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:07.005688 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-43085d58-d51e-4be0-a39b-02c0796c4304 None None] MFA Rules not processed for user `ab36d8f7c9c94e0eba452f5f70bcfaa7`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:07.006935 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-43085d58-d51e-4be0-a39b-02c0796c4304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:07.070084 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1345/2681] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:39:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:39:07.081680 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a741f23-8b43-496f-b23c-b1390a3d345c admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:07.083377 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-4a741f23-8b43-496f-b23c-b1390a3d345c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:07.139446 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a741f23-8b43-496f-b23c-b1390a3d345c admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:07.143848 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6af23b-3936-494f-9b52-08316ff7e1b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:07.144476 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6af23b-3936-494f-9b52-08316ff7e1b9 service cinder] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:07.144752 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6af23b-3936-494f-9b52-08316ff7e1b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:07.145023 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6af23b-3936-494f-9b52-08316ff7e1b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:07.153012 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6af23b-3936-494f-9b52-08316ff7e1b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:07.154413 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6af23b-3936-494f-9b52-08316ff7e1b9 service cinder] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:07.163781 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1337/2682] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:39:09.676042 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43085d58-d51e-4be0-a39b-02c0796c4304 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:09.738634 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43085d58-d51e-4be0-a39b-02c0796c4304 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:09.743334 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d941c71-7702-4660-95da-4c811cd89bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:09.744193 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d941c71-7702-4660-95da-4c811cd89bec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:09.744474 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d941c71-7702-4660-95da-4c811cd89bec admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:09.744746 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d941c71-7702-4660-95da-4c811cd89bec admin admin] PATH_INFO: `/v3/users/ab36d8f7c9c94e0eba452f5f70bcfaa7` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:09.745939 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d941c71-7702-4660-95da-4c811cd89bec admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab36d8f7c9c94e0eba452f5f70bcfaa7)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:09.747904 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d941c71-7702-4660-95da-4c811cd89bec admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:09.793170 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-6d941c71-7702-4660-95da-4c811cd89bec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab36d8f7c9c94e0eba452f5f70bcfaa7'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:09.800121 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-6d941c71-7702-4660-95da-4c811cd89bec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab36d8f7c9c94e0eba452f5f70bcfaa7'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:09.800959 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-6d941c71-7702-4660-95da-4c811cd89bec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab36d8f7c9c94e0eba452f5f70bcfaa7'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:09.812335 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-6d941c71-7702-4660-95da-4c811cd89bec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab36d8f7c9c94e0eba452f5f70bcfaa7'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:09.818764 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-6d941c71-7702-4660-95da-4c811cd89bec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab36d8f7c9c94e0eba452f5f70bcfaa7'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:09.824448 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1346/2683] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:39:09 2022] DELETE /identity/v3/users/ab36d8f7c9c94e0eba452f5f70bcfaa7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:09.828961 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a818c99-1f0d-4daa-a202-9abbe33c32df None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:09.829469 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a818c99-1f0d-4daa-a202-9abbe33c32df None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:09.829571 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a818c99-1f0d-4daa-a202-9abbe33c32df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:09.846639 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-1a818c99-1f0d-4daa-a202-9abbe33c32df None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:09.848098 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-1a818c99-1f0d-4daa-a202-9abbe33c32df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:09.904934 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1338/2684] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:39:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:39:09.914964 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d941c71-7702-4660-95da-4c811cd89bec admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:09.916370 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-6d941c71-7702-4660-95da-4c811cd89bec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:09.974685 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d941c71-7702-4660-95da-4c811cd89bec admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:09.978394 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54fdcd-77b5-4d93-95fa-b84a5319ec13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:09.979068 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54fdcd-77b5-4d93-95fa-b84a5319ec13 service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:09.979357 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54fdcd-77b5-4d93-95fa-b84a5319ec13 service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:09.979707 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54fdcd-77b5-4d93-95fa-b84a5319ec13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:09.988951 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa54fdcd-77b5-4d93-95fa-b84a5319ec13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:09.990372 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa54fdcd-77b5-4d93-95fa-b84a5319ec13 service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:10.000012 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1347/2685] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:39:10.272988 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a818c99-1f0d-4daa-a202-9abbe33c32df None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:10.274830 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-1a818c99-1f0d-4daa-a202-9abbe33c32df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:10.291377 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a818c99-1f0d-4daa-a202-9abbe33c32df None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:10.298152 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0340cc44-3925-466f-ada2-cb2d687bd542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:10.299016 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340cc44-3925-466f-ada2-cb2d687bd542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:10.299295 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340cc44-3925-466f-ada2-cb2d687bd542 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:10.299607 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340cc44-3925-466f-ada2-cb2d687bd542 admin admin] PATH_INFO: `/v3/projects/eac1f4c38868466fb67ed0ace5487d84` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:10.300709 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0340cc44-3925-466f-ada2-cb2d687bd542 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eac1f4c38868466fb67ed0ace5487d84)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:10.302576 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0340cc44-3925-466f-ada2-cb2d687bd542 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:10.355114 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-0340cc44-3925-466f-ada2-cb2d687bd542 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eac1f4c38868466fb67ed0ace5487d84', 'request_id': 'req-0340cc44-3925-466f-ada2-cb2d687bd542'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:10.360422 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-0340cc44-3925-466f-ada2-cb2d687bd542 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eac1f4c38868466fb67ed0ace5487d84', 'request_id': 'req-0340cc44-3925-466f-ada2-cb2d687bd542'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:10.366406 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-0340cc44-3925-466f-ada2-cb2d687bd542 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eac1f4c38868466fb67ed0ace5487d84', 'request_id': 'req-0340cc44-3925-466f-ada2-cb2d687bd542'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:10.378945 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-0340cc44-3925-466f-ada2-cb2d687bd542 admin admin] The token cache is being invalidate because project eac1f4c38868466fb67ed0ace5487d84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:39:10.379223 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-0340cc44-3925-466f-ada2-cb2d687bd542 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:10.379824 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-0340cc44-3925-466f-ada2-cb2d687bd542 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:10.381326 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1339/2686] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:39:10 2022] DELETE /identity/v3/projects/eac1f4c38868466fb67ed0ace5487d84 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:10.386645 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d080252-c6af-4a96-8473-d9007cb31fd3 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:10.386936 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d080252-c6af-4a96-8473-d9007cb31fd3 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:10.387209 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d080252-c6af-4a96-8473-d9007cb31fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:10.405918 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-5d080252-c6af-4a96-8473-d9007cb31fd3 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:10.407063 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-5d080252-c6af-4a96-8473-d9007cb31fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:10.467441 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1348/2687] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:10.475668 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fa724-9d81-4b22-8bef-3f6a21d92147 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:10.475949 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fa724-9d81-4b22-8bef-3f6a21d92147 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:10.476217 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fa724-9d81-4b22-8bef-3f6a21d92147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:10.494871 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-d42fa724-9d81-4b22-8bef-3f6a21d92147 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:10.496119 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-d42fa724-9d81-4b22-8bef-3f6a21d92147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:10.505773 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1340/2688] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:10.510446 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d080252-c6af-4a96-8473-d9007cb31fd3 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:10.521485 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d080252-c6af-4a96-8473-d9007cb31fd3 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:10.526574 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f06ff-a59c-4b37-9957-72afcc4df44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:10.527263 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f06ff-a59c-4b37-9957-72afcc4df44a admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:10.527545 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f06ff-a59c-4b37-9957-72afcc4df44a admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:10.527820 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f06ff-a59c-4b37-9957-72afcc4df44a admin admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:10.528532 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f06ff-a59c-4b37-9957-72afcc4df44a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:39:10.528838 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f06ff-a59c-4b37-9957-72afcc4df44a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:10.530669 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f06ff-a59c-4b37-9957-72afcc4df44a admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:10.542650 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1349/2689] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:39:10.547313 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42fa724-9d81-4b22-8bef-3f6a21d92147 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:10.556720 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42fa724-9d81-4b22-8bef-3f6a21d92147 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:10.561458 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6778444c-2f7f-4e62-90bc-b41995d27470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:10.562667 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778444c-2f7f-4e62-90bc-b41995d27470 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:10.562952 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778444c-2f7f-4e62-90bc-b41995d27470 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:10.563222 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778444c-2f7f-4e62-90bc-b41995d27470 admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:10.563908 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6778444c-2f7f-4e62-90bc-b41995d27470 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:10.565808 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6778444c-2f7f-4e62-90bc-b41995d27470 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:10.595153 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1341/2690] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:39:10 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:10.596297 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f06ff-a59c-4b37-9957-72afcc4df44a admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:10.607165 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f06ff-a59c-4b37-9957-72afcc4df44a admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:10.665939 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2c17f-ab94-4764-a341-8c045d926274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:10.666606 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2c17f-ab94-4764-a341-8c045d926274 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:10.666904 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2c17f-ab94-4764-a341-8c045d926274 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:10.667199 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2c17f-ab94-4764-a341-8c045d926274 admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:10.667871 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a2c17f-ab94-4764-a341-8c045d926274 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:10.669899 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a2c17f-ab94-4764-a341-8c045d926274 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:10.692182 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1350/2691] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:39:10 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:10.696577 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6778444c-2f7f-4e62-90bc-b41995d27470 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:10.706849 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6778444c-2f7f-4e62-90bc-b41995d27470 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:10.711638 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc92f97-6ff0-423a-b0f0-45709b53b45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:10.712283 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc92f97-6ff0-423a-b0f0-45709b53b45b admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:10.712560 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc92f97-6ff0-423a-b0f0-45709b53b45b admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:10.712831 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc92f97-6ff0-423a-b0f0-45709b53b45b admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:10.713539 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc92f97-6ff0-423a-b0f0-45709b53b45b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:10.715146 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc92f97-6ff0-423a-b0f0-45709b53b45b admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:10.725860 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1342/2692] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:10.729712 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2c17f-ab94-4764-a341-8c045d926274 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:10.739933 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2c17f-ab94-4764-a341-8c045d926274 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:10.744493 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1fb699-0073-4fe4-b7a3-4f94614200ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:10.745150 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1fb699-0073-4fe4-b7a3-4f94614200ae admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:10.745412 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1fb699-0073-4fe4-b7a3-4f94614200ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:10.745772 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1fb699-0073-4fe4-b7a3-4f94614200ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:10.746388 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1fb699-0073-4fe4-b7a3-4f94614200ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:10.748006 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1fb699-0073-4fe4-b7a3-4f94614200ae admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:10.758404 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1351/2693] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:10.762551 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc92f97-6ff0-423a-b0f0-45709b53b45b admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:10.772127 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc92f97-6ff0-423a-b0f0-45709b53b45b admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:10.776646 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d147c-7a80-4567-8205-88a6928f2965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:10.777495 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d147c-7a80-4567-8205-88a6928f2965 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:10.777774 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d147c-7a80-4567-8205-88a6928f2965 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:10.778046 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d147c-7a80-4567-8205-88a6928f2965 admin admin] PATH_INFO: `/v3/projects/948904b895f946c8aba32f27eb953f69/users/b8e2b7c0e5f94c958d6e7843c8809046/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:10.791727 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d147c-7a80-4567-8205-88a6928f2965 admin admin] RBAC: Authorizing `identity:create_grant(project_id=948904b895f946c8aba32f27eb953f69, user_id=b8e2b7c0e5f94c958d6e7843c8809046, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:10.794311 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d147c-7a80-4567-8205-88a6928f2965 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:10.807697 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1343/2694] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:10 2022] PUT /identity/v3/projects/948904b895f946c8aba32f27eb953f69/users/b8e2b7c0e5f94c958d6e7843c8809046/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:39:10.818954 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b80348-76e6-4545-a3b0-5a3e379cbf1b None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:10.819241 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b80348-76e6-4545-a3b0-5a3e379cbf1b None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:10.819515 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b80348-76e6-4545-a3b0-5a3e379cbf1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:10.845069 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-40b80348-76e6-4545-a3b0-5a3e379cbf1b None None] MFA Rules not processed for user `b8e2b7c0e5f94c958d6e7843c8809046`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:10.846275 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-40b80348-76e6-4545-a3b0-5a3e379cbf1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:10.907702 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1352/2695] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:39:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:39:10.918887 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d147c-7a80-4567-8205-88a6928f2965 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:10.920543 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-4c8d147c-7a80-4567-8205-88a6928f2965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:10.975605 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d147c-7a80-4567-8205-88a6928f2965 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:10.979269 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e4035-0298-415e-a949-e997f80da10e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd99b63b9b6e44219921569db1bf2e0dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:10.979834 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e4035-0298-415e-a949-e997f80da10e service glance] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:10.980112 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e4035-0298-415e-a949-e997f80da10e service glance] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:10.980382 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e4035-0298-415e-a949-e997f80da10e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:10.988680 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496e4035-0298-415e-a949-e997f80da10e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:10.990078 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496e4035-0298-415e-a949-e997f80da10e service glance] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:10.998555 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1344/2696] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:39:23.631415 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b80348-76e6-4545-a3b0-5a3e379cbf1b None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:23.632998 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-40b80348-76e6-4545-a3b0-5a3e379cbf1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:23.700006 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b80348-76e6-4545-a3b0-5a3e379cbf1b None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:23.705000 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e0f33-3f71-4ad3-8916-cae15c33774a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:23.705848 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e0f33-3f71-4ad3-8916-cae15c33774a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:23.706127 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e0f33-3f71-4ad3-8916-cae15c33774a admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:23.706442 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e0f33-3f71-4ad3-8916-cae15c33774a admin admin] PATH_INFO: `/v3/users/3cdcba6d332b492196494db46ced8b9f` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:23.707618 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e0f33-3f71-4ad3-8916-cae15c33774a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cdcba6d332b492196494db46ced8b9f)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:23.709542 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e0f33-3f71-4ad3-8916-cae15c33774a admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:23.753413 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-9c6e0f33-3f71-4ad3-8916-cae15c33774a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cdcba6d332b492196494db46ced8b9f'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:23.760420 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-9c6e0f33-3f71-4ad3-8916-cae15c33774a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cdcba6d332b492196494db46ced8b9f'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:23.761088 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-9c6e0f33-3f71-4ad3-8916-cae15c33774a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cdcba6d332b492196494db46ced8b9f'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:23.773392 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-9c6e0f33-3f71-4ad3-8916-cae15c33774a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cdcba6d332b492196494db46ced8b9f'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:23.779934 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-9c6e0f33-3f71-4ad3-8916-cae15c33774a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cdcba6d332b492196494db46ced8b9f'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:23.785775 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1353/2697] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:39:23 2022] DELETE /identity/v3/users/3cdcba6d332b492196494db46ced8b9f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:23.954785 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e4035-0298-415e-a949-e997f80da10e service glance] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:23.965380 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e4035-0298-415e-a949-e997f80da10e service glance] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:24.024137 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f13a86-2e45-4748-a6ed-cc9848da0a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:24.025010 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f13a86-2e45-4748-a6ed-cc9848da0a21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:24.025290 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f13a86-2e45-4748-a6ed-cc9848da0a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:24.025564 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f13a86-2e45-4748-a6ed-cc9848da0a21 admin admin] PATH_INFO: `/v3/projects/5c79b1decd974ef2bb73bf55edc02f8c` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:24.026779 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f13a86-2e45-4748-a6ed-cc9848da0a21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c79b1decd974ef2bb73bf55edc02f8c)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:24.028637 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f13a86-2e45-4748-a6ed-cc9848da0a21 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:24.072531 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-f0f13a86-2e45-4748-a6ed-cc9848da0a21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c79b1decd974ef2bb73bf55edc02f8c', 'request_id': 'req-f0f13a86-2e45-4748-a6ed-cc9848da0a21'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:24.078407 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-f0f13a86-2e45-4748-a6ed-cc9848da0a21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c79b1decd974ef2bb73bf55edc02f8c', 'request_id': 'req-f0f13a86-2e45-4748-a6ed-cc9848da0a21'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:24.084483 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-f0f13a86-2e45-4748-a6ed-cc9848da0a21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c79b1decd974ef2bb73bf55edc02f8c', 'request_id': 'req-f0f13a86-2e45-4748-a6ed-cc9848da0a21'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:24.097191 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-f0f13a86-2e45-4748-a6ed-cc9848da0a21 admin admin] The token cache is being invalidate because project 5c79b1decd974ef2bb73bf55edc02f8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:39:24.097476 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-f0f13a86-2e45-4748-a6ed-cc9848da0a21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:24.098341 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-f0f13a86-2e45-4748-a6ed-cc9848da0a21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:24.099844 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1345/2698] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:39:23 2022] DELETE /identity/v3/projects/5c79b1decd974ef2bb73bf55edc02f8c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:24.104761 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c7a5e-7e5c-4682-a2b7-6381bb4307a1 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:24.105045 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c7a5e-7e5c-4682-a2b7-6381bb4307a1 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:24.105315 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c7a5e-7e5c-4682-a2b7-6381bb4307a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:24.123502 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-494c7a5e-7e5c-4682-a2b7-6381bb4307a1 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:24.125232 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-494c7a5e-7e5c-4682-a2b7-6381bb4307a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:24.181091 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1354/2699] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:39:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:24.189545 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d4377-e17a-4953-8ea2-fe9c0553903d None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:24.189857 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d4377-e17a-4953-8ea2-fe9c0553903d None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:24.190133 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d4377-e17a-4953-8ea2-fe9c0553903d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:24.207921 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-ea3d4377-e17a-4953-8ea2-fe9c0553903d None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:24.209106 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-ea3d4377-e17a-4953-8ea2-fe9c0553903d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:24.216877 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1346/2700] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:39:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:24.221147 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c7a5e-7e5c-4682-a2b7-6381bb4307a1 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:24.230988 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c7a5e-7e5c-4682-a2b7-6381bb4307a1 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:24.236093 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2febf2-7d6a-4a83-8830-89d87687706b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:24.236820 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2febf2-7d6a-4a83-8830-89d87687706b admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:24.237100 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2febf2-7d6a-4a83-8830-89d87687706b admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:24.237373 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2febf2-7d6a-4a83-8830-89d87687706b admin admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:24.238085 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2febf2-7d6a-4a83-8830-89d87687706b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:39:24.238391 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2febf2-7d6a-4a83-8830-89d87687706b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:24.240015 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2febf2-7d6a-4a83-8830-89d87687706b admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:24.251961 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1355/2701] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:39:24.256280 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d4377-e17a-4953-8ea2-fe9c0553903d None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:24.265280 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d4377-e17a-4953-8ea2-fe9c0553903d None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:24.269824 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ee031-8ddb-4bb9-a06c-3f4403798bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:24.270454 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ee031-8ddb-4bb9-a06c-3f4403798bb7 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:24.270772 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ee031-8ddb-4bb9-a06c-3f4403798bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:24.271046 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ee031-8ddb-4bb9-a06c-3f4403798bb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:24.271722 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ee031-8ddb-4bb9-a06c-3f4403798bb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:24.273585 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ee031-8ddb-4bb9-a06c-3f4403798bb7 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:24.298353 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1347/2702] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:39:24 2022] POST /identity/v3/projects => generated 403 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:24.302357 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2febf2-7d6a-4a83-8830-89d87687706b admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:24.312650 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2febf2-7d6a-4a83-8830-89d87687706b admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:24.367183 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635726ee-3a02-4ce3-a626-d4311b7ec2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:24.367836 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635726ee-3a02-4ce3-a626-d4311b7ec2b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:24.368142 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635726ee-3a02-4ce3-a626-d4311b7ec2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:24.368417 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635726ee-3a02-4ce3-a626-d4311b7ec2b6 admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:24.369126 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635726ee-3a02-4ce3-a626-d4311b7ec2b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:24.371036 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635726ee-3a02-4ce3-a626-d4311b7ec2b6 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:24.390953 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1356/2703] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:39:24 2022] POST /identity/v3/users => generated 302 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:39:24.395051 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ee031-8ddb-4bb9-a06c-3f4403798bb7 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:24.405014 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ee031-8ddb-4bb9-a06c-3f4403798bb7 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:24.410029 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451054b6-5f35-44ca-8c1f-63941c1f8c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:24.410792 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451054b6-5f35-44ca-8c1f-63941c1f8c25 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:24.411027 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451054b6-5f35-44ca-8c1f-63941c1f8c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:24.411324 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451054b6-5f35-44ca-8c1f-63941c1f8c25 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:24.412012 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451054b6-5f35-44ca-8c1f-63941c1f8c25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:24.413590 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451054b6-5f35-44ca-8c1f-63941c1f8c25 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:24.424464 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1348/2704] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:24.428392 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635726ee-3a02-4ce3-a626-d4311b7ec2b6 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:24.438931 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635726ee-3a02-4ce3-a626-d4311b7ec2b6 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:24.443445 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d6067-0eae-480d-b06a-c5079cbc5523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:24.444083 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d6067-0eae-480d-b06a-c5079cbc5523 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:24.444357 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d6067-0eae-480d-b06a-c5079cbc5523 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:24.444624 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d6067-0eae-480d-b06a-c5079cbc5523 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:24.445333 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1d6067-0eae-480d-b06a-c5079cbc5523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:24.446918 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1d6067-0eae-480d-b06a-c5079cbc5523 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:24.456816 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1357/2705] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:39:24.460737 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451054b6-5f35-44ca-8c1f-63941c1f8c25 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:24.471219 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451054b6-5f35-44ca-8c1f-63941c1f8c25 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:24.475958 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d7284-6948-47eb-9731-77e594ef3013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:24.476821 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d7284-6948-47eb-9731-77e594ef3013 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:24.477102 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d7284-6948-47eb-9731-77e594ef3013 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:24.477391 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d7284-6948-47eb-9731-77e594ef3013 admin admin] PATH_INFO: `/v3/projects/d389e72deb52446bb809836022993316/users/8ed4d45f67e0498bb0da9dc6653ceb70/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:24.492287 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d7284-6948-47eb-9731-77e594ef3013 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d389e72deb52446bb809836022993316, user_id=8ed4d45f67e0498bb0da9dc6653ceb70, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:24.494913 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d7284-6948-47eb-9731-77e594ef3013 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:24.507501 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1349/2706] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:24 2022] PUT /identity/v3/projects/d389e72deb52446bb809836022993316/users/8ed4d45f67e0498bb0da9dc6653ceb70/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:24.512515 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc404ca-5108-4b02-90c8-ce56a3b7dc0f None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:24.512802 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc404ca-5108-4b02-90c8-ce56a3b7dc0f None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:24.513076 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc404ca-5108-4b02-90c8-ce56a3b7dc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:24.531151 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-edc404ca-5108-4b02-90c8-ce56a3b7dc0f None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:24.532426 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-edc404ca-5108-4b02-90c8-ce56a3b7dc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:24.588656 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1358/2707] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:39:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:24.599199 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d7284-6948-47eb-9731-77e594ef3013 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:24.600846 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-b83d7284-6948-47eb-9731-77e594ef3013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:24.658376 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d7284-6948-47eb-9731-77e594ef3013 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:24.661981 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe233c-5ad1-45c0-b331-1d4603682fbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:24.662650 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe233c-5ad1-45c0-b331-1d4603682fbd service neutron] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:24.662931 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe233c-5ad1-45c0-b331-1d4603682fbd service neutron] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:24.663197 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe233c-5ad1-45c0-b331-1d4603682fbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:24.674127 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fe233c-5ad1-45c0-b331-1d4603682fbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:24.676428 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fe233c-5ad1-45c0-b331-1d4603682fbd service neutron] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:24.686329 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1350/2708] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:39:25.307857 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a54cdb-7696-4a5c-a1fd-e2d466d1a10e None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:25.308391 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a54cdb-7696-4a5c-a1fd-e2d466d1a10e None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:25.308391 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a54cdb-7696-4a5c-a1fd-e2d466d1a10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:25.335498 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-e7a54cdb-7696-4a5c-a1fd-e2d466d1a10e None None] MFA Rules not processed for user `8ed4d45f67e0498bb0da9dc6653ceb70`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:25.336872 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-e7a54cdb-7696-4a5c-a1fd-e2d466d1a10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:25.401582 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1359/2709] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:39:25 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:25.406252 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe233c-5ad1-45c0-b331-1d4603682fbd service neutron] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:25.415895 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe233c-5ad1-45c0-b331-1d4603682fbd service neutron] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:25.421717 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e19bc6-c281-4cc1-8f87-36c2ce8e833e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:25.422358 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e19bc6-c281-4cc1-8f87-36c2ce8e833e admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:25.422659 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e19bc6-c281-4cc1-8f87-36c2ce8e833e admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:25.422933 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e19bc6-c281-4cc1-8f87-36c2ce8e833e admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:25.423627 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e19bc6-c281-4cc1-8f87-36c2ce8e833e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:25.425495 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e19bc6-c281-4cc1-8f87-36c2ce8e833e admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:25.456675 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1351/2710] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:39:25 2022] POST /identity/v3/projects => generated 403 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:25.457918 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a54cdb-7696-4a5c-a1fd-e2d466d1a10e None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:25.471158 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a54cdb-7696-4a5c-a1fd-e2d466d1a10e None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:25.529855 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28374a5f-4fd2-4687-b187-9750207e9bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:25.530610 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28374a5f-4fd2-4687-b187-9750207e9bba admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:25.530892 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28374a5f-4fd2-4687-b187-9750207e9bba admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:25.531174 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28374a5f-4fd2-4687-b187-9750207e9bba admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:25.531858 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28374a5f-4fd2-4687-b187-9750207e9bba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:25.533763 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28374a5f-4fd2-4687-b187-9750207e9bba admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:25.552188 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1360/2711] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:39:25 2022] POST /identity/v3/users => generated 308 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:25.556195 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e19bc6-c281-4cc1-8f87-36c2ce8e833e admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:25.567431 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e19bc6-c281-4cc1-8f87-36c2ce8e833e admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:25.572056 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eb08b2-453d-401e-808c-ead643b36094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:25.572747 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb08b2-453d-401e-808c-ead643b36094 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:25.573091 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb08b2-453d-401e-808c-ead643b36094 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:25.573366 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb08b2-453d-401e-808c-ead643b36094 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:25.574095 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eb08b2-453d-401e-808c-ead643b36094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:25.575899 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eb08b2-453d-401e-808c-ead643b36094 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:25.588104 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1352/2712] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:25.592222 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28374a5f-4fd2-4687-b187-9750207e9bba admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:25.606857 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28374a5f-4fd2-4687-b187-9750207e9bba admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:25.615894 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41069f77-a246-452e-a2ba-cabc1fca7364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:25.616771 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41069f77-a246-452e-a2ba-cabc1fca7364 admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:25.617050 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41069f77-a246-452e-a2ba-cabc1fca7364 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:25.617320 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41069f77-a246-452e-a2ba-cabc1fca7364 admin admin] PATH_INFO: `/v3/projects/05b966767f4f4e54b01b0f5bbcd96e26/users/bf8ed103e1d04c709767adb4a5a713c8/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:25.632549 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41069f77-a246-452e-a2ba-cabc1fca7364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05b966767f4f4e54b01b0f5bbcd96e26, user_id=bf8ed103e1d04c709767adb4a5a713c8, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:25.635182 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41069f77-a246-452e-a2ba-cabc1fca7364 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:25.648511 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1361/2713] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:25 2022] PUT /identity/v3/projects/05b966767f4f4e54b01b0f5bbcd96e26/users/bf8ed103e1d04c709767adb4a5a713c8/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:39:25.652534 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eb08b2-453d-401e-808c-ead643b36094 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:25.662933 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eb08b2-453d-401e-808c-ead643b36094 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:25.718788 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab183dea-7448-4537-8da6-46f46a87f262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:25.719448 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab183dea-7448-4537-8da6-46f46a87f262 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:25.719725 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab183dea-7448-4537-8da6-46f46a87f262 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:25.719992 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab183dea-7448-4537-8da6-46f46a87f262 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:25.720699 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab183dea-7448-4537-8da6-46f46a87f262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:25.722253 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab183dea-7448-4537-8da6-46f46a87f262 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:25.732034 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1353/2714] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:25.736952 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41069f77-a246-452e-a2ba-cabc1fca7364 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:25.747144 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41069f77-a246-452e-a2ba-cabc1fca7364 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:25.752356 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132dc083-8bdc-4b05-a17e-d0f855760bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:25.753224 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132dc083-8bdc-4b05-a17e-d0f855760bb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:25.753504 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132dc083-8bdc-4b05-a17e-d0f855760bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:25.753774 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132dc083-8bdc-4b05-a17e-d0f855760bb6 admin admin] PATH_INFO: `/v3/projects/05b966767f4f4e54b01b0f5bbcd96e26/users/bf8ed103e1d04c709767adb4a5a713c8/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:25.755764 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132dc083-8bdc-4b05-a17e-d0f855760bb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05b966767f4f4e54b01b0f5bbcd96e26, user_id=bf8ed103e1d04c709767adb4a5a713c8, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:25.758347 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132dc083-8bdc-4b05-a17e-d0f855760bb6 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:25.768435 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1362/2715] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:25 2022] PUT /identity/v3/projects/05b966767f4f4e54b01b0f5bbcd96e26/users/bf8ed103e1d04c709767adb4a5a713c8/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:26.468928 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad8844-5bef-44aa-985c-276a605b1a41 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:26.469459 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad8844-5bef-44aa-985c-276a605b1a41 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:26.469459 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad8844-5bef-44aa-985c-276a605b1a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:26.497294 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-b8ad8844-5bef-44aa-985c-276a605b1a41 None None] MFA Rules not processed for user `bf8ed103e1d04c709767adb4a5a713c8`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:26.498494 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-b8ad8844-5bef-44aa-985c-276a605b1a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:26.567716 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1354/2716] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:39:26 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:27.562329 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132dc083-8bdc-4b05-a17e-d0f855760bb6 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:27.634330 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132dc083-8bdc-4b05-a17e-d0f855760bb6 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:27.639212 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e9a820-df2b-423c-80ee-734c2d59085b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:27.641032 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9a820-df2b-423c-80ee-734c2d59085b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:27.641032 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9a820-df2b-423c-80ee-734c2d59085b admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:27.641032 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9a820-df2b-423c-80ee-734c2d59085b admin admin] PATH_INFO: `/v3/users/8ed4d45f67e0498bb0da9dc6653ceb70` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:27.651312 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e9a820-df2b-423c-80ee-734c2d59085b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ed4d45f67e0498bb0da9dc6653ceb70)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:27.653417 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e9a820-df2b-423c-80ee-734c2d59085b admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:27.711718 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-e7e9a820-df2b-423c-80ee-734c2d59085b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ed4d45f67e0498bb0da9dc6653ceb70'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:27.720352 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-e7e9a820-df2b-423c-80ee-734c2d59085b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ed4d45f67e0498bb0da9dc6653ceb70'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:27.721036 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-e7e9a820-df2b-423c-80ee-734c2d59085b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ed4d45f67e0498bb0da9dc6653ceb70'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:27.734246 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-e7e9a820-df2b-423c-80ee-734c2d59085b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ed4d45f67e0498bb0da9dc6653ceb70'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:27.741021 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-e7e9a820-df2b-423c-80ee-734c2d59085b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ed4d45f67e0498bb0da9dc6653ceb70'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:27.747052 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1363/2717] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:39:27 2022] DELETE /identity/v3/users/8ed4d45f67e0498bb0da9dc6653ceb70 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:39:27.913171 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad8844-5bef-44aa-985c-276a605b1a41 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:27.924149 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad8844-5bef-44aa-985c-276a605b1a41 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:27.980734 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280eb11-9c33-44f0-97b5-7827f06d5b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:27.981559 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280eb11-9c33-44f0-97b5-7827f06d5b1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:27.981851 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280eb11-9c33-44f0-97b5-7827f06d5b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:27.982103 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280eb11-9c33-44f0-97b5-7827f06d5b1f admin admin] PATH_INFO: `/v3/projects/d389e72deb52446bb809836022993316` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:27.983986 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9280eb11-9c33-44f0-97b5-7827f06d5b1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d389e72deb52446bb809836022993316)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:27.986012 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9280eb11-9c33-44f0-97b5-7827f06d5b1f admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:28.029517 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-9280eb11-9c33-44f0-97b5-7827f06d5b1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd389e72deb52446bb809836022993316', 'request_id': 'req-9280eb11-9c33-44f0-97b5-7827f06d5b1f'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:28.035341 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-9280eb11-9c33-44f0-97b5-7827f06d5b1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd389e72deb52446bb809836022993316', 'request_id': 'req-9280eb11-9c33-44f0-97b5-7827f06d5b1f'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:28.041166 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-9280eb11-9c33-44f0-97b5-7827f06d5b1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd389e72deb52446bb809836022993316', 'request_id': 'req-9280eb11-9c33-44f0-97b5-7827f06d5b1f'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:28.053431 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-9280eb11-9c33-44f0-97b5-7827f06d5b1f admin admin] The token cache is being invalidate because project d389e72deb52446bb809836022993316 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:39:28.053711 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-9280eb11-9c33-44f0-97b5-7827f06d5b1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:28.054324 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-9280eb11-9c33-44f0-97b5-7827f06d5b1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:28.055829 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1355/2718] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:39:27 2022] DELETE /identity/v3/projects/d389e72deb52446bb809836022993316 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:28.060155 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e9a820-df2b-423c-80ee-734c2d59085b admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:28.061859 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-e7e9a820-df2b-423c-80ee-734c2d59085b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:28.075067 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e9a820-df2b-423c-80ee-734c2d59085b admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:28.131660 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8273613-5320-4bde-bc93-4695d8703d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:28.132553 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8273613-5320-4bde-bc93-4695d8703d20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:28.132799 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8273613-5320-4bde-bc93-4695d8703d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:28.133067 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8273613-5320-4bde-bc93-4695d8703d20 admin admin] PATH_INFO: `/v3/users/bf8ed103e1d04c709767adb4a5a713c8` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:28.134432 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8273613-5320-4bde-bc93-4695d8703d20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf8ed103e1d04c709767adb4a5a713c8)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:28.136419 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8273613-5320-4bde-bc93-4695d8703d20 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:28.179661 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-a8273613-5320-4bde-bc93-4695d8703d20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf8ed103e1d04c709767adb4a5a713c8'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:28.186302 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-a8273613-5320-4bde-bc93-4695d8703d20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf8ed103e1d04c709767adb4a5a713c8'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:28.187740 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-a8273613-5320-4bde-bc93-4695d8703d20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf8ed103e1d04c709767adb4a5a713c8'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:28.199248 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-a8273613-5320-4bde-bc93-4695d8703d20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf8ed103e1d04c709767adb4a5a713c8'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:28.205888 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-a8273613-5320-4bde-bc93-4695d8703d20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf8ed103e1d04c709767adb4a5a713c8'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:28.211560 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1364/2719] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:39:28 2022] DELETE /identity/v3/users/bf8ed103e1d04c709767adb4a5a713c8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:28.379861 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280eb11-9c33-44f0-97b5-7827f06d5b1f admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:28.381681 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-9280eb11-9c33-44f0-97b5-7827f06d5b1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:28.400506 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280eb11-9c33-44f0-97b5-7827f06d5b1f admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:28.462414 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f38658-a244-4403-915c-afdda01b0256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:28.463294 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f38658-a244-4403-915c-afdda01b0256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:28.463567 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f38658-a244-4403-915c-afdda01b0256 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:28.463838 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f38658-a244-4403-915c-afdda01b0256 admin admin] PATH_INFO: `/v3/projects/05b966767f4f4e54b01b0f5bbcd96e26` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:28.465031 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f38658-a244-4403-915c-afdda01b0256 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05b966767f4f4e54b01b0f5bbcd96e26)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:28.466960 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f38658-a244-4403-915c-afdda01b0256 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:28.512005 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-e9f38658-a244-4403-915c-afdda01b0256 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05b966767f4f4e54b01b0f5bbcd96e26', 'request_id': 'req-e9f38658-a244-4403-915c-afdda01b0256'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:28.517295 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-e9f38658-a244-4403-915c-afdda01b0256 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05b966767f4f4e54b01b0f5bbcd96e26', 'request_id': 'req-e9f38658-a244-4403-915c-afdda01b0256'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:28.523288 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-e9f38658-a244-4403-915c-afdda01b0256 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05b966767f4f4e54b01b0f5bbcd96e26', 'request_id': 'req-e9f38658-a244-4403-915c-afdda01b0256'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:28.536182 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-e9f38658-a244-4403-915c-afdda01b0256 admin admin] The token cache is being invalidate because project 05b966767f4f4e54b01b0f5bbcd96e26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:39:28.536464 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-e9f38658-a244-4403-915c-afdda01b0256 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:28.537065 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-e9f38658-a244-4403-915c-afdda01b0256 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:28.538625 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1356/2720] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:39:28 2022] DELETE /identity/v3/projects/05b966767f4f4e54b01b0f5bbcd96e26 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:28.543467 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918afae-c542-411c-9065-671a9ffff782 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:28.543802 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918afae-c542-411c-9065-671a9ffff782 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:28.544076 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918afae-c542-411c-9065-671a9ffff782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:28.562785 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-c918afae-c542-411c-9065-671a9ffff782 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:28.563969 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-c918afae-c542-411c-9065-671a9ffff782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:28.623075 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1365/2721] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:39:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:28.631047 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c101a-26d4-47c0-a6f1-2e561c625646 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:28.631339 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c101a-26d4-47c0-a6f1-2e561c625646 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:28.631617 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c101a-26d4-47c0-a6f1-2e561c625646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:28.650108 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-3b7c101a-26d4-47c0-a6f1-2e561c625646 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:28.651342 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-3b7c101a-26d4-47c0-a6f1-2e561c625646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:28.659874 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1357/2722] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:39:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:28.664001 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918afae-c542-411c-9065-671a9ffff782 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:28.673960 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918afae-c542-411c-9065-671a9ffff782 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:28.678648 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d27cc-299a-48a4-91cb-8a925e144513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:28.679288 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d27cc-299a-48a4-91cb-8a925e144513 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:28.679562 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d27cc-299a-48a4-91cb-8a925e144513 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:28.679829 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d27cc-299a-48a4-91cb-8a925e144513 admin admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:28.680528 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3d27cc-299a-48a4-91cb-8a925e144513 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:39:28.680825 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3d27cc-299a-48a4-91cb-8a925e144513 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:28.682383 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3d27cc-299a-48a4-91cb-8a925e144513 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:28.695810 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1366/2723] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:39:28.700046 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c101a-26d4-47c0-a6f1-2e561c625646 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:28.710351 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c101a-26d4-47c0-a6f1-2e561c625646 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:28.716289 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b9dbf-dbca-4a2b-9b3e-8e69241c8a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:28.716993 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b9dbf-dbca-4a2b-9b3e-8e69241c8a01 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:28.717310 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b9dbf-dbca-4a2b-9b3e-8e69241c8a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:28.717650 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b9dbf-dbca-4a2b-9b3e-8e69241c8a01 admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:28.719636 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b9dbf-dbca-4a2b-9b3e-8e69241c8a01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:28.721501 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b9dbf-dbca-4a2b-9b3e-8e69241c8a01 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:28.747086 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1358/2724] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:39:28 2022] POST /identity/v3/projects => generated 357 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:28.756045 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d27cc-299a-48a4-91cb-8a925e144513 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:28.767046 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d27cc-299a-48a4-91cb-8a925e144513 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:28.823455 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f1fdb7-7eea-4085-bd91-0fa25d51f868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:28.824149 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1fdb7-7eea-4085-bd91-0fa25d51f868 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:28.824433 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1fdb7-7eea-4085-bd91-0fa25d51f868 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:28.824707 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1fdb7-7eea-4085-bd91-0fa25d51f868 admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:28.825397 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f1fdb7-7eea-4085-bd91-0fa25d51f868 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:28.828368 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f1fdb7-7eea-4085-bd91-0fa25d51f868 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:28.849565 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1367/2725] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:39:28 2022] POST /identity/v3/users => generated 279 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:39:28.854146 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b9dbf-dbca-4a2b-9b3e-8e69241c8a01 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:28.864652 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b9dbf-dbca-4a2b-9b3e-8e69241c8a01 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:28.869265 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71036c-32de-4261-b50f-27cff860dd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:28.869912 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71036c-32de-4261-b50f-27cff860dd2c admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:28.870192 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71036c-32de-4261-b50f-27cff860dd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:28.870463 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71036c-32de-4261-b50f-27cff860dd2c admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:28.871207 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab71036c-32de-4261-b50f-27cff860dd2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:28.872784 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab71036c-32de-4261-b50f-27cff860dd2c admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:28.884612 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1359/2726] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:28.888836 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f1fdb7-7eea-4085-bd91-0fa25d51f868 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:28.899656 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f1fdb7-7eea-4085-bd91-0fa25d51f868 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:28.904344 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c8761-9da1-4c28-986d-75c4681a2a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:28.904973 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c8761-9da1-4c28-986d-75c4681a2a81 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:28.905251 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c8761-9da1-4c28-986d-75c4681a2a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:28.906251 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c8761-9da1-4c28-986d-75c4681a2a81 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:28.907127 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c8761-9da1-4c28-986d-75c4681a2a81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:28.908711 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c8761-9da1-4c28-986d-75c4681a2a81 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:28.919146 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1368/2727] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:28.923284 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71036c-32de-4261-b50f-27cff860dd2c admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:28.934580 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71036c-32de-4261-b50f-27cff860dd2c admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:28.939359 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dcb6f0-fd85-42cc-9cae-a91e4d7bd52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:28.940272 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dcb6f0-fd85-42cc-9cae-a91e4d7bd52a admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:28.940513 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dcb6f0-fd85-42cc-9cae-a91e4d7bd52a admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:28.940784 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dcb6f0-fd85-42cc-9cae-a91e4d7bd52a admin admin] PATH_INFO: `/v3/projects/c5b40b8aedb94e51a9802f6dc7df19ba/users/e46a293693184dd0ac24743fc6f81c19/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:28.956836 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dcb6f0-fd85-42cc-9cae-a91e4d7bd52a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5b40b8aedb94e51a9802f6dc7df19ba, user_id=e46a293693184dd0ac24743fc6f81c19, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:28.959553 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dcb6f0-fd85-42cc-9cae-a91e4d7bd52a admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:28.972418 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1360/2728] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:28 2022] PUT /identity/v3/projects/c5b40b8aedb94e51a9802f6dc7df19ba/users/e46a293693184dd0ac24743fc6f81c19/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:39:28.984373 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5215f61-044b-4203-8a5e-aea5ff45c057 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:28.984665 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5215f61-044b-4203-8a5e-aea5ff45c057 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:28.984946 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5215f61-044b-4203-8a5e-aea5ff45c057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:29.010800 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-f5215f61-044b-4203-8a5e-aea5ff45c057 None None] MFA Rules not processed for user `e46a293693184dd0ac24743fc6f81c19`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:29.011988 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-f5215f61-044b-4203-8a5e-aea5ff45c057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:29.073400 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1369/2729] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:39:28 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:29.078332 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dcb6f0-fd85-42cc-9cae-a91e4d7bd52a admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:29.135714 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dcb6f0-fd85-42cc-9cae-a91e4d7bd52a admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:29.141075 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6328b88b-39b4-4268-963a-5fed5736279e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:29.141713 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6328b88b-39b4-4268-963a-5fed5736279e admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:29.141991 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6328b88b-39b4-4268-963a-5fed5736279e admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:29.142262 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6328b88b-39b4-4268-963a-5fed5736279e admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:29.142963 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6328b88b-39b4-4268-963a-5fed5736279e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:29.144834 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6328b88b-39b4-4268-963a-5fed5736279e admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:29.169771 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1361/2730] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:39:29 2022] POST /identity/v3/projects => generated 355 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:29.173827 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5215f61-044b-4203-8a5e-aea5ff45c057 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:29.184818 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5215f61-044b-4203-8a5e-aea5ff45c057 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:29.239726 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60503261-dbf7-45f1-9b55-1428ab049a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:29.240377 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60503261-dbf7-45f1-9b55-1428ab049a13 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:29.240656 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60503261-dbf7-45f1-9b55-1428ab049a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:29.240924 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60503261-dbf7-45f1-9b55-1428ab049a13 admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:29.241588 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60503261-dbf7-45f1-9b55-1428ab049a13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:29.243543 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60503261-dbf7-45f1-9b55-1428ab049a13 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:29.263600 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1370/2731] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:39:29 2022] POST /identity/v3/users => generated 284 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:29.268201 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6328b88b-39b4-4268-963a-5fed5736279e admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:29.278260 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6328b88b-39b4-4268-963a-5fed5736279e admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:29.283007 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637ee8df-08ca-48d3-b2f7-22f2882b9815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:29.283649 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ee8df-08ca-48d3-b2f7-22f2882b9815 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:29.283931 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ee8df-08ca-48d3-b2f7-22f2882b9815 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:29.284203 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ee8df-08ca-48d3-b2f7-22f2882b9815 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:29.284915 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637ee8df-08ca-48d3-b2f7-22f2882b9815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:29.286476 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637ee8df-08ca-48d3-b2f7-22f2882b9815 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:29.297056 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1362/2732] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:29.301019 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60503261-dbf7-45f1-9b55-1428ab049a13 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:29.310582 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60503261-dbf7-45f1-9b55-1428ab049a13 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:29.316067 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773eab1-9fdb-47eb-b6c2-155d4cd9835d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:29.316913 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773eab1-9fdb-47eb-b6c2-155d4cd9835d admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:29.317189 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773eab1-9fdb-47eb-b6c2-155d4cd9835d admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:29.317455 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773eab1-9fdb-47eb-b6c2-155d4cd9835d admin admin] PATH_INFO: `/v3/projects/6eefe637bf254cd5925cf0baf103538f/users/d994a56e17994f18a7e080db6a850867/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:29.332330 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7773eab1-9fdb-47eb-b6c2-155d4cd9835d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eefe637bf254cd5925cf0baf103538f, user_id=d994a56e17994f18a7e080db6a850867, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:29.334904 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7773eab1-9fdb-47eb-b6c2-155d4cd9835d admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:29.348169 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1371/2733] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:29 2022] PUT /identity/v3/projects/6eefe637bf254cd5925cf0baf103538f/users/d994a56e17994f18a7e080db6a850867/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:29.352189 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637ee8df-08ca-48d3-b2f7-22f2882b9815 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:29.362815 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637ee8df-08ca-48d3-b2f7-22f2882b9815 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:29.417067 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78a744-a399-4c4f-9512-f49386987b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:29.417724 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78a744-a399-4c4f-9512-f49386987b98 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:29.418004 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78a744-a399-4c4f-9512-f49386987b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:29.418279 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78a744-a399-4c4f-9512-f49386987b98 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:29.419025 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea78a744-a399-4c4f-9512-f49386987b98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:29.420600 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea78a744-a399-4c4f-9512-f49386987b98 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:29.430835 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1363/2734] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:29.435104 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773eab1-9fdb-47eb-b6c2-155d4cd9835d admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:29.446240 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773eab1-9fdb-47eb-b6c2-155d4cd9835d admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:29.450775 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3179a2d-78e6-4aca-b72f-cdfa27a9f158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:29.451629 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3179a2d-78e6-4aca-b72f-cdfa27a9f158 admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:29.451903 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3179a2d-78e6-4aca-b72f-cdfa27a9f158 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:29.452179 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3179a2d-78e6-4aca-b72f-cdfa27a9f158 admin admin] PATH_INFO: `/v3/projects/6eefe637bf254cd5925cf0baf103538f/users/d994a56e17994f18a7e080db6a850867/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:29.454732 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3179a2d-78e6-4aca-b72f-cdfa27a9f158 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eefe637bf254cd5925cf0baf103538f, user_id=d994a56e17994f18a7e080db6a850867, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:29.457339 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3179a2d-78e6-4aca-b72f-cdfa27a9f158 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:29.467402 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1372/2735] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:29 2022] PUT /identity/v3/projects/6eefe637bf254cd5925cf0baf103538f/users/d994a56e17994f18a7e080db6a850867/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:29.477601 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa51941-66dd-4ab5-b16d-0a408a13bbbc None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:29.477886 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa51941-66dd-4ab5-b16d-0a408a13bbbc None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:29.478184 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa51941-66dd-4ab5-b16d-0a408a13bbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:29.505447 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-daa51941-66dd-4ab5-b16d-0a408a13bbbc None None] MFA Rules not processed for user `d994a56e17994f18a7e080db6a850867`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:29.506643 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-daa51941-66dd-4ab5-b16d-0a408a13bbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:29.570983 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1364/2736] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:39:29 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:39:29.582488 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3179a2d-78e6-4aca-b72f-cdfa27a9f158 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:29.584121 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-a3179a2d-78e6-4aca-b72f-cdfa27a9f158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:29.639231 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3179a2d-78e6-4aca-b72f-cdfa27a9f158 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:29.643047 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a97ea26-f31d-48fb-b8c7-acb4bf441b80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:29.643676 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97ea26-f31d-48fb-b8c7-acb4bf441b80 service cinder] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:29.643956 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97ea26-f31d-48fb-b8c7-acb4bf441b80 service cinder] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:29.644230 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97ea26-f31d-48fb-b8c7-acb4bf441b80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:29.653088 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a97ea26-f31d-48fb-b8c7-acb4bf441b80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:29.654497 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a97ea26-f31d-48fb-b8c7-acb4bf441b80 service cinder] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:29.664005 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1373/2737] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:29 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:39:29.737826 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa51941-66dd-4ab5-b16d-0a408a13bbbc None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:29.747422 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa51941-66dd-4ab5-b16d-0a408a13bbbc None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:29.751084 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a80d6b2-1740-4954-8106-b39740b8fc40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:29.751711 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80d6b2-1740-4954-8106-b39740b8fc40 service cinder] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:29.751992 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80d6b2-1740-4954-8106-b39740b8fc40 service cinder] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:29.752290 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80d6b2-1740-4954-8106-b39740b8fc40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:29.806726 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a80d6b2-1740-4954-8106-b39740b8fc40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:29.808152 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a80d6b2-1740-4954-8106-b39740b8fc40 service cinder] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:29.817068 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1365/2738] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:29 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:39:36.623968 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a97ea26-f31d-48fb-b8c7-acb4bf441b80 service cinder] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:36.626342 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-8a97ea26-f31d-48fb-b8c7-acb4bf441b80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:36.690312 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a97ea26-f31d-48fb-b8c7-acb4bf441b80 service cinder] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:36.694818 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a1c97-ad5e-418f-8431-774f625f3f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:36.695666 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a1c97-ad5e-418f-8431-774f625f3f7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:36.695947 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a1c97-ad5e-418f-8431-774f625f3f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:36.696218 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a1c97-ad5e-418f-8431-774f625f3f7a admin admin] PATH_INFO: `/v3/users/b8e2b7c0e5f94c958d6e7843c8809046` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:36.697394 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a1c97-ad5e-418f-8431-774f625f3f7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8e2b7c0e5f94c958d6e7843c8809046)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:36.699328 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a1c97-ad5e-418f-8431-774f625f3f7a admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:36.743612 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-da2a1c97-ad5e-418f-8431-774f625f3f7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8e2b7c0e5f94c958d6e7843c8809046'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:36.752214 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-da2a1c97-ad5e-418f-8431-774f625f3f7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8e2b7c0e5f94c958d6e7843c8809046'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:36.752810 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-da2a1c97-ad5e-418f-8431-774f625f3f7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8e2b7c0e5f94c958d6e7843c8809046'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:36.764803 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-da2a1c97-ad5e-418f-8431-774f625f3f7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8e2b7c0e5f94c958d6e7843c8809046'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:36.772613 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-da2a1c97-ad5e-418f-8431-774f625f3f7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8e2b7c0e5f94c958d6e7843c8809046'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:36.778992 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1374/2739] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:39:36 2022] DELETE /identity/v3/users/b8e2b7c0e5f94c958d6e7843c8809046 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:36.783544 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20917242-61aa-4e2c-97ba-49d429162082 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:36.784045 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20917242-61aa-4e2c-97ba-49d429162082 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:36.784226 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20917242-61aa-4e2c-97ba-49d429162082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:36.801662 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-20917242-61aa-4e2c-97ba-49d429162082 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:36.802890 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-20917242-61aa-4e2c-97ba-49d429162082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:36.860862 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1366/2740] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:39:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:36.870494 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a1c97-ad5e-418f-8431-774f625f3f7a admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:36.871988 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-da2a1c97-ad5e-418f-8431-774f625f3f7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:36.930670 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a1c97-ad5e-418f-8431-774f625f3f7a admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:36.934411 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf7ac09-546c-4cc1-be76-86dd4aaa7332 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:36.935094 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7ac09-546c-4cc1-be76-86dd4aaa7332 service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:36.935375 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7ac09-546c-4cc1-be76-86dd4aaa7332 service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:36.935653 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7ac09-546c-4cc1-be76-86dd4aaa7332 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:36.944605 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf7ac09-546c-4cc1-be76-86dd4aaa7332 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:36.945961 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf7ac09-546c-4cc1-be76-86dd4aaa7332 service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:36.955458 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1375/2741] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:39:37.210199 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20917242-61aa-4e2c-97ba-49d429162082 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:37.211728 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-20917242-61aa-4e2c-97ba-49d429162082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:37.224707 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20917242-61aa-4e2c-97ba-49d429162082 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:37.229648 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eab3ba-4dc2-4110-9f0c-45f97d5e5a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:37.230499 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eab3ba-4dc2-4110-9f0c-45f97d5e5a3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:37.230810 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eab3ba-4dc2-4110-9f0c-45f97d5e5a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:37.231234 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eab3ba-4dc2-4110-9f0c-45f97d5e5a3b admin admin] PATH_INFO: `/v3/projects/948904b895f946c8aba32f27eb953f69` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:37.232440 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eab3ba-4dc2-4110-9f0c-45f97d5e5a3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=948904b895f946c8aba32f27eb953f69)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:37.235243 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eab3ba-4dc2-4110-9f0c-45f97d5e5a3b admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:37.280296 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-43eab3ba-4dc2-4110-9f0c-45f97d5e5a3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '948904b895f946c8aba32f27eb953f69', 'request_id': 'req-43eab3ba-4dc2-4110-9f0c-45f97d5e5a3b'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:37.286276 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-43eab3ba-4dc2-4110-9f0c-45f97d5e5a3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '948904b895f946c8aba32f27eb953f69', 'request_id': 'req-43eab3ba-4dc2-4110-9f0c-45f97d5e5a3b'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:37.292660 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-43eab3ba-4dc2-4110-9f0c-45f97d5e5a3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '948904b895f946c8aba32f27eb953f69', 'request_id': 'req-43eab3ba-4dc2-4110-9f0c-45f97d5e5a3b'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:37.304402 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-43eab3ba-4dc2-4110-9f0c-45f97d5e5a3b admin admin] The token cache is being invalidate because project 948904b895f946c8aba32f27eb953f69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:39:37.304687 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-43eab3ba-4dc2-4110-9f0c-45f97d5e5a3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:37.305306 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-43eab3ba-4dc2-4110-9f0c-45f97d5e5a3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:37.306850 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1367/2742] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:39:37 2022] DELETE /identity/v3/projects/948904b895f946c8aba32f27eb953f69 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:37.311744 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa23257-7487-46b8-b784-a93797622f91 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:37.312028 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa23257-7487-46b8-b784-a93797622f91 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:37.312304 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa23257-7487-46b8-b784-a93797622f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:37.329903 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-baa23257-7487-46b8-b784-a93797622f91 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:37.331138 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-baa23257-7487-46b8-b784-a93797622f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:37.387563 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1376/2743] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:39:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:39:37.396766 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7323a-4694-424a-9bc7-ae868c29eccb None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:37.397054 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7323a-4694-424a-9bc7-ae868c29eccb None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:37.397335 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7323a-4694-424a-9bc7-ae868c29eccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:37.416093 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-82c7323a-4694-424a-9bc7-ae868c29eccb None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:37.417287 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-82c7323a-4694-424a-9bc7-ae868c29eccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:37.425324 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1368/2744] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:39:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:39:37.429517 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa23257-7487-46b8-b784-a93797622f91 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:37.438977 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa23257-7487-46b8-b784-a93797622f91 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:37.443504 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e3a5d-a9cb-4909-a9dd-7c860735f8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:37.444143 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e3a5d-a9cb-4909-a9dd-7c860735f8be admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:37.444425 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e3a5d-a9cb-4909-a9dd-7c860735f8be admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:37.444699 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e3a5d-a9cb-4909-a9dd-7c860735f8be admin admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:37.445404 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e3a5d-a9cb-4909-a9dd-7c860735f8be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:39:37.445704 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e3a5d-a9cb-4909-a9dd-7c860735f8be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:37.447316 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e3a5d-a9cb-4909-a9dd-7c860735f8be admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:37.458933 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1377/2745] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:39:37.463186 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7323a-4694-424a-9bc7-ae868c29eccb None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:37.472804 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7323a-4694-424a-9bc7-ae868c29eccb None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:37.478820 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17de30f-1687-485e-9201-d7ec26d695cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:37.479455 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17de30f-1687-485e-9201-d7ec26d695cb admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:37.479729 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17de30f-1687-485e-9201-d7ec26d695cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:37.479997 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17de30f-1687-485e-9201-d7ec26d695cb admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:37.480682 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17de30f-1687-485e-9201-d7ec26d695cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:37.482554 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17de30f-1687-485e-9201-d7ec26d695cb admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:37.508877 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1369/2746] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:39:37 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:39:37.512979 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e3a5d-a9cb-4909-a9dd-7c860735f8be admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:37.523419 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e3a5d-a9cb-4909-a9dd-7c860735f8be admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:37.578237 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7c372-eef7-4c9b-9ff9-ea30140674dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:37.578932 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7c372-eef7-4c9b-9ff9-ea30140674dd admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:37.579211 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7c372-eef7-4c9b-9ff9-ea30140674dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:37.579485 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7c372-eef7-4c9b-9ff9-ea30140674dd admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:37.580169 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f7c372-eef7-4c9b-9ff9-ea30140674dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:37.582047 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f7c372-eef7-4c9b-9ff9-ea30140674dd admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:37.606561 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1378/2747] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:39:37 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:37.607718 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17de30f-1687-485e-9201-d7ec26d695cb admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:37.617860 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17de30f-1687-485e-9201-d7ec26d695cb admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:37.623295 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b0cbb8-dbde-4a6a-9228-4eda5a87f590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:37.623947 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0cbb8-dbde-4a6a-9228-4eda5a87f590 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:37.624945 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0cbb8-dbde-4a6a-9228-4eda5a87f590 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:37.625199 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0cbb8-dbde-4a6a-9228-4eda5a87f590 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:37.626087 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b0cbb8-dbde-4a6a-9228-4eda5a87f590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:37.627680 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b0cbb8-dbde-4a6a-9228-4eda5a87f590 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:37.638473 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1370/2748] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:39:37.643218 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7c372-eef7-4c9b-9ff9-ea30140674dd admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:37.653345 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7c372-eef7-4c9b-9ff9-ea30140674dd admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:37.658096 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d0cb66-643e-4e3f-941a-4e8ae9ec24f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:37.658804 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0cb66-643e-4e3f-941a-4e8ae9ec24f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:37.659090 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0cb66-643e-4e3f-941a-4e8ae9ec24f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:37.659365 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0cb66-643e-4e3f-941a-4e8ae9ec24f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:37.660085 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d0cb66-643e-4e3f-941a-4e8ae9ec24f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:37.661650 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d0cb66-643e-4e3f-941a-4e8ae9ec24f9 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:37.671801 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1379/2749] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:37.676060 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b0cbb8-dbde-4a6a-9228-4eda5a87f590 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:37.685720 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b0cbb8-dbde-4a6a-9228-4eda5a87f590 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:37.691709 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22c30e-1ced-42f6-9e3a-f9f000fffda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:37.692586 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22c30e-1ced-42f6-9e3a-f9f000fffda9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:37.692867 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22c30e-1ced-42f6-9e3a-f9f000fffda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:37.693136 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22c30e-1ced-42f6-9e3a-f9f000fffda9 admin admin] PATH_INFO: `/v3/projects/8d2a2e3558ec4fbe8bc9a56d835eca5c/users/cf6951a9a2c943a4921d2d83f903ee89/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:37.708015 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c22c30e-1ced-42f6-9e3a-f9f000fffda9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d2a2e3558ec4fbe8bc9a56d835eca5c, user_id=cf6951a9a2c943a4921d2d83f903ee89, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:37.711409 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c22c30e-1ced-42f6-9e3a-f9f000fffda9 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:37.724803 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1371/2750] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:37 2022] PUT /identity/v3/projects/8d2a2e3558ec4fbe8bc9a56d835eca5c/users/cf6951a9a2c943a4921d2d83f903ee89/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:37.735715 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261f571-80e7-45ac-9b06-b99cc1d9a609 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:37.736077 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261f571-80e7-45ac-9b06-b99cc1d9a609 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:37.736385 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261f571-80e7-45ac-9b06-b99cc1d9a609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:37.766541 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-2261f571-80e7-45ac-9b06-b99cc1d9a609 None None] MFA Rules not processed for user `cf6951a9a2c943a4921d2d83f903ee89`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:37.767790 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-2261f571-80e7-45ac-9b06-b99cc1d9a609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:37.837071 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1380/2751] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:39:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:37.858164 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22c30e-1ced-42f6-9e3a-f9f000fffda9 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:37.861202 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-4c22c30e-1ced-42f6-9e3a-f9f000fffda9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:37.923055 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22c30e-1ced-42f6-9e3a-f9f000fffda9 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:37.935730 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca8911-5188-44b0-bdd2-102bae16ed1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:37.937113 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca8911-5188-44b0-bdd2-102bae16ed1f service cinder] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:37.937504 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca8911-5188-44b0-bdd2-102bae16ed1f service cinder] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:37.938175 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca8911-5188-44b0-bdd2-102bae16ed1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:37.947201 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca8911-5188-44b0-bdd2-102bae16ed1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:37.948638 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca8911-5188-44b0-bdd2-102bae16ed1f service cinder] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:37.959170 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1372/2752] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:39:42.455303 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2261f571-80e7-45ac-9b06-b99cc1d9a609 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:42.457069 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-2261f571-80e7-45ac-9b06-b99cc1d9a609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:42.520954 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2261f571-80e7-45ac-9b06-b99cc1d9a609 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:42.524818 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a9dff-4851-44b5-93da-03d508535589 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:42.525465 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a9dff-4851-44b5-93da-03d508535589 service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:42.525747 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a9dff-4851-44b5-93da-03d508535589 service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:42.526021 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a9dff-4851-44b5-93da-03d508535589 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:42.527898 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-2c0a9dff-4851-44b5-93da-03d508535589 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:42.588182 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a9dff-4851-44b5-93da-03d508535589 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:42.589895 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a9dff-4851-44b5-93da-03d508535589 service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:42.599722 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1381/2753] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:39:44.727624 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca8911-5188-44b0-bdd2-102bae16ed1f service cinder] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:44.729721 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-e8ca8911-5188-44b0-bdd2-102bae16ed1f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:44.816673 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca8911-5188-44b0-bdd2-102bae16ed1f service cinder] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:44.821365 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29e224-b630-4451-8095-da30a6c16f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:44.822230 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29e224-b630-4451-8095-da30a6c16f6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:44.822509 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29e224-b630-4451-8095-da30a6c16f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:44.822853 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29e224-b630-4451-8095-da30a6c16f6d admin admin] PATH_INFO: `/v3/users/e46a293693184dd0ac24743fc6f81c19` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:44.824058 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29e224-b630-4451-8095-da30a6c16f6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e46a293693184dd0ac24743fc6f81c19)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:44.825975 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29e224-b630-4451-8095-da30a6c16f6d admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:44.879434 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-ce29e224-b630-4451-8095-da30a6c16f6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e46a293693184dd0ac24743fc6f81c19'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:44.880357 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-ce29e224-b630-4451-8095-da30a6c16f6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e46a293693184dd0ac24743fc6f81c19'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:44.894978 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-ce29e224-b630-4451-8095-da30a6c16f6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e46a293693184dd0ac24743fc6f81c19'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:44.904552 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-ce29e224-b630-4451-8095-da30a6c16f6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e46a293693184dd0ac24743fc6f81c19'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:44.914059 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-ce29e224-b630-4451-8095-da30a6c16f6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e46a293693184dd0ac24743fc6f81c19'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:44.920426 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1373/2754] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:39:44 2022] DELETE /identity/v3/users/e46a293693184dd0ac24743fc6f81c19 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:44.925761 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74457bd5-7688-4631-8028-be889a099b03 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:44.927054 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74457bd5-7688-4631-8028-be889a099b03 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:44.927820 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74457bd5-7688-4631-8028-be889a099b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:44.945943 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-74457bd5-7688-4631-8028-be889a099b03 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:44.947811 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-74457bd5-7688-4631-8028-be889a099b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:45.019354 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1382/2755] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:39:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:39:45.029180 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29e224-b630-4451-8095-da30a6c16f6d admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:45.031187 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-ce29e224-b630-4451-8095-da30a6c16f6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:45.091539 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29e224-b630-4451-8095-da30a6c16f6d admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:45.095346 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe242fc-ba55-4e5d-ac83-9b0e9ac71077 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:45.096019 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe242fc-ba55-4e5d-ac83-9b0e9ac71077 service neutron] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:45.096300 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe242fc-ba55-4e5d-ac83-9b0e9ac71077 service neutron] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:45.096572 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe242fc-ba55-4e5d-ac83-9b0e9ac71077 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:45.106254 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe242fc-ba55-4e5d-ac83-9b0e9ac71077 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:45.107713 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe242fc-ba55-4e5d-ac83-9b0e9ac71077 service neutron] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:45.118379 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1374/2756] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:39:45.444341 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74457bd5-7688-4631-8028-be889a099b03 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:45.445837 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-74457bd5-7688-4631-8028-be889a099b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:45.463518 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74457bd5-7688-4631-8028-be889a099b03 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:45.468933 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7debde03-536a-4143-9e45-4a3e450a23af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:45.469806 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7debde03-536a-4143-9e45-4a3e450a23af admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:45.470088 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7debde03-536a-4143-9e45-4a3e450a23af admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:45.470399 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7debde03-536a-4143-9e45-4a3e450a23af admin admin] PATH_INFO: `/v3/projects/c5b40b8aedb94e51a9802f6dc7df19ba` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:45.471679 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7debde03-536a-4143-9e45-4a3e450a23af admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5b40b8aedb94e51a9802f6dc7df19ba)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:45.473947 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7debde03-536a-4143-9e45-4a3e450a23af admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:45.523253 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-7debde03-536a-4143-9e45-4a3e450a23af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5b40b8aedb94e51a9802f6dc7df19ba', 'request_id': 'req-7debde03-536a-4143-9e45-4a3e450a23af'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:45.528648 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-7debde03-536a-4143-9e45-4a3e450a23af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5b40b8aedb94e51a9802f6dc7df19ba', 'request_id': 'req-7debde03-536a-4143-9e45-4a3e450a23af'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:45.535132 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-7debde03-536a-4143-9e45-4a3e450a23af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5b40b8aedb94e51a9802f6dc7df19ba', 'request_id': 'req-7debde03-536a-4143-9e45-4a3e450a23af'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:45.548558 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-7debde03-536a-4143-9e45-4a3e450a23af admin admin] The token cache is being invalidate because project c5b40b8aedb94e51a9802f6dc7df19ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:39:45.548850 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-7debde03-536a-4143-9e45-4a3e450a23af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:45.549472 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-7debde03-536a-4143-9e45-4a3e450a23af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:45.551060 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1383/2757] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:39:45 2022] DELETE /identity/v3/projects/c5b40b8aedb94e51a9802f6dc7df19ba => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:45.555182 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe242fc-ba55-4e5d-ac83-9b0e9ac71077 service neutron] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:45.564895 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe242fc-ba55-4e5d-ac83-9b0e9ac71077 service neutron] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:45.620491 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92845a1-4b88-4887-a334-ced53829c7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:45.621359 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92845a1-4b88-4887-a334-ced53829c7ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:45.621637 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92845a1-4b88-4887-a334-ced53829c7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:45.621905 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92845a1-4b88-4887-a334-ced53829c7ce admin admin] PATH_INFO: `/v3/users/d994a56e17994f18a7e080db6a850867` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:45.623130 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92845a1-4b88-4887-a334-ced53829c7ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=d994a56e17994f18a7e080db6a850867)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:45.625070 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92845a1-4b88-4887-a334-ced53829c7ce admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:45.669770 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-a92845a1-4b88-4887-a334-ced53829c7ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd994a56e17994f18a7e080db6a850867'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:45.670421 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-a92845a1-4b88-4887-a334-ced53829c7ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd994a56e17994f18a7e080db6a850867'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:45.681641 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-a92845a1-4b88-4887-a334-ced53829c7ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd994a56e17994f18a7e080db6a850867'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:45.688479 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-a92845a1-4b88-4887-a334-ced53829c7ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd994a56e17994f18a7e080db6a850867'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:45.694982 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-a92845a1-4b88-4887-a334-ced53829c7ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd994a56e17994f18a7e080db6a850867'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:45.700946 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1375/2758] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:39:45 2022] DELETE /identity/v3/users/d994a56e17994f18a7e080db6a850867 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:45.991370 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7debde03-536a-4143-9e45-4a3e450a23af admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:45.992840 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-7debde03-536a-4143-9e45-4a3e450a23af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:46.007147 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7debde03-536a-4143-9e45-4a3e450a23af admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:46.070904 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527537b6-3782-460e-82c1-2cab2d35a310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:46.071744 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527537b6-3782-460e-82c1-2cab2d35a310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:46.072017 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527537b6-3782-460e-82c1-2cab2d35a310 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:46.072282 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527537b6-3782-460e-82c1-2cab2d35a310 admin admin] PATH_INFO: `/v3/projects/6eefe637bf254cd5925cf0baf103538f` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:46.073536 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527537b6-3782-460e-82c1-2cab2d35a310 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eefe637bf254cd5925cf0baf103538f)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:46.075594 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527537b6-3782-460e-82c1-2cab2d35a310 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:46.124574 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-527537b6-3782-460e-82c1-2cab2d35a310 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eefe637bf254cd5925cf0baf103538f', 'request_id': 'req-527537b6-3782-460e-82c1-2cab2d35a310'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:46.130350 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-527537b6-3782-460e-82c1-2cab2d35a310 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eefe637bf254cd5925cf0baf103538f', 'request_id': 'req-527537b6-3782-460e-82c1-2cab2d35a310'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:46.136412 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-527537b6-3782-460e-82c1-2cab2d35a310 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eefe637bf254cd5925cf0baf103538f', 'request_id': 'req-527537b6-3782-460e-82c1-2cab2d35a310'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:46.152035 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-527537b6-3782-460e-82c1-2cab2d35a310 admin admin] The token cache is being invalidate because project 6eefe637bf254cd5925cf0baf103538f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:39:46.152371 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-527537b6-3782-460e-82c1-2cab2d35a310 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:46.153036 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-527537b6-3782-460e-82c1-2cab2d35a310 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:46.157710 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1384/2759] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:39:45 2022] DELETE /identity/v3/projects/6eefe637bf254cd5925cf0baf103538f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:46.160293 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba316a-4f47-4915-b87d-044dd130e59e None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:46.160759 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba316a-4f47-4915-b87d-044dd130e59e None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:46.160871 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba316a-4f47-4915-b87d-044dd130e59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:46.179718 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-f1ba316a-4f47-4915-b87d-044dd130e59e None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:46.180940 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-f1ba316a-4f47-4915-b87d-044dd130e59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:46.247445 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1376/2760] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:39:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:39:46.256939 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140677c-929e-4c97-9add-00f470fd9627 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:46.257229 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140677c-929e-4c97-9add-00f470fd9627 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:46.257509 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140677c-929e-4c97-9add-00f470fd9627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:46.276661 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-3140677c-929e-4c97-9add-00f470fd9627 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:46.278029 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-3140677c-929e-4c97-9add-00f470fd9627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:46.286648 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1385/2761] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:39:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:39:46.291029 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba316a-4f47-4915-b87d-044dd130e59e None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:46.301450 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba316a-4f47-4915-b87d-044dd130e59e None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:46.307190 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e92837-3884-4a6e-8594-d8284d0fe3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:46.307854 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e92837-3884-4a6e-8594-d8284d0fe3f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:46.308134 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e92837-3884-4a6e-8594-d8284d0fe3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:46.308403 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e92837-3884-4a6e-8594-d8284d0fe3f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:46.309122 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e92837-3884-4a6e-8594-d8284d0fe3f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:39:46.309419 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e92837-3884-4a6e-8594-d8284d0fe3f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:46.311034 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e92837-3884-4a6e-8594-d8284d0fe3f5 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:46.325249 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1377/2762] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:39:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:39:46.329854 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3140677c-929e-4c97-9add-00f470fd9627 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:46.339812 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3140677c-929e-4c97-9add-00f470fd9627 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:46.345015 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f630737-5667-4316-a0e7-6997e4fee311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:46.345670 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f630737-5667-4316-a0e7-6997e4fee311 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:46.345941 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f630737-5667-4316-a0e7-6997e4fee311 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:46.346405 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f630737-5667-4316-a0e7-6997e4fee311 admin admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:46.347127 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f630737-5667-4316-a0e7-6997e4fee311 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:46.349426 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f630737-5667-4316-a0e7-6997e4fee311 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:46.388242 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1386/2763] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:39:46 2022] POST /identity/v3/projects => generated 397 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:39:46.392758 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e92837-3884-4a6e-8594-d8284d0fe3f5 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:46.402794 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e92837-3884-4a6e-8594-d8284d0fe3f5 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:46.460639 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe308f6f-097d-41b2-b40d-b44cf190cc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:46.461308 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe308f6f-097d-41b2-b40d-b44cf190cc0e admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:46.461590 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe308f6f-097d-41b2-b40d-b44cf190cc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:46.461866 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe308f6f-097d-41b2-b40d-b44cf190cc0e admin admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:46.462587 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe308f6f-097d-41b2-b40d-b44cf190cc0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:46.464542 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe308f6f-097d-41b2-b40d-b44cf190cc0e admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:46.485914 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1378/2764] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:39:46 2022] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:46.490098 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f630737-5667-4316-a0e7-6997e4fee311 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:46.501294 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f630737-5667-4316-a0e7-6997e4fee311 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:46.506044 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4bb5d-64e5-44c9-b0dd-e7e5c664cf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:46.506751 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4bb5d-64e5-44c9-b0dd-e7e5c664cf8d admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:46.507036 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4bb5d-64e5-44c9-b0dd-e7e5c664cf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:46.507311 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4bb5d-64e5-44c9-b0dd-e7e5c664cf8d admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:46.508040 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a4bb5d-64e5-44c9-b0dd-e7e5c664cf8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:46.509666 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a4bb5d-64e5-44c9-b0dd-e7e5c664cf8d admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:46.521079 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1387/2765] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:46.525381 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe308f6f-097d-41b2-b40d-b44cf190cc0e admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:46.535941 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe308f6f-097d-41b2-b40d-b44cf190cc0e admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:46.540886 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b72e8-d3da-44fb-800e-bc7cf6de0326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:46.541627 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b72e8-d3da-44fb-800e-bc7cf6de0326 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:46.541983 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b72e8-d3da-44fb-800e-bc7cf6de0326 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:46.542292 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b72e8-d3da-44fb-800e-bc7cf6de0326 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:46.543315 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155b72e8-d3da-44fb-800e-bc7cf6de0326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:46.544680 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155b72e8-d3da-44fb-800e-bc7cf6de0326 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:46.555733 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1379/2766] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:46.559997 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4bb5d-64e5-44c9-b0dd-e7e5c664cf8d admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:46.571284 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4bb5d-64e5-44c9-b0dd-e7e5c664cf8d admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:46.580190 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0064fba-ce0d-4c66-b2af-f2f61c249fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:46.581087 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0064fba-ce0d-4c66-b2af-f2f61c249fb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:46.581370 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0064fba-ce0d-4c66-b2af-f2f61c249fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:46.581679 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0064fba-ce0d-4c66-b2af-f2f61c249fb5 admin admin] PATH_INFO: `/v3/projects/7e6aafab4a3c40259753acc3713739a5/users/6309f433c7a54fdd8a578ada0321168a/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:46.598074 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0064fba-ce0d-4c66-b2af-f2f61c249fb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e6aafab4a3c40259753acc3713739a5, user_id=6309f433c7a54fdd8a578ada0321168a, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:46.601044 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0064fba-ce0d-4c66-b2af-f2f61c249fb5 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:46.614169 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1388/2767] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:46 2022] PUT /identity/v3/projects/7e6aafab4a3c40259753acc3713739a5/users/6309f433c7a54fdd8a578ada0321168a/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:46.626663 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9eb06-9356-4185-ae03-5076c146d1c2 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:46.627407 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9eb06-9356-4185-ae03-5076c146d1c2 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:46.627691 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9eb06-9356-4185-ae03-5076c146d1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:46.656350 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-63e9eb06-9356-4185-ae03-5076c146d1c2 None None] MFA Rules not processed for user `6309f433c7a54fdd8a578ada0321168a`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:46.657567 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-63e9eb06-9356-4185-ae03-5076c146d1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:46.750217 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1380/2768] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:39:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:39:46.755020 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0064fba-ce0d-4c66-b2af-f2f61c249fb5 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:46.825249 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0064fba-ce0d-4c66-b2af-f2f61c249fb5 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:46.833068 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a933ea-77e3-4bf5-abad-17b699579fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:46.833744 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a933ea-77e3-4bf5-abad-17b699579fc4 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:46.834023 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a933ea-77e3-4bf5-abad-17b699579fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:46.834297 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a933ea-77e3-4bf5-abad-17b699579fc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:46.835030 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a933ea-77e3-4bf5-abad-17b699579fc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:46.836994 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a933ea-77e3-4bf5-abad-17b699579fc4 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:46.870312 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1389/2769] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:39:46 2022] POST /identity/v3/projects => generated 399 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:46.874940 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9eb06-9356-4185-ae03-5076c146d1c2 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:46.886610 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9eb06-9356-4185-ae03-5076c146d1c2 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:46.980853 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea5a938-2e47-4823-815d-cb5ada0218d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:46.985489 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5a938-2e47-4823-815d-cb5ada0218d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:46.985489 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5a938-2e47-4823-815d-cb5ada0218d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:46.986050 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5a938-2e47-4823-815d-cb5ada0218d3 admin admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:46.986912 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea5a938-2e47-4823-815d-cb5ada0218d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:46.988921 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea5a938-2e47-4823-815d-cb5ada0218d3 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:47.013117 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1381/2770] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:39:46 2022] POST /identity/v3/users => generated 306 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:47.017999 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a933ea-77e3-4bf5-abad-17b699579fc4 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:47.031669 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a933ea-77e3-4bf5-abad-17b699579fc4 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:47.037858 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703cd213-0944-4923-8709-490d711f8e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:47.038673 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703cd213-0944-4923-8709-490d711f8e91 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:47.039057 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703cd213-0944-4923-8709-490d711f8e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:47.039455 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703cd213-0944-4923-8709-490d711f8e91 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:47.040344 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703cd213-0944-4923-8709-490d711f8e91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:47.042494 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703cd213-0944-4923-8709-490d711f8e91 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:47.058470 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1390/2771] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:47.063070 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea5a938-2e47-4823-815d-cb5ada0218d3 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:47.077636 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea5a938-2e47-4823-815d-cb5ada0218d3 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:47.090164 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0fa2d-4329-415d-b42c-ebeee580ab17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:47.091229 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0fa2d-4329-415d-b42c-ebeee580ab17 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:47.091653 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0fa2d-4329-415d-b42c-ebeee580ab17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:47.091937 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0fa2d-4329-415d-b42c-ebeee580ab17 admin admin] PATH_INFO: `/v3/projects/210d32d0eaf749d69d6cab02cc57a2b2/users/c29d024b1c094f7c8ad433463badf831/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:47.109744 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f0fa2d-4329-415d-b42c-ebeee580ab17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=210d32d0eaf749d69d6cab02cc57a2b2, user_id=c29d024b1c094f7c8ad433463badf831, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:47.112490 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f0fa2d-4329-415d-b42c-ebeee580ab17 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:47.144014 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1382/2772] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:47 2022] PUT /identity/v3/projects/210d32d0eaf749d69d6cab02cc57a2b2/users/c29d024b1c094f7c8ad433463badf831/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:39:47.147783 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703cd213-0944-4923-8709-490d711f8e91 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:47.158505 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703cd213-0944-4923-8709-490d711f8e91 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:47.229200 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810baab-1929-4f99-8146-b5886dd773c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:47.230481 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810baab-1929-4f99-8146-b5886dd773c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:47.230805 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810baab-1929-4f99-8146-b5886dd773c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:47.231085 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810baab-1929-4f99-8146-b5886dd773c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:47.232348 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f810baab-1929-4f99-8146-b5886dd773c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:47.236003 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f810baab-1929-4f99-8146-b5886dd773c5 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:47.261351 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1391/2773] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:47.266361 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0fa2d-4329-415d-b42c-ebeee580ab17 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:47.280685 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0fa2d-4329-415d-b42c-ebeee580ab17 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:47.293479 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01c184-3e11-457f-a7f2-46911eff78c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:47.294853 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01c184-3e11-457f-a7f2-46911eff78c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:47.295324 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01c184-3e11-457f-a7f2-46911eff78c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:47.295758 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01c184-3e11-457f-a7f2-46911eff78c1 admin admin] PATH_INFO: `/v3/projects/210d32d0eaf749d69d6cab02cc57a2b2/users/c29d024b1c094f7c8ad433463badf831/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:47.299131 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a01c184-3e11-457f-a7f2-46911eff78c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=210d32d0eaf749d69d6cab02cc57a2b2, user_id=c29d024b1c094f7c8ad433463badf831, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:47.302978 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a01c184-3e11-457f-a7f2-46911eff78c1 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:47.323167 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1383/2774] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:47 2022] PUT /identity/v3/projects/210d32d0eaf749d69d6cab02cc57a2b2/users/c29d024b1c094f7c8ad433463badf831/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:47.335521 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485548a-6153-4f54-a183-c6a0b3bc3fb4 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:47.335813 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485548a-6153-4f54-a183-c6a0b3bc3fb4 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:47.339550 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485548a-6153-4f54-a183-c6a0b3bc3fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:47.435791 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-7485548a-6153-4f54-a183-c6a0b3bc3fb4 None None] MFA Rules not processed for user `c29d024b1c094f7c8ad433463badf831`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:47.438313 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-7485548a-6153-4f54-a183-c6a0b3bc3fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:47.534140 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1392/2775] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:39:47 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:47.752946 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01c184-3e11-457f-a7f2-46911eff78c1 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:47.755087 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-6a01c184-3e11-457f-a7f2-46911eff78c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:47.872575 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01c184-3e11-457f-a7f2-46911eff78c1 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:47.877764 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2b2f9-6b95-45f7-8c5f-abac7b49c458 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:47.878670 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2b2f9-6b95-45f7-8c5f-abac7b49c458 service cinder] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:47.878947 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2b2f9-6b95-45f7-8c5f-abac7b49c458 service cinder] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:47.879357 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2b2f9-6b95-45f7-8c5f-abac7b49c458 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:47.890632 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd2b2f9-6b95-45f7-8c5f-abac7b49c458 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:47.892455 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd2b2f9-6b95-45f7-8c5f-abac7b49c458 service cinder] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:47.910269 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1384/2776] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:47 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:39:47.916810 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485548a-6153-4f54-a183-c6a0b3bc3fb4 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:47.917943 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-7485548a-6153-4f54-a183-c6a0b3bc3fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:48.018364 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2b2f9-6b95-45f7-8c5f-abac7b49c458 service cinder] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:48.023490 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485548a-6153-4f54-a183-c6a0b3bc3fb4 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:48.033788 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4f0fb-aeab-45a8-a77e-0205cce144f2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b2346e4de5d45a79d4bb2abb01d4827', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:48.035228 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4f0fb-aeab-45a8-a77e-0205cce144f2 service placement] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:48.035821 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4f0fb-aeab-45a8-a77e-0205cce144f2 service placement] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:48.036254 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4f0fb-aeab-45a8-a77e-0205cce144f2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:48.039023 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-16f4f0fb-aeab-45a8-a77e-0205cce144f2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:48.046673 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2b2f9-6b95-45f7-8c5f-abac7b49c458 service cinder] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:48.055263 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f4f0fb-aeab-45a8-a77e-0205cce144f2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:48.057403 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95f1a7-3240-448b-ab7e-be278e62010b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:48.057581 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f4f0fb-aeab-45a8-a77e-0205cce144f2 service placement] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:48.058487 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95f1a7-3240-448b-ab7e-be278e62010b service cinder] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:48.058815 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95f1a7-3240-448b-ab7e-be278e62010b service cinder] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:48.059102 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95f1a7-3240-448b-ab7e-be278e62010b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:48.071002 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1393/2777] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:39:48.071879 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4f0fb-aeab-45a8-a77e-0205cce144f2 service placement] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:48.073393 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-16f4f0fb-aeab-45a8-a77e-0205cce144f2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:48.089162 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4f0fb-aeab-45a8-a77e-0205cce144f2 service placement] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:48.097347 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00830636-a008-44e6-9845-a834622542a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b2346e4de5d45a79d4bb2abb01d4827', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:48.098341 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00830636-a008-44e6-9845-a834622542a6 service placement] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:48.099617 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00830636-a008-44e6-9845-a834622542a6 service placement] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:48.100065 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00830636-a008-44e6-9845-a834622542a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:48.111959 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00830636-a008-44e6-9845-a834622542a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:48.114671 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00830636-a008-44e6-9845-a834622542a6 service placement] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:48.128203 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1394/2778] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:39:48.141710 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00830636-a008-44e6-9845-a834622542a6 service placement] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:48.145373 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-00830636-a008-44e6-9845-a834622542a6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:48.215053 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe95f1a7-3240-448b-ab7e-be278e62010b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:48.216935 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe95f1a7-3240-448b-ab7e-be278e62010b service cinder] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:48.228235 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1385/2779] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:48 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:39:48.252120 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00830636-a008-44e6-9845-a834622542a6 service placement] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:48.259120 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad1004-1e0e-46e3-b821-1f4abeb244e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:48.259992 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad1004-1e0e-46e3-b821-1f4abeb244e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:48.260270 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad1004-1e0e-46e3-b821-1f4abeb244e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:48.260573 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad1004-1e0e-46e3-b821-1f4abeb244e4 admin admin] PATH_INFO: `/v3/users/cf6951a9a2c943a4921d2d83f903ee89` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:48.262337 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ad1004-1e0e-46e3-b821-1f4abeb244e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf6951a9a2c943a4921d2d83f903ee89)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:48.264559 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ad1004-1e0e-46e3-b821-1f4abeb244e4 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:48.320640 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-f7ad1004-1e0e-46e3-b821-1f4abeb244e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf6951a9a2c943a4921d2d83f903ee89'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:48.330136 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-f7ad1004-1e0e-46e3-b821-1f4abeb244e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf6951a9a2c943a4921d2d83f903ee89'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:48.330808 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-f7ad1004-1e0e-46e3-b821-1f4abeb244e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf6951a9a2c943a4921d2d83f903ee89'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:48.344272 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-f7ad1004-1e0e-46e3-b821-1f4abeb244e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf6951a9a2c943a4921d2d83f903ee89'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:48.354633 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-f7ad1004-1e0e-46e3-b821-1f4abeb244e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf6951a9a2c943a4921d2d83f903ee89'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:48.361722 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1395/2780] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:39:48 2022] DELETE /identity/v3/users/cf6951a9a2c943a4921d2d83f903ee89 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:39:48.366562 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10e642-0ae2-42d1-ad73-8efaca6dc1d7 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:48.367114 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10e642-0ae2-42d1-ad73-8efaca6dc1d7 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:48.367239 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10e642-0ae2-42d1-ad73-8efaca6dc1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:48.386798 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-2f10e642-0ae2-42d1-ad73-8efaca6dc1d7 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:48.388021 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-2f10e642-0ae2-42d1-ad73-8efaca6dc1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:48.461365 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1386/2781] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:39:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:48.471659 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad1004-1e0e-46e3-b821-1f4abeb244e4 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:48.473790 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-f7ad1004-1e0e-46e3-b821-1f4abeb244e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:48.583238 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad1004-1e0e-46e3-b821-1f4abeb244e4 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:48.587451 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c6f8a-4749-4e5c-bea6-3ea3323d6776 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:48.588245 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c6f8a-4749-4e5c-bea6-3ea3323d6776 service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:48.588528 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c6f8a-4749-4e5c-bea6-3ea3323d6776 service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:48.589084 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c6f8a-4749-4e5c-bea6-3ea3323d6776 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:48.602332 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0c6f8a-4749-4e5c-bea6-3ea3323d6776 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:48.605285 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0c6f8a-4749-4e5c-bea6-3ea3323d6776 service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:48.618308 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1396/2782] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:39:48.886466 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513f43e-58bb-438c-9a4f-9985962d4327 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:48.886786 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513f43e-58bb-438c-9a4f-9985962d4327 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:48.887063 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513f43e-58bb-438c-9a4f-9985962d4327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:48.908307 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-f513f43e-58bb-438c-9a4f-9985962d4327 None None] MFA Rules not processed for user `bcd74c3c272a427ba2e362c19cdbad8a`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:48.909708 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-f513f43e-58bb-438c-9a4f-9985962d4327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:48.950424 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c6f8a-4749-4e5c-bea6-3ea3323d6776 service neutron] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:48.952301 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-3a0c6f8a-4749-4e5c-bea6-3ea3323d6776 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:48.971827 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c6f8a-4749-4e5c-bea6-3ea3323d6776 service neutron] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:48.978835 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295a254-8367-42e1-8768-36547946f3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:48.979046 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1387/2783] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:39:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:48.979724 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295a254-8367-42e1-8768-36547946f3f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:48.980027 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295a254-8367-42e1-8768-36547946f3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:48.980498 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295a254-8367-42e1-8768-36547946f3f8 admin admin] PATH_INFO: `/v3/projects/8d2a2e3558ec4fbe8bc9a56d835eca5c` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:48.984353 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295a254-8367-42e1-8768-36547946f3f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d2a2e3558ec4fbe8bc9a56d835eca5c)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:48.986196 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295a254-8367-42e1-8768-36547946f3f8 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:49.033395 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-2295a254-8367-42e1-8768-36547946f3f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d2a2e3558ec4fbe8bc9a56d835eca5c', 'request_id': 'req-2295a254-8367-42e1-8768-36547946f3f8'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:49.038963 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-2295a254-8367-42e1-8768-36547946f3f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d2a2e3558ec4fbe8bc9a56d835eca5c', 'request_id': 'req-2295a254-8367-42e1-8768-36547946f3f8'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:49.045379 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-2295a254-8367-42e1-8768-36547946f3f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d2a2e3558ec4fbe8bc9a56d835eca5c', 'request_id': 'req-2295a254-8367-42e1-8768-36547946f3f8'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:49.059846 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-2295a254-8367-42e1-8768-36547946f3f8 admin admin] The token cache is being invalidate because project 8d2a2e3558ec4fbe8bc9a56d835eca5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:39:49.060137 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-2295a254-8367-42e1-8768-36547946f3f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:49.060779 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-2295a254-8367-42e1-8768-36547946f3f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:49.063211 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1397/2784] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:39:48 2022] DELETE /identity/v3/projects/8d2a2e3558ec4fbe8bc9a56d835eca5c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:39:49.068552 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07b4eb-ed36-42c9-84a1-b604831610b2 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:49.069070 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07b4eb-ed36-42c9-84a1-b604831610b2 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:49.069479 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07b4eb-ed36-42c9-84a1-b604831610b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:49.089364 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-8b07b4eb-ed36-42c9-84a1-b604831610b2 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:49.091049 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-8b07b4eb-ed36-42c9-84a1-b604831610b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:49.162156 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1388/2785] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:39:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:49.170886 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0159e-3d9a-4915-9625-15729624ef82 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:49.171542 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0159e-3d9a-4915-9625-15729624ef82 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:49.172019 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0159e-3d9a-4915-9625-15729624ef82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:49.192335 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-43c0159e-3d9a-4915-9625-15729624ef82 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:49.193716 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-43c0159e-3d9a-4915-9625-15729624ef82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:49.205672 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1398/2786] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:39:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:39:49.206930 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07b4eb-ed36-42c9-84a1-b604831610b2 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:49.218576 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07b4eb-ed36-42c9-84a1-b604831610b2 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:49.224984 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e24fa7-8651-472e-9edc-65b5c568bc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:49.225869 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e24fa7-8651-472e-9edc-65b5c568bc54 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:49.226155 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e24fa7-8651-472e-9edc-65b5c568bc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:49.226432 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e24fa7-8651-472e-9edc-65b5c568bc54 admin admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:49.227477 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e24fa7-8651-472e-9edc-65b5c568bc54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:39:49.227781 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e24fa7-8651-472e-9edc-65b5c568bc54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:49.229663 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e24fa7-8651-472e-9edc-65b5c568bc54 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:49.247562 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1389/2787] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:39:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 10:39:49.252429 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0159e-3d9a-4915-9625-15729624ef82 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:49.262970 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0159e-3d9a-4915-9625-15729624ef82 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:49.269470 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc061a0-1631-40fd-bdcb-c523b317fd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:49.271002 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc061a0-1631-40fd-bdcb-c523b317fd6f admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:49.271474 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc061a0-1631-40fd-bdcb-c523b317fd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:49.271928 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc061a0-1631-40fd-bdcb-c523b317fd6f admin admin] PATH_INFO: `/v3/projects` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:49.273350 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc061a0-1631-40fd-bdcb-c523b317fd6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:49.275562 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc061a0-1631-40fd-bdcb-c523b317fd6f admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:49.325099 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1399/2788] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:39:49 2022] POST /identity/v3/projects => generated 379 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:49.329708 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e24fa7-8651-472e-9edc-65b5c568bc54 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:49.356749 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e24fa7-8651-472e-9edc-65b5c568bc54 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:49.406220 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc061a0-1631-40fd-bdcb-c523b317fd6f admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:49.409113 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-dcc061a0-1631-40fd-bdcb-c523b317fd6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:49.440849 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d10fb-717c-457c-9610-1394de6733b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:49.441603 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d10fb-717c-457c-9610-1394de6733b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:49.441949 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d10fb-717c-457c-9610-1394de6733b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:49.442315 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d10fb-717c-457c-9610-1394de6733b4 admin admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:49.443343 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d10fb-717c-457c-9610-1394de6733b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:49.445327 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d10fb-717c-457c-9610-1394de6733b4 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:49.467509 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1390/2789] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:39:49 2022] POST /identity/v3/users => generated 290 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:49.472120 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d10fb-717c-457c-9610-1394de6733b4 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:49.475812 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc061a0-1631-40fd-bdcb-c523b317fd6f admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:49.479850 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d7c60-f27c-4646-8379-b7ba5df192d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:49.480553 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d7c60-f27c-4646-8379-b7ba5df192d8 service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:49.480857 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d7c60-f27c-4646-8379-b7ba5df192d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:49.481136 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d7c60-f27c-4646-8379-b7ba5df192d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:49.482551 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d10fb-717c-457c-9610-1394de6733b4 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:49.483006 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-af5d7c60-f27c-4646-8379-b7ba5df192d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:49.487508 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d7e31-a8df-4284-adf7-f1af57547e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:49.488377 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d7e31-a8df-4284-adf7-f1af57547e94 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:49.488754 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d7e31-a8df-4284-adf7-f1af57547e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:49.489163 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d7e31-a8df-4284-adf7-f1af57547e94 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:49.490016 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d7e31-a8df-4284-adf7-f1af57547e94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:49.493021 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d7e31-a8df-4284-adf7-f1af57547e94 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:49.495355 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d7c60-f27c-4646-8379-b7ba5df192d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:49.497020 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d7c60-f27c-4646-8379-b7ba5df192d8 service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:49.503817 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1391/2790] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:39:49.507734 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d7e31-a8df-4284-adf7-f1af57547e94 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:49.508145 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1400/2791] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:39:49.519733 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d7e31-a8df-4284-adf7-f1af57547e94 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:49.524530 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141b210-5d61-4aef-b690-014a94aa6076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:49.525188 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141b210-5d61-4aef-b690-014a94aa6076 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:49.525466 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141b210-5d61-4aef-b690-014a94aa6076 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:49.525734 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141b210-5d61-4aef-b690-014a94aa6076 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:49.526453 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0141b210-5d61-4aef-b690-014a94aa6076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:49.528069 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0141b210-5d61-4aef-b690-014a94aa6076 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:49.544724 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1392/2792] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:39:49.545121 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d7c60-f27c-4646-8379-b7ba5df192d8 service neutron] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:49.560703 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d7c60-f27c-4646-8379-b7ba5df192d8 service neutron] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:49.566933 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d548bc4-442d-4dd4-b4a1-cf80ad1d3946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:49.568158 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d548bc4-442d-4dd4-b4a1-cf80ad1d3946 admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:49.568631 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d548bc4-442d-4dd4-b4a1-cf80ad1d3946 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:49.569108 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d548bc4-442d-4dd4-b4a1-cf80ad1d3946 admin admin] PATH_INFO: `/v3/projects/89ef7e55ea524b1c979f0dbad2a150df/users/d7520dc4fad24983a3ec9b1a205a3ef2/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:49.589873 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d548bc4-442d-4dd4-b4a1-cf80ad1d3946 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89ef7e55ea524b1c979f0dbad2a150df, user_id=d7520dc4fad24983a3ec9b1a205a3ef2, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:49.594153 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d548bc4-442d-4dd4-b4a1-cf80ad1d3946 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:49.635217 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1401/2793] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:49 2022] PUT /identity/v3/projects/89ef7e55ea524b1c979f0dbad2a150df/users/d7520dc4fad24983a3ec9b1a205a3ef2/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:39:49.640399 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeecd72-a66d-4072-aae3-a6d4bce23f78 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:49.641121 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeecd72-a66d-4072-aae3-a6d4bce23f78 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:49.641667 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeecd72-a66d-4072-aae3-a6d4bce23f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:49.676193 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-bdeecd72-a66d-4072-aae3-a6d4bce23f78 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:49.677641 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-bdeecd72-a66d-4072-aae3-a6d4bce23f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:49.766057 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1393/2794] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:39:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:49.776780 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d548bc4-442d-4dd4-b4a1-cf80ad1d3946 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:49.778802 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-3d548bc4-442d-4dd4-b4a1-cf80ad1d3946 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:49.873668 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d548bc4-442d-4dd4-b4a1-cf80ad1d3946 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:49.884987 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f0bbc-f237-4a58-a113-1122bab9a094 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:49.885821 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f0bbc-f237-4a58-a113-1122bab9a094 service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:49.886210 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f0bbc-f237-4a58-a113-1122bab9a094 service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:49.886586 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f0bbc-f237-4a58-a113-1122bab9a094 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:49.903200 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f0bbc-f237-4a58-a113-1122bab9a094 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:49.904764 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f0bbc-f237-4a58-a113-1122bab9a094 service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:49.931997 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1402/2795] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:39:50.672516 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb7241-22a0-4a47-94cc-cc9b2daaccfe None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:50.673109 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb7241-22a0-4a47-94cc-cc9b2daaccfe None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:50.673435 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb7241-22a0-4a47-94cc-cc9b2daaccfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:50.703658 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-d2eb7241-22a0-4a47-94cc-cc9b2daaccfe None None] MFA Rules not processed for user `d7520dc4fad24983a3ec9b1a205a3ef2`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:50.704937 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-d2eb7241-22a0-4a47-94cc-cc9b2daaccfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:50.785143 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1394/2796] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:39:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:50.794111 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f0bbc-f237-4a58-a113-1122bab9a094 service neutron] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:50.795566 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-5c6f0bbc-f237-4a58-a113-1122bab9a094 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:50.867294 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f0bbc-f237-4a58-a113-1122bab9a094 service neutron] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:50.872369 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15adf7cc-6374-47c4-8bc3-b34d26c212a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:50.873181 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15adf7cc-6374-47c4-8bc3-b34d26c212a0 service cinder] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:50.873467 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15adf7cc-6374-47c4-8bc3-b34d26c212a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:50.873744 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15adf7cc-6374-47c4-8bc3-b34d26c212a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:50.883226 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15adf7cc-6374-47c4-8bc3-b34d26c212a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:50.884668 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15adf7cc-6374-47c4-8bc3-b34d26c212a0 service cinder] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:50.895804 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1403/2797] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:39:52.446098 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4da0a3-f638-4252-8b8b-0f7bcf716164 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:52.447158 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4da0a3-f638-4252-8b8b-0f7bcf716164 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:52.447590 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4da0a3-f638-4252-8b8b-0f7bcf716164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:52.467168 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-5c4da0a3-f638-4252-8b8b-0f7bcf716164 None None] MFA Rules not processed for user `d7520dc4fad24983a3ec9b1a205a3ef2`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:52.468747 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-5c4da0a3-f638-4252-8b8b-0f7bcf716164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:52.478041 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1395/2798] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:39:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:52.718351 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15adf7cc-6374-47c4-8bc3-b34d26c212a0 service cinder] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:52.720786 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-15adf7cc-6374-47c4-8bc3-b34d26c212a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:52.737024 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15adf7cc-6374-47c4-8bc3-b34d26c212a0 service cinder] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:52.742368 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a94499c-677b-487b-82fe-fde72919138f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:52.743414 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94499c-677b-487b-82fe-fde72919138f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:52.743826 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94499c-677b-487b-82fe-fde72919138f admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:52.744199 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94499c-677b-487b-82fe-fde72919138f admin admin] PATH_INFO: `/v3/users/6309f433c7a54fdd8a578ada0321168a` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:52.745595 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a94499c-677b-487b-82fe-fde72919138f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6309f433c7a54fdd8a578ada0321168a)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:52.747642 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a94499c-677b-487b-82fe-fde72919138f admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:52.799017 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-3a94499c-677b-487b-82fe-fde72919138f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6309f433c7a54fdd8a578ada0321168a'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:52.809250 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-3a94499c-677b-487b-82fe-fde72919138f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6309f433c7a54fdd8a578ada0321168a'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:52.809620 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-3a94499c-677b-487b-82fe-fde72919138f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6309f433c7a54fdd8a578ada0321168a'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:52.828122 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-3a94499c-677b-487b-82fe-fde72919138f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6309f433c7a54fdd8a578ada0321168a'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:52.838123 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-3a94499c-677b-487b-82fe-fde72919138f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6309f433c7a54fdd8a578ada0321168a'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:52.869204 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1404/2799] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:39:52 2022] DELETE /identity/v3/users/6309f433c7a54fdd8a578ada0321168a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:52.874517 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd4c98-6d2f-4c22-8c74-21df697b9457 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:52.875267 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd4c98-6d2f-4c22-8c74-21df697b9457 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:52.875267 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd4c98-6d2f-4c22-8c74-21df697b9457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:52.902217 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-21dd4c98-6d2f-4c22-8c74-21df697b9457 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:52.903853 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-21dd4c98-6d2f-4c22-8c74-21df697b9457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:53.015288 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1396/2800] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:39:53.039404 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a94499c-677b-487b-82fe-fde72919138f admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:53.041336 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-3a94499c-677b-487b-82fe-fde72919138f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:53.134908 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a94499c-677b-487b-82fe-fde72919138f admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:53.145095 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41bea74-3a84-4aa5-a21f-af3967bd6214 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:53.145775 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bea74-3a84-4aa5-a21f-af3967bd6214 service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:53.146086 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bea74-3a84-4aa5-a21f-af3967bd6214 service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:53.146368 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bea74-3a84-4aa5-a21f-af3967bd6214 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:53.158439 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41bea74-3a84-4aa5-a21f-af3967bd6214 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:53.160185 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41bea74-3a84-4aa5-a21f-af3967bd6214 service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:53.178547 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1405/2801] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:39:54.009175 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd4c98-6d2f-4c22-8c74-21df697b9457 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:54.010576 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-21dd4c98-6d2f-4c22-8c74-21df697b9457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:54.028529 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd4c98-6d2f-4c22-8c74-21df697b9457 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:54.040635 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f8865-a4ee-4365-ac2e-8697a6c6c309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:54.041633 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f8865-a4ee-4365-ac2e-8697a6c6c309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:54.044305 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f8865-a4ee-4365-ac2e-8697a6c6c309 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:54.044305 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f8865-a4ee-4365-ac2e-8697a6c6c309 admin admin] PATH_INFO: `/v3/projects/7e6aafab4a3c40259753acc3713739a5` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:54.044305 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f8865-a4ee-4365-ac2e-8697a6c6c309 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e6aafab4a3c40259753acc3713739a5)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:54.048448 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f8865-a4ee-4365-ac2e-8697a6c6c309 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:54.152724 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-523f8865-a4ee-4365-ac2e-8697a6c6c309 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e6aafab4a3c40259753acc3713739a5', 'request_id': 'req-523f8865-a4ee-4365-ac2e-8697a6c6c309'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:54.161319 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-523f8865-a4ee-4365-ac2e-8697a6c6c309 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e6aafab4a3c40259753acc3713739a5', 'request_id': 'req-523f8865-a4ee-4365-ac2e-8697a6c6c309'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:54.169814 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-523f8865-a4ee-4365-ac2e-8697a6c6c309 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e6aafab4a3c40259753acc3713739a5', 'request_id': 'req-523f8865-a4ee-4365-ac2e-8697a6c6c309'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:54.194550 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-523f8865-a4ee-4365-ac2e-8697a6c6c309 admin admin] The token cache is being invalidate because project 7e6aafab4a3c40259753acc3713739a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:39:54.195777 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-523f8865-a4ee-4365-ac2e-8697a6c6c309 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:54.196647 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-523f8865-a4ee-4365-ac2e-8697a6c6c309 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:54.206369 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41bea74-3a84-4aa5-a21f-af3967bd6214 service neutron] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:54.218436 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1397/2802] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:39:54 2022] DELETE /identity/v3/projects/7e6aafab4a3c40259753acc3713739a5 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:54.219683 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41bea74-3a84-4aa5-a21f-af3967bd6214 service neutron] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:54.293743 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570bf9e-7220-4f92-af92-a2847dda5922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:54.294990 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570bf9e-7220-4f92-af92-a2847dda5922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:54.295455 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570bf9e-7220-4f92-af92-a2847dda5922 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:54.295987 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570bf9e-7220-4f92-af92-a2847dda5922 admin admin] PATH_INFO: `/v3/users/c29d024b1c094f7c8ad433463badf831` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:54.297640 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4570bf9e-7220-4f92-af92-a2847dda5922 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c29d024b1c094f7c8ad433463badf831)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:54.300244 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4570bf9e-7220-4f92-af92-a2847dda5922 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:54.362322 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-4570bf9e-7220-4f92-af92-a2847dda5922 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c29d024b1c094f7c8ad433463badf831'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:54.370368 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-4570bf9e-7220-4f92-af92-a2847dda5922 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c29d024b1c094f7c8ad433463badf831'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:54.371054 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-4570bf9e-7220-4f92-af92-a2847dda5922 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c29d024b1c094f7c8ad433463badf831'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:54.384496 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-4570bf9e-7220-4f92-af92-a2847dda5922 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c29d024b1c094f7c8ad433463badf831'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:54.391787 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-4570bf9e-7220-4f92-af92-a2847dda5922 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c29d024b1c094f7c8ad433463badf831'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:54.398361 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1406/2803] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:39:54 2022] DELETE /identity/v3/users/c29d024b1c094f7c8ad433463badf831 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:54.711189 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f8865-a4ee-4365-ac2e-8697a6c6c309 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:54.713304 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-523f8865-a4ee-4365-ac2e-8697a6c6c309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:54.745409 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f8865-a4ee-4365-ac2e-8697a6c6c309 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:54.823963 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa68958-a12e-4416-8587-5e89531929c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:54.824860 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa68958-a12e-4416-8587-5e89531929c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:54.825140 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa68958-a12e-4416-8587-5e89531929c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:54.825416 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa68958-a12e-4416-8587-5e89531929c1 admin admin] PATH_INFO: `/v3/projects/210d32d0eaf749d69d6cab02cc57a2b2` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:54.827243 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa68958-a12e-4416-8587-5e89531929c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=210d32d0eaf749d69d6cab02cc57a2b2)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:54.829449 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa68958-a12e-4416-8587-5e89531929c1 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:54.877890 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-baa68958-a12e-4416-8587-5e89531929c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '210d32d0eaf749d69d6cab02cc57a2b2', 'request_id': 'req-baa68958-a12e-4416-8587-5e89531929c1'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:54.885383 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-baa68958-a12e-4416-8587-5e89531929c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '210d32d0eaf749d69d6cab02cc57a2b2', 'request_id': 'req-baa68958-a12e-4416-8587-5e89531929c1'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:54.891820 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-baa68958-a12e-4416-8587-5e89531929c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '210d32d0eaf749d69d6cab02cc57a2b2', 'request_id': 'req-baa68958-a12e-4416-8587-5e89531929c1'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:54.904825 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-baa68958-a12e-4416-8587-5e89531929c1 admin admin] The token cache is being invalidate because project 210d32d0eaf749d69d6cab02cc57a2b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:39:54.905113 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-baa68958-a12e-4416-8587-5e89531929c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:54.906316 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-baa68958-a12e-4416-8587-5e89531929c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:54.907883 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1398/2804] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:39:54 2022] DELETE /identity/v3/projects/210d32d0eaf749d69d6cab02cc57a2b2 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:54.914015 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a5057-a90a-4f47-8488-30f32f2a3d2f None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:54.914304 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a5057-a90a-4f47-8488-30f32f2a3d2f None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:54.914641 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a5057-a90a-4f47-8488-30f32f2a3d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:54.938406 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-ae7a5057-a90a-4f47-8488-30f32f2a3d2f None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:54.940896 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-ae7a5057-a90a-4f47-8488-30f32f2a3d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:55.008799 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1407/2805] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:55.016882 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e6ebf-94d2-4634-b816-265ef23c2c7f None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:55.017835 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e6ebf-94d2-4634-b816-265ef23c2c7f None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:55.018414 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e6ebf-94d2-4634-b816-265ef23c2c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:55.074746 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-eb6e6ebf-94d2-4634-b816-265ef23c2c7f None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:55.076306 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-eb6e6ebf-94d2-4634-b816-265ef23c2c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:55.098625 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1399/2806] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:39:55.104441 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a5057-a90a-4f47-8488-30f32f2a3d2f None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:55.116164 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a5057-a90a-4f47-8488-30f32f2a3d2f None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:55.122120 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f422f34-ade4-413c-b505-933c49490212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:55.122847 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f422f34-ade4-413c-b505-933c49490212 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:55.123602 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f422f34-ade4-413c-b505-933c49490212 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:55.123602 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f422f34-ade4-413c-b505-933c49490212 admin admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:55.124761 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f422f34-ade4-413c-b505-933c49490212 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:39:55.124761 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f422f34-ade4-413c-b505-933c49490212 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:55.126922 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f422f34-ade4-413c-b505-933c49490212 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:55.143510 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1408/2807] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:39:55.144083 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e6ebf-94d2-4634-b816-265ef23c2c7f None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:55.154699 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e6ebf-94d2-4634-b816-265ef23c2c7f None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:55.163079 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b74ac-776b-4c45-abff-e977a6b819e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:55.163927 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b74ac-776b-4c45-abff-e977a6b819e4 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:55.164046 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b74ac-776b-4c45-abff-e977a6b819e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:55.164318 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b74ac-776b-4c45-abff-e977a6b819e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:55.165002 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b74ac-776b-4c45-abff-e977a6b819e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:55.167574 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b74ac-776b-4c45-abff-e977a6b819e4 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:55.201029 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1400/2808] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:39:55 2022] POST /identity/v3/projects => generated 387 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:39:55.205931 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f422f34-ade4-413c-b505-933c49490212 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:55.219285 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f422f34-ade4-413c-b505-933c49490212 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:55.299471 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c06fe-359a-4ef1-9770-e3d190c3a1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:55.300508 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c06fe-359a-4ef1-9770-e3d190c3a1ea admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:55.300793 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c06fe-359a-4ef1-9770-e3d190c3a1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:55.301384 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c06fe-359a-4ef1-9770-e3d190c3a1ea admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:55.302069 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c06fe-359a-4ef1-9770-e3d190c3a1ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:55.304007 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c06fe-359a-4ef1-9770-e3d190c3a1ea admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:55.326046 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1409/2809] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:39:55 2022] POST /identity/v3/users => generated 294 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:55.331090 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b74ac-776b-4c45-abff-e977a6b819e4 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:55.341855 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b74ac-776b-4c45-abff-e977a6b819e4 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:55.347757 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3e18d-e30e-45bb-b898-38de24e7d81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:55.348601 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3e18d-e30e-45bb-b898-38de24e7d81f admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:55.349137 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3e18d-e30e-45bb-b898-38de24e7d81f admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:55.349970 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3e18d-e30e-45bb-b898-38de24e7d81f admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:55.350725 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3e18d-e30e-45bb-b898-38de24e7d81f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:55.352308 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3e18d-e30e-45bb-b898-38de24e7d81f admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:55.365390 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1401/2810] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:55.368927 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c06fe-359a-4ef1-9770-e3d190c3a1ea admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:55.378950 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c06fe-359a-4ef1-9770-e3d190c3a1ea admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:55.385258 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e121f102-3de9-41d7-9029-0bee0c7e5f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:55.385926 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121f102-3de9-41d7-9029-0bee0c7e5f91 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:55.386201 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121f102-3de9-41d7-9029-0bee0c7e5f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:55.386473 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121f102-3de9-41d7-9029-0bee0c7e5f91 admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:55.387223 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e121f102-3de9-41d7-9029-0bee0c7e5f91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:55.388804 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e121f102-3de9-41d7-9029-0bee0c7e5f91 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:55.401318 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1410/2811] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:55.405786 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3e18d-e30e-45bb-b898-38de24e7d81f admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:55.420109 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3e18d-e30e-45bb-b898-38de24e7d81f admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:55.426908 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562235bc-8869-42a7-8482-97d5051d55e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:55.428120 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562235bc-8869-42a7-8482-97d5051d55e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:55.428553 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562235bc-8869-42a7-8482-97d5051d55e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:55.428992 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562235bc-8869-42a7-8482-97d5051d55e1 admin admin] PATH_INFO: `/v3/projects/84f2d705524640079dabd20866c104a4/users/ae30e6d162d34f7992418fd9744c8e98/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:55.448229 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562235bc-8869-42a7-8482-97d5051d55e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84f2d705524640079dabd20866c104a4, user_id=ae30e6d162d34f7992418fd9744c8e98, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:55.451219 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562235bc-8869-42a7-8482-97d5051d55e1 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:55.466945 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1402/2812] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:55 2022] PUT /identity/v3/projects/84f2d705524640079dabd20866c104a4/users/ae30e6d162d34f7992418fd9744c8e98/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:39:55.478817 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec24e04-722e-4e17-a53d-8beccd99027e None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:55.479216 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec24e04-722e-4e17-a53d-8beccd99027e None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:55.479582 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec24e04-722e-4e17-a53d-8beccd99027e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:55.510575 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-0ec24e04-722e-4e17-a53d-8beccd99027e None None] MFA Rules not processed for user `ae30e6d162d34f7992418fd9744c8e98`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:55.511957 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-0ec24e04-722e-4e17-a53d-8beccd99027e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:55.581328 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1411/2813] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:39:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:55.586208 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562235bc-8869-42a7-8482-97d5051d55e1 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:55.656847 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562235bc-8869-42a7-8482-97d5051d55e1 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:55.661829 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1134b7-2f9a-40b0-a80b-5fca3624ac66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:55.662695 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1134b7-2f9a-40b0-a80b-5fca3624ac66 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:55.663118 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1134b7-2f9a-40b0-a80b-5fca3624ac66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:55.663539 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1134b7-2f9a-40b0-a80b-5fca3624ac66 admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:55.664471 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1134b7-2f9a-40b0-a80b-5fca3624ac66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:55.666653 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1134b7-2f9a-40b0-a80b-5fca3624ac66 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:55.695650 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1403/2814] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:39:55 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:55.699753 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec24e04-722e-4e17-a53d-8beccd99027e None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:55.713029 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec24e04-722e-4e17-a53d-8beccd99027e None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:55.794920 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d10279-3251-457d-873c-df206e2d7537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:55.795713 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d10279-3251-457d-873c-df206e2d7537 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:55.797346 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d10279-3251-457d-873c-df206e2d7537 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:55.797631 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d10279-3251-457d-873c-df206e2d7537 admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:55.798320 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d10279-3251-457d-873c-df206e2d7537 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:55.800266 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d10279-3251-457d-873c-df206e2d7537 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:55.821981 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1412/2815] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:39:55 2022] POST /identity/v3/users => generated 299 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:39:55.826318 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1134b7-2f9a-40b0-a80b-5fca3624ac66 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:55.837582 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1134b7-2f9a-40b0-a80b-5fca3624ac66 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:55.848501 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f2a8b-92f6-4d22-abe3-ba9c079f5a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:55.849569 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f2a8b-92f6-4d22-abe3-ba9c079f5a93 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:55.850502 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f2a8b-92f6-4d22-abe3-ba9c079f5a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:55.850898 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f2a8b-92f6-4d22-abe3-ba9c079f5a93 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:55.851746 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f2a8b-92f6-4d22-abe3-ba9c079f5a93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:55.853499 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f2a8b-92f6-4d22-abe3-ba9c079f5a93 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:55.866532 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1404/2816] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:39:55.870976 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d10279-3251-457d-873c-df206e2d7537 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:55.882806 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d10279-3251-457d-873c-df206e2d7537 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:55.887950 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80289fb6-7c4d-4d4e-aa39-6b67dc327ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:55.888843 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80289fb6-7c4d-4d4e-aa39-6b67dc327ebc admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:55.889128 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80289fb6-7c4d-4d4e-aa39-6b67dc327ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:55.889378 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80289fb6-7c4d-4d4e-aa39-6b67dc327ebc admin admin] PATH_INFO: `/v3/projects/b1ff2fa65dda474f8bbcc91ddf9c1d13/users/95b84c8f0bd949b2aef49851cc9bd217/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:55.913420 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80289fb6-7c4d-4d4e-aa39-6b67dc327ebc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1ff2fa65dda474f8bbcc91ddf9c1d13, user_id=95b84c8f0bd949b2aef49851cc9bd217, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:55.916329 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80289fb6-7c4d-4d4e-aa39-6b67dc327ebc admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:55.940076 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1413/2817] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:55 2022] PUT /identity/v3/projects/b1ff2fa65dda474f8bbcc91ddf9c1d13/users/95b84c8f0bd949b2aef49851cc9bd217/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:55.941442 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f2a8b-92f6-4d22-abe3-ba9c079f5a93 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:55.952688 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f2a8b-92f6-4d22-abe3-ba9c079f5a93 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:56.034983 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35984078-d256-4e02-aa6f-b2fb08d80218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:56.035952 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35984078-d256-4e02-aa6f-b2fb08d80218 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:56.036240 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35984078-d256-4e02-aa6f-b2fb08d80218 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:56.037026 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35984078-d256-4e02-aa6f-b2fb08d80218 admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:56.037759 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35984078-d256-4e02-aa6f-b2fb08d80218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:56.040066 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35984078-d256-4e02-aa6f-b2fb08d80218 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:56.058542 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1405/2818] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:39:56.061996 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80289fb6-7c4d-4d4e-aa39-6b67dc327ebc admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:56.078188 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80289fb6-7c4d-4d4e-aa39-6b67dc327ebc admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:56.083725 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ba880-3431-4dfa-8ff2-a2f2ba139681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:56.084623 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ba880-3431-4dfa-8ff2-a2f2ba139681 admin admin] REQUEST_METHOD: `PUT` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:56.084910 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ba880-3431-4dfa-8ff2-a2f2ba139681 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:56.085181 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ba880-3431-4dfa-8ff2-a2f2ba139681 admin admin] PATH_INFO: `/v3/projects/b1ff2fa65dda474f8bbcc91ddf9c1d13/users/95b84c8f0bd949b2aef49851cc9bd217/roles/48e4608a7b3f4b87a20b10c4d1b45aa9` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:56.087253 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29ba880-3431-4dfa-8ff2-a2f2ba139681 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1ff2fa65dda474f8bbcc91ddf9c1d13, user_id=95b84c8f0bd949b2aef49851cc9bd217, role_id=48e4608a7b3f4b87a20b10c4d1b45aa9)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:56.089854 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29ba880-3431-4dfa-8ff2-a2f2ba139681 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:56.105135 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1414/2819] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:56 2022] PUT /identity/v3/projects/b1ff2fa65dda474f8bbcc91ddf9c1d13/users/95b84c8f0bd949b2aef49851cc9bd217/roles/48e4608a7b3f4b87a20b10c4d1b45aa9 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:56.116407 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde7a72-a30c-44e6-bfbe-cb47e9ad2972 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:56.121869 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde7a72-a30c-44e6-bfbe-cb47e9ad2972 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:56.122394 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde7a72-a30c-44e6-bfbe-cb47e9ad2972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:56.156898 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-2fde7a72-a30c-44e6-bfbe-cb47e9ad2972 None None] MFA Rules not processed for user `95b84c8f0bd949b2aef49851cc9bd217`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:56.158774 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-2fde7a72-a30c-44e6-bfbe-cb47e9ad2972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:56.235533 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1406/2820] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:39:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:56.247773 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ba880-3431-4dfa-8ff2-a2f2ba139681 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:56.250328 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-d29ba880-3431-4dfa-8ff2-a2f2ba139681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:56.344150 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ba880-3431-4dfa-8ff2-a2f2ba139681 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:56.348308 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aea343-ad5c-4a4f-b68c-94be4e6ead4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:56.349560 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aea343-ad5c-4a4f-b68c-94be4e6ead4a service cinder] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:56.350021 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aea343-ad5c-4a4f-b68c-94be4e6ead4a service cinder] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:56.350303 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aea343-ad5c-4a4f-b68c-94be4e6ead4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:56.360987 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aea343-ad5c-4a4f-b68c-94be4e6ead4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:56.362478 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aea343-ad5c-4a4f-b68c-94be4e6ead4a service cinder] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:56.373354 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1415/2821] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:56 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:39:57.073874 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde7a72-a30c-44e6-bfbe-cb47e9ad2972 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:57.141180 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde7a72-a30c-44e6-bfbe-cb47e9ad2972 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:57.145639 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03046f9e-52d9-4c3e-a7c7-5498dc429e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:57.146874 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03046f9e-52d9-4c3e-a7c7-5498dc429e76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:57.147335 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03046f9e-52d9-4c3e-a7c7-5498dc429e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:57.147768 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03046f9e-52d9-4c3e-a7c7-5498dc429e76 admin admin] PATH_INFO: `/v3/users/ae30e6d162d34f7992418fd9744c8e98` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:57.149146 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03046f9e-52d9-4c3e-a7c7-5498dc429e76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae30e6d162d34f7992418fd9744c8e98)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:57.151328 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03046f9e-52d9-4c3e-a7c7-5498dc429e76 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:57.208527 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-03046f9e-52d9-4c3e-a7c7-5498dc429e76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae30e6d162d34f7992418fd9744c8e98'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:57.209514 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-03046f9e-52d9-4c3e-a7c7-5498dc429e76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae30e6d162d34f7992418fd9744c8e98'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:57.226075 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-03046f9e-52d9-4c3e-a7c7-5498dc429e76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae30e6d162d34f7992418fd9744c8e98'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:57.237046 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-03046f9e-52d9-4c3e-a7c7-5498dc429e76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae30e6d162d34f7992418fd9744c8e98'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:57.244847 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-03046f9e-52d9-4c3e-a7c7-5498dc429e76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae30e6d162d34f7992418fd9744c8e98'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:57.252802 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1407/2822] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:39:57 2022] DELETE /identity/v3/users/ae30e6d162d34f7992418fd9744c8e98 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:57.257387 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cd780-ef0e-4056-8910-855f4ac45f66 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:57.257942 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cd780-ef0e-4056-8910-855f4ac45f66 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:57.257942 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cd780-ef0e-4056-8910-855f4ac45f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:57.278682 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-334cd780-ef0e-4056-8910-855f4ac45f66 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:57.279971 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-334cd780-ef0e-4056-8910-855f4ac45f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:57.362326 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1416/2823] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:39:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:57.377302 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03046f9e-52d9-4c3e-a7c7-5498dc429e76 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:57.378787 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-03046f9e-52d9-4c3e-a7c7-5498dc429e76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:57.462031 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03046f9e-52d9-4c3e-a7c7-5498dc429e76 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:57.466133 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d4f79-9386-4dfb-89fa-85fca9868e74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:57.467022 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d4f79-9386-4dfb-89fa-85fca9868e74 service neutron] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:57.467467 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d4f79-9386-4dfb-89fa-85fca9868e74 service neutron] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:57.467940 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d4f79-9386-4dfb-89fa-85fca9868e74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:57.482035 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6d4f79-9386-4dfb-89fa-85fca9868e74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:57.484807 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6d4f79-9386-4dfb-89fa-85fca9868e74 service neutron] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:57.501841 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1408/2824] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:39:58.003545 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334cd780-ef0e-4056-8910-855f4ac45f66 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:58.005465 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-334cd780-ef0e-4056-8910-855f4ac45f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:58.019580 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334cd780-ef0e-4056-8910-855f4ac45f66 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:58.025882 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f51492-eeb9-46e0-b696-26ca5866be31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:58.027166 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f51492-eeb9-46e0-b696-26ca5866be31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:58.027466 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f51492-eeb9-46e0-b696-26ca5866be31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:58.027740 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f51492-eeb9-46e0-b696-26ca5866be31 admin admin] PATH_INFO: `/v3/projects/84f2d705524640079dabd20866c104a4` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:58.029069 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f51492-eeb9-46e0-b696-26ca5866be31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84f2d705524640079dabd20866c104a4)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:58.032905 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f51492-eeb9-46e0-b696-26ca5866be31 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:58.081730 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-25f51492-eeb9-46e0-b696-26ca5866be31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84f2d705524640079dabd20866c104a4', 'request_id': 'req-25f51492-eeb9-46e0-b696-26ca5866be31'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:58.087052 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-25f51492-eeb9-46e0-b696-26ca5866be31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84f2d705524640079dabd20866c104a4', 'request_id': 'req-25f51492-eeb9-46e0-b696-26ca5866be31'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:58.093986 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-25f51492-eeb9-46e0-b696-26ca5866be31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84f2d705524640079dabd20866c104a4', 'request_id': 'req-25f51492-eeb9-46e0-b696-26ca5866be31'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:58.107366 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-25f51492-eeb9-46e0-b696-26ca5866be31 admin admin] The token cache is being invalidate because project 84f2d705524640079dabd20866c104a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:39:58.107651 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-25f51492-eeb9-46e0-b696-26ca5866be31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:58.108278 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-25f51492-eeb9-46e0-b696-26ca5866be31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:58.110854 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1417/2825] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:39:58 2022] DELETE /identity/v3/projects/84f2d705524640079dabd20866c104a4 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:58.114883 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d4f79-9386-4dfb-89fa-85fca9868e74 service neutron] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:58.125182 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d4f79-9386-4dfb-89fa-85fca9868e74 service neutron] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:58.195507 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b3020-aa70-4d79-b19a-56a0b4a38a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:58.196470 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b3020-aa70-4d79-b19a-56a0b4a38a2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:58.196845 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b3020-aa70-4d79-b19a-56a0b4a38a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:58.197214 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b3020-aa70-4d79-b19a-56a0b4a38a2b admin admin] PATH_INFO: `/v3/users/95b84c8f0bd949b2aef49851cc9bd217` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:58.198483 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568b3020-aa70-4d79-b19a-56a0b4a38a2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=95b84c8f0bd949b2aef49851cc9bd217)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:58.200529 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568b3020-aa70-4d79-b19a-56a0b4a38a2b admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:58.246561 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-568b3020-aa70-4d79-b19a-56a0b4a38a2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95b84c8f0bd949b2aef49851cc9bd217'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:58.247166 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-568b3020-aa70-4d79-b19a-56a0b4a38a2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95b84c8f0bd949b2aef49851cc9bd217'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:58.259280 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-568b3020-aa70-4d79-b19a-56a0b4a38a2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95b84c8f0bd949b2aef49851cc9bd217'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:58.267056 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-568b3020-aa70-4d79-b19a-56a0b4a38a2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95b84c8f0bd949b2aef49851cc9bd217'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:58.274928 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-568b3020-aa70-4d79-b19a-56a0b4a38a2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95b84c8f0bd949b2aef49851cc9bd217'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:58.281060 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1409/2826] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:39:58 2022] DELETE /identity/v3/users/95b84c8f0bd949b2aef49851cc9bd217 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:58.907196 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f51492-eeb9-46e0-b696-26ca5866be31 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:58.914157 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-25f51492-eeb9-46e0-b696-26ca5866be31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:58.950930 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f51492-eeb9-46e0-b696-26ca5866be31 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:59.008310 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59eeaa3-a021-4390-9435-42a7faf1210a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:59.009166 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59eeaa3-a021-4390-9435-42a7faf1210a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:59.009441 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59eeaa3-a021-4390-9435-42a7faf1210a admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:59.009706 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59eeaa3-a021-4390-9435-42a7faf1210a admin admin] PATH_INFO: `/v3/projects/b1ff2fa65dda474f8bbcc91ddf9c1d13` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:59.010926 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59eeaa3-a021-4390-9435-42a7faf1210a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1ff2fa65dda474f8bbcc91ddf9c1d13)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:59.012922 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59eeaa3-a021-4390-9435-42a7faf1210a admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:59.070269 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-f59eeaa3-a021-4390-9435-42a7faf1210a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1ff2fa65dda474f8bbcc91ddf9c1d13', 'request_id': 'req-f59eeaa3-a021-4390-9435-42a7faf1210a'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:59.075845 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-f59eeaa3-a021-4390-9435-42a7faf1210a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1ff2fa65dda474f8bbcc91ddf9c1d13', 'request_id': 'req-f59eeaa3-a021-4390-9435-42a7faf1210a'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:59.082141 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-f59eeaa3-a021-4390-9435-42a7faf1210a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1ff2fa65dda474f8bbcc91ddf9c1d13', 'request_id': 'req-f59eeaa3-a021-4390-9435-42a7faf1210a'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:59.094934 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-f59eeaa3-a021-4390-9435-42a7faf1210a admin admin] The token cache is being invalidate because project b1ff2fa65dda474f8bbcc91ddf9c1d13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:39:59.095246 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-f59eeaa3-a021-4390-9435-42a7faf1210a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:59.095823 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-f59eeaa3-a021-4390-9435-42a7faf1210a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:59.097478 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1418/2827] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:39:58 2022] DELETE /identity/v3/projects/b1ff2fa65dda474f8bbcc91ddf9c1d13 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:59.103003 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4ca72-a36c-4018-9d41-f27272acbe6b None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:59.103283 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4ca72-a36c-4018-9d41-f27272acbe6b None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:59.103551 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4ca72-a36c-4018-9d41-f27272acbe6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:59.121780 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-19d4ca72-a36c-4018-9d41-f27272acbe6b None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:59.123005 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-19d4ca72-a36c-4018-9d41-f27272acbe6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:59.185536 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1410/2828] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:59.194294 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983c102-b4bb-4a84-97a1-efdb5188b144 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:59.197380 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983c102-b4bb-4a84-97a1-efdb5188b144 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:59.197380 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983c102-b4bb-4a84-97a1-efdb5188b144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:59.226266 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-f983c102-b4bb-4a84-97a1-efdb5188b144 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:59.227825 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-f983c102-b4bb-4a84-97a1-efdb5188b144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:59.240795 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1419/2829] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:39:59.245149 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4ca72-a36c-4018-9d41-f27272acbe6b None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:59.257851 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4ca72-a36c-4018-9d41-f27272acbe6b None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:59.268184 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983c102-b4bb-4a84-97a1-efdb5188b144 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:59.270692 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-f983c102-b4bb-4a84-97a1-efdb5188b144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:59.276394 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca6d50-5528-43fd-b9d5-12608c79ca17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:59.277464 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca6d50-5528-43fd-b9d5-12608c79ca17 admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:59.277921 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca6d50-5528-43fd-b9d5-12608c79ca17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:59.278332 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca6d50-5528-43fd-b9d5-12608c79ca17 admin admin] PATH_INFO: `/v3/domains` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:59.279386 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca6d50-5528-43fd-b9d5-12608c79ca17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:39:59.279868 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca6d50-5528-43fd-b9d5-12608c79ca17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:59.282172 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca6d50-5528-43fd-b9d5-12608c79ca17 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:59.284688 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983c102-b4bb-4a84-97a1-efdb5188b144 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:59.292892 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a0cb9-3fc5-4c0e-b5cf-a5341a4779d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:59.293853 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a0cb9-3fc5-4c0e-b5cf-a5341a4779d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:59.294202 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a0cb9-3fc5-4c0e-b5cf-a5341a4779d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:59.294554 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a0cb9-3fc5-4c0e-b5cf-a5341a4779d5 admin admin] PATH_INFO: `/v3/users/5b21c9002601480eaabdbcb74d337f2a` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:59.295480 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1411/2830] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:39:59.299785 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a0cb9-3fc5-4c0e-b5cf-a5341a4779d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b21c9002601480eaabdbcb74d337f2a)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:59.300896 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca6d50-5528-43fd-b9d5-12608c79ca17 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:59.301932 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a0cb9-3fc5-4c0e-b5cf-a5341a4779d5 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:59.315045 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca6d50-5528-43fd-b9d5-12608c79ca17 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:59.320236 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f8567-0569-41a3-91d6-9d86581dadf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:59.320951 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f8567-0569-41a3-91d6-9d86581dadf6 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:59.321422 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f8567-0569-41a3-91d6-9d86581dadf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:59.321866 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f8567-0569-41a3-91d6-9d86581dadf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:59.322751 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363f8567-0569-41a3-91d6-9d86581dadf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:59.324635 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363f8567-0569-41a3-91d6-9d86581dadf6 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:59.361097 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1412/2831] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:39:59 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:39:59.362167 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-807a0cb9-3fc5-4c0e-b5cf-a5341a4779d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b21c9002601480eaabdbcb74d337f2a'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:59.363409 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f8567-0569-41a3-91d6-9d86581dadf6 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:59.376276 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-807a0cb9-3fc5-4c0e-b5cf-a5341a4779d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b21c9002601480eaabdbcb74d337f2a'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:59.377349 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-807a0cb9-3fc5-4c0e-b5cf-a5341a4779d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b21c9002601480eaabdbcb74d337f2a'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:59.396557 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-807a0cb9-3fc5-4c0e-b5cf-a5341a4779d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b21c9002601480eaabdbcb74d337f2a'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:59.408022 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-807a0cb9-3fc5-4c0e-b5cf-a5341a4779d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b21c9002601480eaabdbcb74d337f2a'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:59.422839 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1420/2832] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:39:59 2022] DELETE /identity/v3/users/5b21c9002601480eaabdbcb74d337f2a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:39:59.457589 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f8567-0569-41a3-91d6-9d86581dadf6 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:59.518194 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4e269-a3d7-437d-b9fd-77ed5b5047b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:59.518980 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4e269-a3d7-437d-b9fd-77ed5b5047b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:59.519254 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4e269-a3d7-437d-b9fd-77ed5b5047b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:59.519523 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4e269-a3d7-437d-b9fd-77ed5b5047b0 admin admin] PATH_INFO: `/v3/users` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:59.520199 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd4e269-a3d7-437d-b9fd-77ed5b5047b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:59.522094 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd4e269-a3d7-437d-b9fd-77ed5b5047b0 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:59.543730 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1413/2833] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:39:59 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:39:59.548998 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a0cb9-3fc5-4c0e-b5cf-a5341a4779d5 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:59.550479 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-807a0cb9-3fc5-4c0e-b5cf-a5341a4779d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:59.563472 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a0cb9-3fc5-4c0e-b5cf-a5341a4779d5 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:59.568050 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8935f04b-a797-46e4-8903-ffcc0f6296aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:59.568708 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935f04b-a797-46e4-8903-ffcc0f6296aa admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:59.568995 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935f04b-a797-46e4-8903-ffcc0f6296aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:59.569270 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935f04b-a797-46e4-8903-ffcc0f6296aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:59.569996 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8935f04b-a797-46e4-8903-ffcc0f6296aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:59.571606 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8935f04b-a797-46e4-8903-ffcc0f6296aa admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:59.581917 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1421/2834] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:59.585873 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4e269-a3d7-437d-b9fd-77ed5b5047b0 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:59.596252 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4e269-a3d7-437d-b9fd-77ed5b5047b0 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:59.601426 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f175a22-f317-4858-bc0c-6a54573f8e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:59.602208 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f175a22-f317-4858-bc0c-6a54573f8e5a admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:59.602500 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f175a22-f317-4858-bc0c-6a54573f8e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:59.602809 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f175a22-f317-4858-bc0c-6a54573f8e5a admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:59.603595 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f175a22-f317-4858-bc0c-6a54573f8e5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:59.604649 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8935f04b-a797-46e4-8903-ffcc0f6296aa admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:59.606395 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-8935f04b-a797-46e4-8903-ffcc0f6296aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:59.606745 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f175a22-f317-4858-bc0c-6a54573f8e5a admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:59.620880 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8935f04b-a797-46e4-8903-ffcc0f6296aa admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:59.627414 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b300dea-246d-45c4-b6bf-e0f59fd25408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:59.628275 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b300dea-246d-45c4-b6bf-e0f59fd25408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:59.628576 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b300dea-246d-45c4-b6bf-e0f59fd25408 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:59.628825 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b300dea-246d-45c4-b6bf-e0f59fd25408 admin admin] PATH_INFO: `/v3/projects/b55c46d5c05b41adb823461813ee1e5b` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:59.629325 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1414/2835] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:39:59.633080 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b300dea-246d-45c4-b6bf-e0f59fd25408 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b55c46d5c05b41adb823461813ee1e5b)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:59.633452 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f175a22-f317-4858-bc0c-6a54573f8e5a admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:59.635817 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b300dea-246d-45c4-b6bf-e0f59fd25408 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:59.644088 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f175a22-f317-4858-bc0c-6a54573f8e5a admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:59.649014 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c2f03-8d62-4e89-bb8e-6cbe31883e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:59.649958 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c2f03-8d62-4e89-bb8e-6cbe31883e55 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:59.650307 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c2f03-8d62-4e89-bb8e-6cbe31883e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:59.650686 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c2f03-8d62-4e89-bb8e-6cbe31883e55 admin admin] PATH_INFO: `/v3/projects/30ee860c9b4c435fa579c79622a96735/users/2a21b8572427406abd38b5af445937fc/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:59.666617 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c2f03-8d62-4e89-bb8e-6cbe31883e55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30ee860c9b4c435fa579c79622a96735, user_id=2a21b8572427406abd38b5af445937fc, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:59.669271 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c2f03-8d62-4e89-bb8e-6cbe31883e55 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:59.683103 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1415/2836] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:39:59 2022] PUT /identity/v3/projects/30ee860c9b4c435fa579c79622a96735/users/2a21b8572427406abd38b5af445937fc/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:39:59.683802 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-9b300dea-246d-45c4-b6bf-e0f59fd25408 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b55c46d5c05b41adb823461813ee1e5b', 'request_id': 'req-9b300dea-246d-45c4-b6bf-e0f59fd25408'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:59.691296 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-9b300dea-246d-45c4-b6bf-e0f59fd25408 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b55c46d5c05b41adb823461813ee1e5b', 'request_id': 'req-9b300dea-246d-45c4-b6bf-e0f59fd25408'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:59.693624 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b31d22-3beb-41af-9b9b-2f7f9f777753 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:59.693903 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b31d22-3beb-41af-9b9b-2f7f9f777753 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:59.694175 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b31d22-3beb-41af-9b9b-2f7f9f777753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:59.697879 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-9b300dea-246d-45c4-b6bf-e0f59fd25408 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b55c46d5c05b41adb823461813ee1e5b', 'request_id': 'req-9b300dea-246d-45c4-b6bf-e0f59fd25408'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:59.709690 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-9b300dea-246d-45c4-b6bf-e0f59fd25408 admin admin] The token cache is being invalidate because project b55c46d5c05b41adb823461813ee1e5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:39:59.709970 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-9b300dea-246d-45c4-b6bf-e0f59fd25408 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:59.710589 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-9b300dea-246d-45c4-b6bf-e0f59fd25408 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:59.712947 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1422/2837] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:39:59 2022] DELETE /identity/v3/projects/b55c46d5c05b41adb823461813ee1e5b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:39:59.716349 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b300dea-246d-45c4-b6bf-e0f59fd25408 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:59.718334 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-9b300dea-246d-45c4-b6bf-e0f59fd25408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:59.724242 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-10b31d22-3beb-41af-9b9b-2f7f9f777753 None None] MFA Rules not processed for user `2a21b8572427406abd38b5af445937fc`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:39:59.725439 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-10b31d22-3beb-41af-9b9b-2f7f9f777753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:59.788292 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b300dea-246d-45c4-b6bf-e0f59fd25408 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:59.799307 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1416/2838] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:39:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:39:59.813898 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b31d22-3beb-41af-9b9b-2f7f9f777753 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:59.817489 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-10b31d22-3beb-41af-9b9b-2f7f9f777753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:59.857644 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4860d-01c6-4482-a614-e464925c28f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:59.859436 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4860d-01c6-4482-a614-e464925c28f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:59.859754 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4860d-01c6-4482-a614-e464925c28f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:59.860050 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4860d-01c6-4482-a614-e464925c28f2 admin admin] PATH_INFO: `/v3/users/b30b85344f25478c895e766f33edaf21` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:59.861309 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae4860d-01c6-4482-a614-e464925c28f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b30b85344f25478c895e766f33edaf21)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:59.863368 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae4860d-01c6-4482-a614-e464925c28f2 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:59.886844 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b31d22-3beb-41af-9b9b-2f7f9f777753 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:39:59.891491 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92470dc-580d-4017-a4d4-488e16d21f86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:39:59.892247 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92470dc-580d-4017-a4d4-488e16d21f86 service cinder] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:39:59.892591 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92470dc-580d-4017-a4d4-488e16d21f86 service cinder] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:39:59.892960 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92470dc-580d-4017-a4d4-488e16d21f86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:39:59.903234 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92470dc-580d-4017-a4d4-488e16d21f86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:39:59.904970 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92470dc-580d-4017-a4d4-488e16d21f86 service cinder] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:39:59.913962 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-3ae4860d-01c6-4482-a614-e464925c28f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b30b85344f25478c895e766f33edaf21'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:59.915783 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1417/2839] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:39:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 10:39:59.923252 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-3ae4860d-01c6-4482-a614-e464925c28f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b30b85344f25478c895e766f33edaf21'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:59.924458 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-3ae4860d-01c6-4482-a614-e464925c28f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b30b85344f25478c895e766f33edaf21'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:59.937988 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92470dc-580d-4017-a4d4-488e16d21f86 service cinder] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:39:59.938188 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-3ae4860d-01c6-4482-a614-e464925c28f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b30b85344f25478c895e766f33edaf21'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:59.939458 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-d92470dc-580d-4017-a4d4-488e16d21f86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:39:59.945071 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-3ae4860d-01c6-4482-a614-e464925c28f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b30b85344f25478c895e766f33edaf21'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:39:59.951706 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1423/2840] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:39:59 2022] DELETE /identity/v3/users/b30b85344f25478c895e766f33edaf21 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:39:59.953870 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92470dc-580d-4017-a4d4-488e16d21f86 service cinder] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:40:00.019678 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fff683-7660-49bb-b9e3-a4651847c496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:40:00.020557 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fff683-7660-49bb-b9e3-a4651847c496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:00.021405 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fff683-7660-49bb-b9e3-a4651847c496 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:00.021718 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fff683-7660-49bb-b9e3-a4651847c496 admin admin] PATH_INFO: `/v3/users/2a21b8572427406abd38b5af445937fc` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:00.023030 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fff683-7660-49bb-b9e3-a4651847c496 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a21b8572427406abd38b5af445937fc)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:40:00.024993 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fff683-7660-49bb-b9e3-a4651847c496 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:40:00.079878 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-c6fff683-7660-49bb-b9e3-a4651847c496 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a21b8572427406abd38b5af445937fc'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:00.080593 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-c6fff683-7660-49bb-b9e3-a4651847c496 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a21b8572427406abd38b5af445937fc'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:00.094202 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-c6fff683-7660-49bb-b9e3-a4651847c496 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a21b8572427406abd38b5af445937fc'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:00.103771 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-c6fff683-7660-49bb-b9e3-a4651847c496 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a21b8572427406abd38b5af445937fc'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:00.111866 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-c6fff683-7660-49bb-b9e3-a4651847c496 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a21b8572427406abd38b5af445937fc'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:00.118636 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1418/2841] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:39:59 2022] DELETE /identity/v3/users/2a21b8572427406abd38b5af445937fc => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:40:00.123510 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a48179-8ac9-4a04-bd7c-87a04c40fe44 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:00.123805 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a48179-8ac9-4a04-bd7c-87a04c40fe44 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:00.124272 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a48179-8ac9-4a04-bd7c-87a04c40fe44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:00.143527 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-90a48179-8ac9-4a04-bd7c-87a04c40fe44 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:40:00.144794 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-90a48179-8ac9-4a04-bd7c-87a04c40fe44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:40:00.148127 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fff683-7660-49bb-b9e3-a4651847c496 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:40:00.150249 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-c6fff683-7660-49bb-b9e3-a4651847c496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:40:00.220274 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1424/2842] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:40:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:40:00.221179 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fff683-7660-49bb-b9e3-a4651847c496 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:40:00.226786 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8a62a-2ebf-4384-aa78-59f049b8301f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:40:00.227733 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8a62a-2ebf-4384-aa78-59f049b8301f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:00.228108 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8a62a-2ebf-4384-aa78-59f049b8301f admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:00.228448 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8a62a-2ebf-4384-aa78-59f049b8301f admin admin] PATH_INFO: `/v3/projects/3600bc55c6f84479864d57e9a8f9e0af` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:00.229696 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8a62a-2ebf-4384-aa78-59f049b8301f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3600bc55c6f84479864d57e9a8f9e0af)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:40:00.230329 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a48179-8ac9-4a04-bd7c-87a04c40fe44 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:40:00.231672 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8a62a-2ebf-4384-aa78-59f049b8301f admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:40:00.231803 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-90a48179-8ac9-4a04-bd7c-87a04c40fe44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:40:00.279886 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-34c8a62a-2ebf-4384-aa78-59f049b8301f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3600bc55c6f84479864d57e9a8f9e0af', 'request_id': 'req-34c8a62a-2ebf-4384-aa78-59f049b8301f'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:00.286714 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-34c8a62a-2ebf-4384-aa78-59f049b8301f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3600bc55c6f84479864d57e9a8f9e0af', 'request_id': 'req-34c8a62a-2ebf-4384-aa78-59f049b8301f'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:00.295253 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a48179-8ac9-4a04-bd7c-87a04c40fe44 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:40:00.295495 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-34c8a62a-2ebf-4384-aa78-59f049b8301f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3600bc55c6f84479864d57e9a8f9e0af', 'request_id': 'req-34c8a62a-2ebf-4384-aa78-59f049b8301f'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:00.314696 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-34c8a62a-2ebf-4384-aa78-59f049b8301f admin admin] The token cache is being invalidate because project 3600bc55c6f84479864d57e9a8f9e0af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:40:00.314982 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-34c8a62a-2ebf-4384-aa78-59f049b8301f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:00.316235 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-34c8a62a-2ebf-4384-aa78-59f049b8301f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:00.318412 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1419/2843] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:40:00 2022] DELETE /identity/v3/projects/3600bc55c6f84479864d57e9a8f9e0af => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:40:00.356518 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e95ce-ec9f-46de-a6a6-e5abc8affa66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:40:00.357184 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e95ce-ec9f-46de-a6a6-e5abc8affa66 service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:00.357467 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e95ce-ec9f-46de-a6a6-e5abc8affa66 service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:00.357739 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e95ce-ec9f-46de-a6a6-e5abc8affa66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:00.360573 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-aa8e95ce-ec9f-46de-a6a6-e5abc8affa66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:40:00.445211 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8e95ce-ec9f-46de-a6a6-e5abc8affa66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:40:00.448955 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8e95ce-ec9f-46de-a6a6-e5abc8affa66 service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:40:00.461750 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1425/2844] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:40:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:40:00.911439 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8a62a-2ebf-4384-aa78-59f049b8301f admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:40:00.912960 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-34c8a62a-2ebf-4384-aa78-59f049b8301f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:40:00.927561 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8a62a-2ebf-4384-aa78-59f049b8301f admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:40:00.932246 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca90d4a-5982-4dd1-bde9-67958af38409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:40:00.933091 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca90d4a-5982-4dd1-bde9-67958af38409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:00.933366 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca90d4a-5982-4dd1-bde9-67958af38409 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:00.933634 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca90d4a-5982-4dd1-bde9-67958af38409 admin admin] PATH_INFO: `/v3/projects/30ee860c9b4c435fa579c79622a96735` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:00.934919 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca90d4a-5982-4dd1-bde9-67958af38409 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30ee860c9b4c435fa579c79622a96735)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:40:00.937406 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca90d4a-5982-4dd1-bde9-67958af38409 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:40:00.982975 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-9ca90d4a-5982-4dd1-bde9-67958af38409 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30ee860c9b4c435fa579c79622a96735', 'request_id': 'req-9ca90d4a-5982-4dd1-bde9-67958af38409'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:00.989333 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-9ca90d4a-5982-4dd1-bde9-67958af38409 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30ee860c9b4c435fa579c79622a96735', 'request_id': 'req-9ca90d4a-5982-4dd1-bde9-67958af38409'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:00.995220 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-9ca90d4a-5982-4dd1-bde9-67958af38409 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30ee860c9b4c435fa579c79622a96735', 'request_id': 'req-9ca90d4a-5982-4dd1-bde9-67958af38409'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:01.006983 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-9ca90d4a-5982-4dd1-bde9-67958af38409 admin admin] The token cache is being invalidate because project 30ee860c9b4c435fa579c79622a96735 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:40:01.007263 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-9ca90d4a-5982-4dd1-bde9-67958af38409 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:01.007890 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-9ca90d4a-5982-4dd1-bde9-67958af38409 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:01.009370 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1420/2845] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:40:00 2022] DELETE /identity/v3/projects/30ee860c9b4c435fa579c79622a96735 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:40:01.014277 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4391ba-1558-45de-88b2-b98db39025eb None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:01.014794 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4391ba-1558-45de-88b2-b98db39025eb None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:01.014981 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4391ba-1558-45de-88b2-b98db39025eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:01.032985 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-1b4391ba-1558-45de-88b2-b98db39025eb None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:40:01.034179 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-1b4391ba-1558-45de-88b2-b98db39025eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:40:01.091770 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1426/2846] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 10:40:01.150519 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c59834-0563-4f65-b93c-acde04aea9cf None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:01.151121 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c59834-0563-4f65-b93c-acde04aea9cf None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:01.151121 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c59834-0563-4f65-b93c-acde04aea9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:01.170002 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-86c59834-0563-4f65-b93c-acde04aea9cf None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:40:01.172011 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-86c59834-0563-4f65-b93c-acde04aea9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:40:01.179786 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1421/2847] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:40:01.183933 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4391ba-1558-45de-88b2-b98db39025eb None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:40:01.193587 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4391ba-1558-45de-88b2-b98db39025eb None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:40:01.198143 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cee0d8-8fc2-4ee8-a6fd-9e93fbc99d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:40:01.198822 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cee0d8-8fc2-4ee8-a6fd-9e93fbc99d0d admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:01.199105 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cee0d8-8fc2-4ee8-a6fd-9e93fbc99d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:01.199380 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cee0d8-8fc2-4ee8-a6fd-9e93fbc99d0d admin admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:01.200099 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cee0d8-8fc2-4ee8-a6fd-9e93fbc99d0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:40:01.200407 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cee0d8-8fc2-4ee8-a6fd-9e93fbc99d0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:40:01.201988 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cee0d8-8fc2-4ee8-a6fd-9e93fbc99d0d admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:40:01.213495 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1427/2848] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:40:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:40:01.218207 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c59834-0563-4f65-b93c-acde04aea9cf None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:40:01.227647 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c59834-0563-4f65-b93c-acde04aea9cf None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:40:01.232285 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b8b576-6058-4157-bbf8-85d4babc050b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:40:01.232920 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b8b576-6058-4157-bbf8-85d4babc050b admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:01.233203 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b8b576-6058-4157-bbf8-85d4babc050b admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:01.234272 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b8b576-6058-4157-bbf8-85d4babc050b admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:01.235140 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b8b576-6058-4157-bbf8-85d4babc050b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:40:01.237024 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b8b576-6058-4157-bbf8-85d4babc050b admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:40:01.262218 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1422/2849] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:40:01 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:40:01.266986 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cee0d8-8fc2-4ee8-a6fd-9e93fbc99d0d admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:40:01.276700 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cee0d8-8fc2-4ee8-a6fd-9e93fbc99d0d admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:40:01.329765 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e69ec4-ffa5-4596-bb0f-e16ceedb984d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:40:01.330419 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e69ec4-ffa5-4596-bb0f-e16ceedb984d admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:01.330730 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e69ec4-ffa5-4596-bb0f-e16ceedb984d admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:01.331007 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e69ec4-ffa5-4596-bb0f-e16ceedb984d admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:01.331687 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e69ec4-ffa5-4596-bb0f-e16ceedb984d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:40:01.333658 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e69ec4-ffa5-4596-bb0f-e16ceedb984d admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:40:01.353688 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1428/2850] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:40:01 2022] POST /identity/v3/users => generated 286 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 10:40:01.357763 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b8b576-6058-4157-bbf8-85d4babc050b admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:40:01.367829 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b8b576-6058-4157-bbf8-85d4babc050b admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:40:01.372467 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7d202-c669-4b03-a96e-8821e5d890cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:40:01.373112 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7d202-c669-4b03-a96e-8821e5d890cd admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:01.373392 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7d202-c669-4b03-a96e-8821e5d890cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:01.373667 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7d202-c669-4b03-a96e-8821e5d890cd admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:01.374387 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7d202-c669-4b03-a96e-8821e5d890cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:40:01.375998 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7d202-c669-4b03-a96e-8821e5d890cd admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:40:01.386068 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1423/2851] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:40:01.390349 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e69ec4-ffa5-4596-bb0f-e16ceedb984d admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:40:01.399971 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e69ec4-ffa5-4596-bb0f-e16ceedb984d admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:40:01.404474 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3615bb-f071-4798-8047-a07a726d243c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:40:01.405105 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3615bb-f071-4798-8047-a07a726d243c admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:01.405966 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3615bb-f071-4798-8047-a07a726d243c admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:01.406242 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3615bb-f071-4798-8047-a07a726d243c admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:01.406982 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3615bb-f071-4798-8047-a07a726d243c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:40:01.408533 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3615bb-f071-4798-8047-a07a726d243c admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:40:01.418057 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1429/2852] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 10:40:01.422167 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7d202-c669-4b03-a96e-8821e5d890cd admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:40:01.431718 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7d202-c669-4b03-a96e-8821e5d890cd admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:40:01.436510 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf507f5d-989a-4e58-94c7-3d5be3161135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:40:01.437432 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf507f5d-989a-4e58-94c7-3d5be3161135 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:01.437711 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf507f5d-989a-4e58-94c7-3d5be3161135 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:01.437981 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf507f5d-989a-4e58-94c7-3d5be3161135 admin admin] PATH_INFO: `/v3/projects/3c39cc19817d415a95948635f7511889/users/ea163b1e8be5462db046f789ca8365f8/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:01.454524 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf507f5d-989a-4e58-94c7-3d5be3161135 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c39cc19817d415a95948635f7511889, user_id=ea163b1e8be5462db046f789ca8365f8, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:40:01.457170 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf507f5d-989a-4e58-94c7-3d5be3161135 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:40:01.469956 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1424/2853] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:40:01 2022] PUT /identity/v3/projects/3c39cc19817d415a95948635f7511889/users/ea163b1e8be5462db046f789ca8365f8/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:40:01.480499 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1950c3-88da-4f6a-8866-4f4f78666617 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:01.480788 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1950c3-88da-4f6a-8866-4f4f78666617 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:01.481061 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1950c3-88da-4f6a-8866-4f4f78666617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:01.506368 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-2b1950c3-88da-4f6a-8866-4f4f78666617 None None] MFA Rules not processed for user `ea163b1e8be5462db046f789ca8365f8`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:40:01.507601 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-2b1950c3-88da-4f6a-8866-4f4f78666617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:40:01.567669 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1430/2854] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:40:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:40:01.579164 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf507f5d-989a-4e58-94c7-3d5be3161135 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:40:01.580834 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-bf507f5d-989a-4e58-94c7-3d5be3161135 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:40:01.635589 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf507f5d-989a-4e58-94c7-3d5be3161135 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:40:01.639179 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59108542-1ad5-4739-a2a9-966195b7e60e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:40:01.640393 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59108542-1ad5-4739-a2a9-966195b7e60e service cinder] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:01.640734 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59108542-1ad5-4739-a2a9-966195b7e60e service cinder] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:01.641012 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59108542-1ad5-4739-a2a9-966195b7e60e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:01.649084 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59108542-1ad5-4739-a2a9-966195b7e60e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:40:01.650529 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59108542-1ad5-4739-a2a9-966195b7e60e service cinder] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:40:01.659225 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1425/2855] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:40:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:40:01.678810 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1950c3-88da-4f6a-8866-4f4f78666617 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:40:01.740102 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1950c3-88da-4f6a-8866-4f4f78666617 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:40:01.745209 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de0875-a6e6-4116-a46b-b6832695e052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:40:01.746162 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de0875-a6e6-4116-a46b-b6832695e052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:01.746343 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de0875-a6e6-4116-a46b-b6832695e052 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:01.746641 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de0875-a6e6-4116-a46b-b6832695e052 admin admin] PATH_INFO: `/v3/users/ea163b1e8be5462db046f789ca8365f8` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:01.747851 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de0875-a6e6-4116-a46b-b6832695e052 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea163b1e8be5462db046f789ca8365f8)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:40:01.750385 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de0875-a6e6-4116-a46b-b6832695e052 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:40:01.813177 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-96de0875-a6e6-4116-a46b-b6832695e052 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea163b1e8be5462db046f789ca8365f8'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:01.822643 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-96de0875-a6e6-4116-a46b-b6832695e052 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea163b1e8be5462db046f789ca8365f8'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:01.823342 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-96de0875-a6e6-4116-a46b-b6832695e052 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea163b1e8be5462db046f789ca8365f8'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:01.836662 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-96de0875-a6e6-4116-a46b-b6832695e052 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea163b1e8be5462db046f789ca8365f8'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:01.847315 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-96de0875-a6e6-4116-a46b-b6832695e052 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea163b1e8be5462db046f789ca8365f8'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:01.851336 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1431/2856] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:40:01 2022] DELETE /identity/v3/users/ea163b1e8be5462db046f789ca8365f8 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:40:01.855171 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32612104-7deb-4773-a4f3-711d97116891 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:01.855460 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32612104-7deb-4773-a4f3-711d97116891 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:01.855798 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32612104-7deb-4773-a4f3-711d97116891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:01.874963 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-32612104-7deb-4773-a4f3-711d97116891 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:40:01.876181 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-32612104-7deb-4773-a4f3-711d97116891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:40:01.942836 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1426/2857] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:40:01.951335 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de0875-a6e6-4116-a46b-b6832695e052 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:40:01.954199 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-96de0875-a6e6-4116-a46b-b6832695e052 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:40:02.027700 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de0875-a6e6-4116-a46b-b6832695e052 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:40:02.032017 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4fee65-ae2d-4494-bd71-df6763d4a675 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:40:02.032957 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fee65-ae2d-4494-bd71-df6763d4a675 service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:02.033473 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fee65-ae2d-4494-bd71-df6763d4a675 service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:02.033947 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fee65-ae2d-4494-bd71-df6763d4a675 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:02.048938 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4fee65-ae2d-4494-bd71-df6763d4a675 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:40:02.050384 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4fee65-ae2d-4494-bd71-df6763d4a675 service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:40:02.060850 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1432/2858] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:40:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:40:02.346549 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32612104-7deb-4773-a4f3-711d97116891 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:40:02.348601 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-32612104-7deb-4773-a4f3-711d97116891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:40:02.363445 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32612104-7deb-4773-a4f3-711d97116891 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:40:02.369178 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7983d0f0-c2cb-4d2b-93c0-f7007a2da982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:40:02.370122 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983d0f0-c2cb-4d2b-93c0-f7007a2da982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:02.370459 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983d0f0-c2cb-4d2b-93c0-f7007a2da982 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:02.371099 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983d0f0-c2cb-4d2b-93c0-f7007a2da982 admin admin] PATH_INFO: `/v3/projects/3c39cc19817d415a95948635f7511889` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:02.373009 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7983d0f0-c2cb-4d2b-93c0-f7007a2da982 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c39cc19817d415a95948635f7511889)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:40:02.375690 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7983d0f0-c2cb-4d2b-93c0-f7007a2da982 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:40:02.427517 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-7983d0f0-c2cb-4d2b-93c0-f7007a2da982 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c39cc19817d415a95948635f7511889', 'request_id': 'req-7983d0f0-c2cb-4d2b-93c0-f7007a2da982'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:02.433301 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-7983d0f0-c2cb-4d2b-93c0-f7007a2da982 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c39cc19817d415a95948635f7511889', 'request_id': 'req-7983d0f0-c2cb-4d2b-93c0-f7007a2da982'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:02.440317 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-7983d0f0-c2cb-4d2b-93c0-f7007a2da982 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c39cc19817d415a95948635f7511889', 'request_id': 'req-7983d0f0-c2cb-4d2b-93c0-f7007a2da982'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:02.453819 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-7983d0f0-c2cb-4d2b-93c0-f7007a2da982 admin admin] The token cache is being invalidate because project 3c39cc19817d415a95948635f7511889 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:40:02.454034 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-7983d0f0-c2cb-4d2b-93c0-f7007a2da982 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:02.455328 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-7983d0f0-c2cb-4d2b-93c0-f7007a2da982 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:02.456859 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1427/2859] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:40:02 2022] DELETE /identity/v3/projects/3c39cc19817d415a95948635f7511889 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:40:02.461781 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53cf18-a557-4e4a-8d64-cb881f0b95a9 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:02.462071 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53cf18-a557-4e4a-8d64-cb881f0b95a9 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:02.462345 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53cf18-a557-4e4a-8d64-cb881f0b95a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:02.479751 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-7d53cf18-a557-4e4a-8d64-cb881f0b95a9 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:40:02.480953 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-7d53cf18-a557-4e4a-8d64-cb881f0b95a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:40:02.538390 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1433/2860] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:40:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:40:02.546302 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14fc92-b442-4af5-90b8-a600f7f41ef9 None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:02.546854 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14fc92-b442-4af5-90b8-a600f7f41ef9 None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:02.547137 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14fc92-b442-4af5-90b8-a600f7f41ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:02.565853 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-2b14fc92-b442-4af5-90b8-a600f7f41ef9 None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:40:02.567120 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-2b14fc92-b442-4af5-90b8-a600f7f41ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:40:02.575285 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1428/2861] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:40:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:40:02.580226 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53cf18-a557-4e4a-8d64-cb881f0b95a9 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:40:02.589881 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53cf18-a557-4e4a-8d64-cb881f0b95a9 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:40:02.594616 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c83cf-fca2-4344-bb17-641a62dccc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:40:02.595286 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c83cf-fca2-4344-bb17-641a62dccc28 admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:02.595569 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c83cf-fca2-4344-bb17-641a62dccc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:02.595844 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c83cf-fca2-4344-bb17-641a62dccc28 admin admin] PATH_INFO: `/v3/domains` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:02.596560 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572c83cf-fca2-4344-bb17-641a62dccc28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 10:40:02.596867 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572c83cf-fca2-4344-bb17-641a62dccc28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:40:02.598457 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572c83cf-fca2-4344-bb17-641a62dccc28 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:40:02.610122 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1434/2862] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Feb 28 10:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 10:40:02.614470 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b14fc92-b442-4af5-90b8-a600f7f41ef9 None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:40:02.623777 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b14fc92-b442-4af5-90b8-a600f7f41ef9 None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:40:02.629810 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa0337-2fa4-4595-afe6-426b242975ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:40:02.630456 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa0337-2fa4-4595-afe6-426b242975ce admin admin] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:02.630765 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa0337-2fa4-4595-afe6-426b242975ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:02.631039 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa0337-2fa4-4595-afe6-426b242975ce admin admin] PATH_INFO: `/v3/projects` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:02.631707 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa0337-2fa4-4595-afe6-426b242975ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:40:02.634180 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa0337-2fa4-4595-afe6-426b242975ce admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:40:02.659780 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1429/2863] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Feb 28 10:40:02 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:40:02.663936 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c83cf-fca2-4344-bb17-641a62dccc28 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:40:02.673990 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c83cf-fca2-4344-bb17-641a62dccc28 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:40:02.730743 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ab502-af21-4f19-ae43-4bf98871eba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:40:02.731335 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ab502-af21-4f19-ae43-4bf98871eba3 admin admin] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:02.731617 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ab502-af21-4f19-ae43-4bf98871eba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:02.731888 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ab502-af21-4f19-ae43-4bf98871eba3 admin admin] PATH_INFO: `/v3/users` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:02.732570 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ab502-af21-4f19-ae43-4bf98871eba3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:40:02.734696 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ab502-af21-4f19-ae43-4bf98871eba3 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:40:02.754008 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1435/2864] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Feb 28 10:40:02 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 10:40:02.758137 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa0337-2fa4-4595-afe6-426b242975ce admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:40:02.769026 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa0337-2fa4-4595-afe6-426b242975ce admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:40:02.773566 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ade4a-52cc-494d-8349-ea527b579a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:40:02.774209 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ade4a-52cc-494d-8349-ea527b579a9b admin admin] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:02.774485 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ade4a-52cc-494d-8349-ea527b579a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:02.774790 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ade4a-52cc-494d-8349-ea527b579a9b admin admin] PATH_INFO: `/v3/roles` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:02.775495 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4ade4a-52cc-494d-8349-ea527b579a9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:40:02.777087 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4ade4a-52cc-494d-8349-ea527b579a9b admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:40:02.788577 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1430/2865] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:40:02.792646 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ab502-af21-4f19-ae43-4bf98871eba3 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:40:02.803325 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ab502-af21-4f19-ae43-4bf98871eba3 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:40:02.807916 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4315cd-9e2d-4b4d-8fc2-60f835e4aa4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:40:02.808550 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4315cd-9e2d-4b4d-8fc2-60f835e4aa4e admin admin] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:02.808828 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4315cd-9e2d-4b4d-8fc2-60f835e4aa4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:02.809104 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4315cd-9e2d-4b4d-8fc2-60f835e4aa4e admin admin] PATH_INFO: `/v3/roles` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:02.809809 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4315cd-9e2d-4b4d-8fc2-60f835e4aa4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:40:02.811403 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4315cd-9e2d-4b4d-8fc2-60f835e4aa4e admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:40:02.823513 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1436/2866] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Feb 28 10:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 10:40:02.827634 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ade4a-52cc-494d-8349-ea527b579a9b admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:40:02.837347 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ade4a-52cc-494d-8349-ea527b579a9b admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:40:02.842060 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f702e5-00d4-4aad-8859-b1e0dee90358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:40:02.843017 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f702e5-00d4-4aad-8859-b1e0dee90358 admin admin] REQUEST_METHOD: `PUT` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:02.843441 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f702e5-00d4-4aad-8859-b1e0dee90358 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:02.843719 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f702e5-00d4-4aad-8859-b1e0dee90358 admin admin] PATH_INFO: `/v3/projects/93b729e9b4ea4e78ac212b3e61f20524/users/98599012b27c4e90a1f04aaf3a44d2af/roles/1c79fcc5aeef4042aa382ec20f77f7b9` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:02.859537 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f702e5-00d4-4aad-8859-b1e0dee90358 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93b729e9b4ea4e78ac212b3e61f20524, user_id=98599012b27c4e90a1f04aaf3a44d2af, role_id=1c79fcc5aeef4042aa382ec20f77f7b9)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:40:02.862019 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f702e5-00d4-4aad-8859-b1e0dee90358 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:40:02.875080 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1431/2867] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Feb 28 10:40:02 2022] PUT /identity/v3/projects/93b729e9b4ea4e78ac212b3e61f20524/users/98599012b27c4e90a1f04aaf3a44d2af/roles/1c79fcc5aeef4042aa382ec20f77f7b9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:40:02.886405 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cca41-42d7-4563-89b5-6785feade076 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:02.886756 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cca41-42d7-4563-89b5-6785feade076 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:02.887033 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cca41-42d7-4563-89b5-6785feade076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:02.913242 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-1c2cca41-42d7-4563-89b5-6785feade076 None None] MFA Rules not processed for user `98599012b27c4e90a1f04aaf3a44d2af`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:40:02.914427 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-1c2cca41-42d7-4563-89b5-6785feade076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:40:02.977401 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1437/2868] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:40:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:40:02.988560 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f702e5-00d4-4aad-8859-b1e0dee90358 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:40:02.990273 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-17f702e5-00d4-4aad-8859-b1e0dee90358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:40:03.047461 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f702e5-00d4-4aad-8859-b1e0dee90358 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:40:03.051277 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054556bb-493e-42e1-8094-0df00479b69f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:40:03.051939 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054556bb-493e-42e1-8094-0df00479b69f service cinder] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:03.052221 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054556bb-493e-42e1-8094-0df00479b69f service cinder] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:03.052492 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054556bb-493e-42e1-8094-0df00479b69f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:03.063073 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054556bb-493e-42e1-8094-0df00479b69f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:40:03.064876 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054556bb-493e-42e1-8094-0df00479b69f service cinder] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:40:03.075441 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1432/2869] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:40:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:40:10.488396 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2cca41-42d7-4563-89b5-6785feade076 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:40:10.553106 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2cca41-42d7-4563-89b5-6785feade076 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:40:10.557850 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e30ec-f3bc-45ac-9093-c5e7b81caf3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:40:10.558794 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e30ec-f3bc-45ac-9093-c5e7b81caf3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:10.559075 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e30ec-f3bc-45ac-9093-c5e7b81caf3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:10.559350 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e30ec-f3bc-45ac-9093-c5e7b81caf3d admin admin] PATH_INFO: `/v3/users/98599012b27c4e90a1f04aaf3a44d2af` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:10.560568 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e30ec-f3bc-45ac-9093-c5e7b81caf3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=98599012b27c4e90a1f04aaf3a44d2af)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:40:10.562921 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e30ec-f3bc-45ac-9093-c5e7b81caf3d admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:40:10.615046 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-4e7e30ec-f3bc-45ac-9093-c5e7b81caf3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98599012b27c4e90a1f04aaf3a44d2af'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:10.622769 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-4e7e30ec-f3bc-45ac-9093-c5e7b81caf3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98599012b27c4e90a1f04aaf3a44d2af'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:10.623426 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-4e7e30ec-f3bc-45ac-9093-c5e7b81caf3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98599012b27c4e90a1f04aaf3a44d2af'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:10.637018 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-4e7e30ec-f3bc-45ac-9093-c5e7b81caf3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98599012b27c4e90a1f04aaf3a44d2af'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:10.645005 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-4e7e30ec-f3bc-45ac-9093-c5e7b81caf3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98599012b27c4e90a1f04aaf3a44d2af'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:10.651634 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1438/2870] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:40:10 2022] DELETE /identity/v3/users/98599012b27c4e90a1f04aaf3a44d2af => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:40:10.655972 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ed021-fcb6-4e70-968c-0e142d59145e None None] REQUEST_METHOD: `POST` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:10.656564 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ed021-fcb6-4e70-968c-0e142d59145e None None] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:10.656564 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ed021-fcb6-4e70-968c-0e142d59145e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:10.674284 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.auth.core [None req-666ed021-fcb6-4e70-968c-0e142d59145e None None] MFA Rules not processed for user `6ceda84916c547c4bc3f54154671eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=79319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:40:10.675561 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-666ed021-fcb6-4e70-968c-0e142d59145e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:40:10.757600 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1433/2871] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:40:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:40:10.773945 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e30ec-f3bc-45ac-9093-c5e7b81caf3d admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:40:10.775455 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-4e7e30ec-f3bc-45ac-9093-c5e7b81caf3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:40:10.855554 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e30ec-f3bc-45ac-9093-c5e7b81caf3d admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:40:10.864544 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e71c92a-019a-4b25-ba0a-e1f29c3f76bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:40:10.865227 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71c92a-019a-4b25-ba0a-e1f29c3f76bb service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:10.865509 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71c92a-019a-4b25-ba0a-e1f29c3f76bb service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:10.865786 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71c92a-019a-4b25-ba0a-e1f29c3f76bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:10.876337 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e71c92a-019a-4b25-ba0a-e1f29c3f76bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:40:10.877789 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e71c92a-019a-4b25-ba0a-e1f29c3f76bb service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:40:10.894008 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1439/2872] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:40:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:40:11.352490 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ed021-fcb6-4e70-968c-0e142d59145e None None] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:40:11.353942 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-666ed021-fcb6-4e70-968c-0e142d59145e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:40:11.367322 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ed021-fcb6-4e70-968c-0e142d59145e None None] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:40:11.379812 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1052a1d3-db36-40c3-8be8-e0079efdf162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:40:11.380687 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052a1d3-db36-40c3-8be8-e0079efdf162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:11.380961 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052a1d3-db36-40c3-8be8-e0079efdf162 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:11.381233 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052a1d3-db36-40c3-8be8-e0079efdf162 admin admin] PATH_INFO: `/v3/projects/93b729e9b4ea4e78ac212b3e61f20524` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:11.382632 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1052a1d3-db36-40c3-8be8-e0079efdf162 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93b729e9b4ea4e78ac212b3e61f20524)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:40:11.384547 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1052a1d3-db36-40c3-8be8-e0079efdf162 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:40:11.438037 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-1052a1d3-db36-40c3-8be8-e0079efdf162 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93b729e9b4ea4e78ac212b3e61f20524', 'request_id': 'req-1052a1d3-db36-40c3-8be8-e0079efdf162'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:11.444645 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-1052a1d3-db36-40c3-8be8-e0079efdf162 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93b729e9b4ea4e78ac212b3e61f20524', 'request_id': 'req-1052a1d3-db36-40c3-8be8-e0079efdf162'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:11.451999 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-1052a1d3-db36-40c3-8be8-e0079efdf162 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93b729e9b4ea4e78ac212b3e61f20524', 'request_id': 'req-1052a1d3-db36-40c3-8be8-e0079efdf162'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:11.466451 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-1052a1d3-db36-40c3-8be8-e0079efdf162 admin admin] The token cache is being invalidate because project 93b729e9b4ea4e78ac212b3e61f20524 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:40:11.466901 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-1052a1d3-db36-40c3-8be8-e0079efdf162 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:11.467622 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-1052a1d3-db36-40c3-8be8-e0079efdf162 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:40:11.469875 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1434/2873] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:40:11 2022] DELETE /identity/v3/projects/93b729e9b4ea4e78ac212b3e61f20524 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:40:55.142898 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7ac51-f167-4fb5-b584-8ca7bd868853 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:40:55.143446 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7ac51-f167-4fb5-b584-8ca7bd868853 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:40:55.143446 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7ac51-f167-4fb5-b584-8ca7bd868853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:40:55.160503 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-d9a7ac51-f167-4fb5-b584-8ca7bd868853 None None] MFA Rules not processed for user `d7520dc4fad24983a3ec9b1a205a3ef2`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:40:55.161697 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-d9a7ac51-f167-4fb5-b584-8ca7bd868853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:40:55.212879 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1440/2874] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:40:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:41:49.909016 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1052a1d3-db36-40c3-8be8-e0079efdf162 admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:49.910592 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-1052a1d3-db36-40c3-8be8-e0079efdf162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:49.977479 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1052a1d3-db36-40c3-8be8-e0079efdf162 admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:49.983011 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd01c8b-b8bc-46d3-b56e-aae0a1b9a54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:49.983867 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd01c8b-b8bc-46d3-b56e-aae0a1b9a54c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:49.984172 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd01c8b-b8bc-46d3-b56e-aae0a1b9a54c admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:49.984443 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd01c8b-b8bc-46d3-b56e-aae0a1b9a54c admin admin] PATH_INFO: `/v3/users/d7520dc4fad24983a3ec9b1a205a3ef2` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:49.985651 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd01c8b-b8bc-46d3-b56e-aae0a1b9a54c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7520dc4fad24983a3ec9b1a205a3ef2)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:49.987600 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd01c8b-b8bc-46d3-b56e-aae0a1b9a54c admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:50.031558 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-ebd01c8b-b8bc-46d3-b56e-aae0a1b9a54c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7520dc4fad24983a3ec9b1a205a3ef2'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:50.032191 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-ebd01c8b-b8bc-46d3-b56e-aae0a1b9a54c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7520dc4fad24983a3ec9b1a205a3ef2'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:50.044949 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-ebd01c8b-b8bc-46d3-b56e-aae0a1b9a54c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7520dc4fad24983a3ec9b1a205a3ef2'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:50.051956 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-ebd01c8b-b8bc-46d3-b56e-aae0a1b9a54c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7520dc4fad24983a3ec9b1a205a3ef2'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:50.058633 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-ebd01c8b-b8bc-46d3-b56e-aae0a1b9a54c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7520dc4fad24983a3ec9b1a205a3ef2'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:50.065457 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1435/2875] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:41:49 2022] DELETE /identity/v3/users/d7520dc4fad24983a3ec9b1a205a3ef2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:41:50.234845 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7ac51-f167-4fb5-b584-8ca7bd868853 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:50.249592 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7ac51-f167-4fb5-b584-8ca7bd868853 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:50.316221 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a9b72-b651-43d3-89a8-dec995f516a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:50.317075 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a9b72-b651-43d3-89a8-dec995f516a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:50.317387 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a9b72-b651-43d3-89a8-dec995f516a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:50.317942 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a9b72-b651-43d3-89a8-dec995f516a3 admin admin] PATH_INFO: `/v3/projects/89ef7e55ea524b1c979f0dbad2a150df` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:50.319271 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a9b72-b651-43d3-89a8-dec995f516a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89ef7e55ea524b1c979f0dbad2a150df)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:50.321206 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a9b72-b651-43d3-89a8-dec995f516a3 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:50.372678 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-181a9b72-b651-43d3-89a8-dec995f516a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89ef7e55ea524b1c979f0dbad2a150df', 'request_id': 'req-181a9b72-b651-43d3-89a8-dec995f516a3'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:50.379395 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-181a9b72-b651-43d3-89a8-dec995f516a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89ef7e55ea524b1c979f0dbad2a150df', 'request_id': 'req-181a9b72-b651-43d3-89a8-dec995f516a3'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:50.387166 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-181a9b72-b651-43d3-89a8-dec995f516a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89ef7e55ea524b1c979f0dbad2a150df', 'request_id': 'req-181a9b72-b651-43d3-89a8-dec995f516a3'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:50.403430 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-181a9b72-b651-43d3-89a8-dec995f516a3 admin admin] The token cache is being invalidate because project 89ef7e55ea524b1c979f0dbad2a150df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:41:50.403829 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-181a9b72-b651-43d3-89a8-dec995f516a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:50.404502 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-181a9b72-b651-43d3-89a8-dec995f516a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:41:50.406036 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1441/2876] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:41:50 2022] DELETE /identity/v3/projects/89ef7e55ea524b1c979f0dbad2a150df => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 10:41:55.028398 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd01c8b-b8bc-46d3-b56e-aae0a1b9a54c admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:55.029820 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-ebd01c8b-b8bc-46d3-b56e-aae0a1b9a54c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:55.084626 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd01c8b-b8bc-46d3-b56e-aae0a1b9a54c admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:55.131516 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6588de-2d25-438f-b1d5-7ccd1e6dbe45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:55.132196 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6588de-2d25-438f-b1d5-7ccd1e6dbe45 service cinder] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:55.132472 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6588de-2d25-438f-b1d5-7ccd1e6dbe45 service cinder] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:55.132773 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6588de-2d25-438f-b1d5-7ccd1e6dbe45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:55.134687 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-0e6588de-2d25-438f-b1d5-7ccd1e6dbe45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:55.192844 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6588de-2d25-438f-b1d5-7ccd1e6dbe45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:55.194307 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6588de-2d25-438f-b1d5-7ccd1e6dbe45 service cinder] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:55.203737 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1436/2877] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:41:55 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:41:57.400890 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11aec8-b8bd-488f-a935-6696c9113084 None None] REQUEST_METHOD: `POST` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:57.401378 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11aec8-b8bd-488f-a935-6696c9113084 None None] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:57.401495 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11aec8-b8bd-488f-a935-6696c9113084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:57.419695 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.auth.core [None req-bf11aec8-b8bd-488f-a935-6696c9113084 None None] MFA Rules not processed for user `bcd74c3c272a427ba2e362c19cdbad8a`. Rule list: `[]` (Enabled: `True`). {{(pid=79318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 10:41:57.420883 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-bf11aec8-b8bd-488f-a935-6696c9113084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:57.427704 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1442/2878] 10.222.0.21 () {58 vars in 957 bytes} [Mon Feb 28 10:41:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 10:41:57.461623 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6588de-2d25-438f-b1d5-7ccd1e6dbe45 service cinder] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:57.463011 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-0e6588de-2d25-438f-b1d5-7ccd1e6dbe45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:57.474338 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6588de-2d25-438f-b1d5-7ccd1e6dbe45 service cinder] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:57.477857 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60737d0b-3d15-4dcf-9b87-9e7ce42c8a48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2e92304833d47828c52ae737f6b96cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:57.478476 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60737d0b-3d15-4dcf-9b87-9e7ce42c8a48 service cinder] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:57.478786 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60737d0b-3d15-4dcf-9b87-9e7ce42c8a48 service cinder] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:57.479061 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60737d0b-3d15-4dcf-9b87-9e7ce42c8a48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:57.481245 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-60737d0b-3d15-4dcf-9b87-9e7ce42c8a48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:57.548130 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60737d0b-3d15-4dcf-9b87-9e7ce42c8a48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:57.549547 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60737d0b-3d15-4dcf-9b87-9e7ce42c8a48 service cinder] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:57.560383 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1437/2879] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:41:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:41:58.275853 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11aec8-b8bd-488f-a935-6696c9113084 None None] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:41:58.277427 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-bf11aec8-b8bd-488f-a935-6696c9113084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:58.333851 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11aec8-b8bd-488f-a935-6696c9113084 None None] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:41:58.337498 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7203574-a880-4b91-a36f-c19585167403 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:41:58.338172 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7203574-a880-4b91-a36f-c19585167403 service neutron] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:41:58.338451 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7203574-a880-4b91-a36f-c19585167403 service neutron] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:41:58.338756 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7203574-a880-4b91-a36f-c19585167403 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:41:58.340804 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-c7203574-a880-4b91-a36f-c19585167403 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:41:58.355756 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7203574-a880-4b91-a36f-c19585167403 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:41:58.357173 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7203574-a880-4b91-a36f-c19585167403 service neutron] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:41:58.368398 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1443/2880] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:41:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:42:38.500956 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60737d0b-3d15-4dcf-9b87-9e7ce42c8a48 service cinder] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:42:38.502444 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-60737d0b-3d15-4dcf-9b87-9e7ce42c8a48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:42:38.514284 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60737d0b-3d15-4dcf-9b87-9e7ce42c8a48 service cinder] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:42:38.517808 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e4419a-87ff-4bbe-87d1-bb31c7909888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:42:38.518431 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4419a-87ff-4bbe-87d1-bb31c7909888 service neutron] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:42:38.518744 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4419a-87ff-4bbe-87d1-bb31c7909888 service neutron] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:42:38.519019 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4419a-87ff-4bbe-87d1-bb31c7909888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:42:38.520717 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-e4e4419a-87ff-4bbe-87d1-bb31c7909888 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:42:38.529809 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e4419a-87ff-4bbe-87d1-bb31c7909888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:42:38.531247 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e4419a-87ff-4bbe-87d1-bb31c7909888 service neutron] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:42:38.539025 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1438/2881] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:42:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:43:44.353408 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7203574-a880-4b91-a36f-c19585167403 service neutron] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:44.354936 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-c7203574-a880-4b91-a36f-c19585167403 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:44.370197 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7203574-a880-4b91-a36f-c19585167403 service neutron] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:44.376823 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16dc63-a3ab-4c4a-9baa-7622b2c7a236 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec202a34db8e47f4a6c18285245e3f5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:44.377578 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16dc63-a3ab-4c4a-9baa-7622b2c7a236 service nova] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:44.377980 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16dc63-a3ab-4c4a-9baa-7622b2c7a236 service nova] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:44.378326 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16dc63-a3ab-4c4a-9baa-7622b2c7a236 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:44.380224 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-3e16dc63-a3ab-4c4a-9baa-7622b2c7a236 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:44.393846 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16dc63-a3ab-4c4a-9baa-7622b2c7a236 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:44.395539 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16dc63-a3ab-4c4a-9baa-7622b2c7a236 service nova] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:44.409362 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1444/2882] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:43:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:43:56.476377 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e4419a-87ff-4bbe-87d1-bb31c7909888 service neutron] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:43:56.512979 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e4419a-87ff-4bbe-87d1-bb31c7909888 service neutron] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:43:56.516472 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f8522-ddab-404a-9c65-da2e9733b0db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaa12b94c834676bb17bf997dace5d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:43:56.517513 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f8522-ddab-404a-9c65-da2e9733b0db service neutron] REQUEST_METHOD: `GET` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:43:56.517815 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f8522-ddab-404a-9c65-da2e9733b0db service neutron] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:43:56.518087 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f8522-ddab-404a-9c65-da2e9733b0db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:43:56.519833 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-963f8522-ddab-404a-9c65-da2e9733b0db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:43:56.628769 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963f8522-ddab-404a-9c65-da2e9733b0db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:43:56.630172 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963f8522-ddab-404a-9c65-da2e9733b0db service neutron] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:43:56.649635 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1439/2883] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:43:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 10:44:02.826056 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16dc63-a3ab-4c4a-9baa-7622b2c7a236 service nova] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:44:02.827609 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-3e16dc63-a3ab-4c4a-9baa-7622b2c7a236 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:44:02.887327 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16dc63-a3ab-4c4a-9baa-7622b2c7a236 service nova] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:44:02.892585 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3506e1-5187-468a-bd5b-97f03efa0fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:44:02.893139 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3506e1-5187-468a-bd5b-97f03efa0fc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:44:02.893418 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3506e1-5187-468a-bd5b-97f03efa0fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:44:02.893693 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3506e1-5187-468a-bd5b-97f03efa0fc8 admin admin] PATH_INFO: `/v3/users/bcd74c3c272a427ba2e362c19cdbad8a` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:44:02.894928 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3506e1-5187-468a-bd5b-97f03efa0fc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcd74c3c272a427ba2e362c19cdbad8a)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:44:02.896820 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3506e1-5187-468a-bd5b-97f03efa0fc8 admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:44:02.945064 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-ca3506e1-5187-468a-bd5b-97f03efa0fc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcd74c3c272a427ba2e362c19cdbad8a'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:44:02.952024 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-ca3506e1-5187-468a-bd5b-97f03efa0fc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcd74c3c272a427ba2e362c19cdbad8a'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:44:02.952614 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-ca3506e1-5187-468a-bd5b-97f03efa0fc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcd74c3c272a427ba2e362c19cdbad8a'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:44:02.964466 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-ca3506e1-5187-468a-bd5b-97f03efa0fc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcd74c3c272a427ba2e362c19cdbad8a'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:44:02.971796 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-ca3506e1-5187-468a-bd5b-97f03efa0fc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcd74c3c272a427ba2e362c19cdbad8a'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:44:02.977556 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1445/2884] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:44:02 2022] DELETE /identity/v3/users/bcd74c3c272a427ba2e362c19cdbad8a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:44:03.145036 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f8522-ddab-404a-9c65-da2e9733b0db service neutron] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:44:03.155011 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f8522-ddab-404a-9c65-da2e9733b0db service neutron] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:44:03.210907 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0409cab-cd76-469b-80ec-3f1c8713dfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:44:03.211745 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0409cab-cd76-469b-80ec-3f1c8713dfef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:44:03.212022 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0409cab-cd76-469b-80ec-3f1c8713dfef admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:44:03.212294 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0409cab-cd76-469b-80ec-3f1c8713dfef admin admin] PATH_INFO: `/v3/projects/340c3f500cc14200bce6eb3ae5d77f21` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:44:03.213442 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0409cab-cd76-469b-80ec-3f1c8713dfef admin admin] RBAC: Authorizing `identity:delete_project(project_id=340c3f500cc14200bce6eb3ae5d77f21)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:44:03.215344 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0409cab-cd76-469b-80ec-3f1c8713dfef admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:44:03.260493 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-e0409cab-cd76-469b-80ec-3f1c8713dfef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '340c3f500cc14200bce6eb3ae5d77f21', 'request_id': 'req-e0409cab-cd76-469b-80ec-3f1c8713dfef'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:44:03.265818 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-e0409cab-cd76-469b-80ec-3f1c8713dfef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '340c3f500cc14200bce6eb3ae5d77f21', 'request_id': 'req-e0409cab-cd76-469b-80ec-3f1c8713dfef'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:44:03.271741 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-e0409cab-cd76-469b-80ec-3f1c8713dfef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '340c3f500cc14200bce6eb3ae5d77f21', 'request_id': 'req-e0409cab-cd76-469b-80ec-3f1c8713dfef'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:44:03.284076 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-e0409cab-cd76-469b-80ec-3f1c8713dfef admin admin] The token cache is being invalidate because project 340c3f500cc14200bce6eb3ae5d77f21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:44:03.284356 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-e0409cab-cd76-469b-80ec-3f1c8713dfef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:44:03.284969 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-e0409cab-cd76-469b-80ec-3f1c8713dfef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:44:03.286521 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1440/2885] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:44:03 2022] DELETE /identity/v3/projects/340c3f500cc14200bce6eb3ae5d77f21 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:44:03.290460 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3506e1-5187-468a-bd5b-97f03efa0fc8 admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:44:03.291870 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-ca3506e1-5187-468a-bd5b-97f03efa0fc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:44:03.305225 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3506e1-5187-468a-bd5b-97f03efa0fc8 admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:44:03.359115 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd37bae-d30f-428e-a686-6cc3e465029f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:44:03.360041 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd37bae-d30f-428e-a686-6cc3e465029f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:44:03.360264 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd37bae-d30f-428e-a686-6cc3e465029f admin admin] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:44:03.360901 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd37bae-d30f-428e-a686-6cc3e465029f admin admin] PATH_INFO: `/v3/users/5b4cb1ab41ef459e94acf5d4187e54fb` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:44:03.361884 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd37bae-d30f-428e-a686-6cc3e465029f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b4cb1ab41ef459e94acf5d4187e54fb)` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:44:03.363809 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd37bae-d30f-428e-a686-6cc3e465029f admin admin] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:44:03.409364 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-cbd37bae-d30f-428e-a686-6cc3e465029f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b4cb1ab41ef459e94acf5d4187e54fb'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:44:03.416108 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-cbd37bae-d30f-428e-a686-6cc3e465029f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b4cb1ab41ef459e94acf5d4187e54fb'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:44:03.416709 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-cbd37bae-d30f-428e-a686-6cc3e465029f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b4cb1ab41ef459e94acf5d4187e54fb'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:44:03.428240 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-cbd37bae-d30f-428e-a686-6cc3e465029f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b4cb1ab41ef459e94acf5d4187e54fb'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:44:03.434623 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.notifications [None req-cbd37bae-d30f-428e-a686-6cc3e465029f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b4cb1ab41ef459e94acf5d4187e54fb'} {{(pid=79318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:44:03.441218 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1446/2886] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Feb 28 10:44:03 2022] DELETE /identity/v3/users/5b4cb1ab41ef459e94acf5d4187e54fb => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:44:03.614080 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0409cab-cd76-469b-80ec-3f1c8713dfef admin admin] Authenticating user token {{(pid=79319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:44:03.615602 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.fernet_utils [None req-e0409cab-cd76-469b-80ec-3f1c8713dfef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:44:03.631799 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0409cab-cd76-469b-80ec-3f1c8713dfef admin admin] Validating token access rules against request {{(pid=79319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:44:03.690001 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2900b76-2e57-4ab9-8181-5aa4267c9771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ceda84916c547c4bc3f54154671eb74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5bfe7c1c3cf44edb4e5e5f5ea06d32a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:44:03.690871 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2900b76-2e57-4ab9-8181-5aa4267c9771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:44:03.691144 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2900b76-2e57-4ab9-8181-5aa4267c9771 admin admin] SCRIPT_NAME: `/identity` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:44:03.691414 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2900b76-2e57-4ab9-8181-5aa4267c9771 admin admin] PATH_INFO: `/v3/projects/d467e14abb3d4405a46a4500f82450fb` {{(pid=79319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:44:03.692643 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2900b76-2e57-4ab9-8181-5aa4267c9771 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d467e14abb3d4405a46a4500f82450fb)` {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:44:03.694451 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2900b76-2e57-4ab9-8181-5aa4267c9771 admin admin] RBAC: Authorization granted {{(pid=79319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:44:03.740727 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-d2900b76-2e57-4ab9-8181-5aa4267c9771 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd467e14abb3d4405a46a4500f82450fb', 'request_id': 'req-d2900b76-2e57-4ab9-8181-5aa4267c9771'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:44:03.745921 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-d2900b76-2e57-4ab9-8181-5aa4267c9771 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd467e14abb3d4405a46a4500f82450fb', 'request_id': 'req-d2900b76-2e57-4ab9-8181-5aa4267c9771'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:44:03.752329 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-d2900b76-2e57-4ab9-8181-5aa4267c9771 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd467e14abb3d4405a46a4500f82450fb', 'request_id': 'req-d2900b76-2e57-4ab9-8181-5aa4267c9771'} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:44:03.764286 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-d2900b76-2e57-4ab9-8181-5aa4267c9771 admin admin] The token cache is being invalidate because project d467e14abb3d4405a46a4500f82450fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 10:44:03.764570 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-d2900b76-2e57-4ab9-8181-5aa4267c9771 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:44:03.765185 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: DEBUG keystone.notifications [None req-d2900b76-2e57-4ab9-8181-5aa4267c9771 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 10:44:03.767415 dv-cinder-master-3-iscsi devstack@keystone.service[79319]: [pid: 79319|app: 0|req: 1441/2887] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Feb 28 10:44:03 2022] DELETE /identity/v3/projects/d467e14abb3d4405a46a4500f82450fb => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 10:45:46.804266 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd37bae-d30f-428e-a686-6cc3e465029f admin admin] Authenticating user token {{(pid=79318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 10:45:46.805906 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-cbd37bae-d30f-428e-a686-6cc3e465029f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:45:46.894282 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd37bae-d30f-428e-a686-6cc3e465029f admin admin] Validating token access rules against request {{(pid=79318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 10:45:46.953368 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c342a1f-b11f-4312-85f8-6b5148140efa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b2346e4de5d45a79d4bb2abb01d4827', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d1d6f8141924b2d99b766f975a3d43b', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 10:45:46.954012 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c342a1f-b11f-4312-85f8-6b5148140efa service placement] REQUEST_METHOD: `GET` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 10:45:46.954293 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c342a1f-b11f-4312-85f8-6b5148140efa service placement] SCRIPT_NAME: `/identity` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 10:45:46.954612 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c342a1f-b11f-4312-85f8-6b5148140efa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 10:45:46.956376 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.fernet_utils [None req-9c342a1f-b11f-4312-85f8-6b5148140efa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 10:45:46.968579 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c342a1f-b11f-4312-85f8-6b5148140efa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 10:45:46.970398 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c342a1f-b11f-4312-85f8-6b5148140efa service placement] RBAC: Authorization granted {{(pid=79318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 10:45:46.979998 dv-cinder-master-3-iscsi devstack@keystone.service[79318]: [pid: 79318|app: 0|req: 1447/2888] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Feb 28 10:45:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)